2024-09-10T08:35:13.389 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-10T08:35:13.411 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T08:35:13.495 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898932 branch: wip-rishabh-testing-20240909.165402-squid description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/snap_schedule_snapdir} email: null first_in_suite: false job_id: '7898932' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-rishabh-testing-20240909.165402-squid ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 client snapdir: .customsnapfuse debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b kclient: snapdirname: .customsnapkernel syntax: v2 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 subvolume_version: 2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240909.165402-squid sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b owner: scheduled_rishabh@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 9893 sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b sleep_before_teardown: 0 subset: 197/1024 suite: fs suite_branch: wip-rishabh-testing-20240909.165402-squid suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi002.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAj6fQQ6Vqh0CpzJ9llx9UfoqS5qSXV8XfheHWuIdabD9P4OlmAlggaW/zrkdsmD5DrMmLYORIxc45JWQ2luOt8= smithi155.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK5RR8vJeyVdzFJDnN/EZVzWPZBgAOwWFT6P1U/lnv43D6wS0ZHR0vnW8XkQ4Flx82w27JhhGQsvmHvjCBPZpoo= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-10_06:58:10 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-10T08:35:13.495 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa; will attempt to use it 2024-09-10T08:35:13.496 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa/tasks 2024-09-10T08:35:13.496 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-10T08:35:13.498 INFO:teuthology.task.internal:Checking packages... 2024-09-10T08:35:13.520 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '1cf819b7212a6048e92fc78c4eff963344f6d56b' 2024-09-10T08:35:13.520 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-10T08:35:13.520 INFO:teuthology.packaging:ref: None 2024-09-10T08:35:13.520 INFO:teuthology.packaging:tag: None 2024-09-10T08:35:13.520 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240909.165402-squid 2024-09-10T08:35:13.520 INFO:teuthology.packaging:sha1: 1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T08:35:13.520 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-rishabh-testing-20240909.165402-squid 2024-09-10T08:35:13.673 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-305.g1cf819b7 2024-09-10T08:35:13.675 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-10T08:35:13.681 INFO:teuthology.task.internal:no buildpackages task found 2024-09-10T08:35:13.681 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-10T08:35:13.707 INFO:teuthology.task.internal:Saving configuration 2024-09-10T08:35:13.723 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-10T08:35:13.732 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-10T08:35:13.756 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi002.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898932', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 08:29:58.538022', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAj6fQQ6Vqh0CpzJ9llx9UfoqS5qSXV8XfheHWuIdabD9P4OlmAlggaW/zrkdsmD5DrMmLYORIxc45JWQ2luOt8='} 2024-09-10T08:35:13.782 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi155.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898932', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 08:29:58.536531', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK5RR8vJeyVdzFJDnN/EZVzWPZBgAOwWFT6P1U/lnv43D6wS0ZHR0vnW8XkQ4Flx82w27JhhGQsvmHvjCBPZpoo='} 2024-09-10T08:35:13.782 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-10T08:35:13.789 INFO:teuthology.task.internal:roles: ubuntu@smithi002.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-09-10T08:35:13.789 INFO:teuthology.task.internal:roles: ubuntu@smithi155.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-09-10T08:35:13.789 INFO:teuthology.run_tasks:Running task console_log... 2024-09-10T08:35:13.863 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ffbae5abbe0>, signals=[15]) 2024-09-10T08:35:13.863 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-10T08:35:13.870 INFO:teuthology.task.internal:Opening connections... 2024-09-10T08:35:13.870 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi002.front.sepia.ceph.com 2024-09-10T08:35:13.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T08:35:13.949 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi155.front.sepia.ceph.com 2024-09-10T08:35:13.950 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T08:35:14.023 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-10T08:35:14.030 DEBUG:teuthology.orchestra.run.smithi002:> uname -m 2024-09-10T08:35:14.049 INFO:teuthology.orchestra.run.smithi002.stdout:x86_64 2024-09-10T08:35:14.049 DEBUG:teuthology.orchestra.run.smithi002:> cat /etc/os-release 2024-09-10T08:35:14.106 INFO:teuthology.orchestra.run.smithi002.stdout:NAME="CentOS Stream" 2024-09-10T08:35:14.106 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION="9" 2024-09-10T08:35:14.106 INFO:teuthology.orchestra.run.smithi002.stdout:ID="centos" 2024-09-10T08:35:14.106 INFO:teuthology.orchestra.run.smithi002.stdout:ID_LIKE="rhel fedora" 2024-09-10T08:35:14.106 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_ID="9" 2024-09-10T08:35:14.107 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM_ID="platform:el9" 2024-09-10T08:35:14.107 INFO:teuthology.orchestra.run.smithi002.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T08:35:14.107 INFO:teuthology.orchestra.run.smithi002.stdout:ANSI_COLOR="0;31" 2024-09-10T08:35:14.107 INFO:teuthology.orchestra.run.smithi002.stdout:LOGO="fedora-logo-icon" 2024-09-10T08:35:14.107 INFO:teuthology.orchestra.run.smithi002.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T08:35:14.107 INFO:teuthology.orchestra.run.smithi002.stdout:HOME_URL="https://centos.org/" 2024-09-10T08:35:14.107 INFO:teuthology.orchestra.run.smithi002.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T08:35:14.107 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T08:35:14.107 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T08:35:14.108 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server 2024-09-10T08:35:14.125 DEBUG:teuthology.orchestra.run.smithi155:> uname -m 2024-09-10T08:35:14.143 INFO:teuthology.orchestra.run.smithi155.stdout:x86_64 2024-09-10T08:35:14.144 DEBUG:teuthology.orchestra.run.smithi155:> cat /etc/os-release 2024-09-10T08:35:14.201 INFO:teuthology.orchestra.run.smithi155.stdout:NAME="CentOS Stream" 2024-09-10T08:35:14.201 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION="9" 2024-09-10T08:35:14.201 INFO:teuthology.orchestra.run.smithi155.stdout:ID="centos" 2024-09-10T08:35:14.202 INFO:teuthology.orchestra.run.smithi155.stdout:ID_LIKE="rhel fedora" 2024-09-10T08:35:14.202 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_ID="9" 2024-09-10T08:35:14.202 INFO:teuthology.orchestra.run.smithi155.stdout:PLATFORM_ID="platform:el9" 2024-09-10T08:35:14.202 INFO:teuthology.orchestra.run.smithi155.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-10T08:35:14.202 INFO:teuthology.orchestra.run.smithi155.stdout:ANSI_COLOR="0;31" 2024-09-10T08:35:14.202 INFO:teuthology.orchestra.run.smithi155.stdout:LOGO="fedora-logo-icon" 2024-09-10T08:35:14.202 INFO:teuthology.orchestra.run.smithi155.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-10T08:35:14.202 INFO:teuthology.orchestra.run.smithi155.stdout:HOME_URL="https://centos.org/" 2024-09-10T08:35:14.202 INFO:teuthology.orchestra.run.smithi155.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-10T08:35:14.202 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-10T08:35:14.202 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-10T08:35:14.203 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server 2024-09-10T08:35:14.217 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-10T08:35:14.226 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-10T08:35:14.249 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-10T08:35:14.249 DEBUG:teuthology.orchestra.run.smithi002:> test '!' -e /home/ubuntu/cephtest 2024-09-10T08:35:14.251 DEBUG:teuthology.orchestra.run.smithi155:> test '!' -e /home/ubuntu/cephtest 2024-09-10T08:35:14.268 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-10T08:35:14.282 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-10T08:35:14.282 DEBUG:teuthology.orchestra.run.smithi002:> test -z $(ls -A /var/lib/ceph) 2024-09-10T08:35:14.309 DEBUG:teuthology.orchestra.run.smithi155:> test -z $(ls -A /var/lib/ceph) 2024-09-10T08:35:14.332 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-10T08:35:14.385 INFO:teuthology.run_tasks:Running task kernel... 2024-09-10T08:35:14.411 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-10T08:35:14.412 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-09-10T08:35:14.412 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-09-10T08:35:14.412 DEBUG:teuthology.orchestra.run.smithi002:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T08:35:14.413 DEBUG:teuthology.orchestra.run.smithi155:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T08:35:14.432 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T08:35:14.433 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-09-10T08:35:14.439 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T08:35:14.440 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-09-10T08:35:14.649 DEBUG:teuthology.task.kernel:sha1 for client.0 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T08:35:14.649 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-10T08:35:14.649 DEBUG:teuthology.orchestra.run.smithi002:> uname -r 2024-09-10T08:35:14.667 INFO:teuthology.orchestra.run.smithi002.stdout:5.14.0-503.el9.x86_64 2024-09-10T08:35:14.667 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T08:35:14.668 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-10T08:35:14.668 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum upgrade -y linux-firmware 2024-09-10T08:35:14.693 DEBUG:teuthology.task.kernel:sha1 for client.1 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T08:35:14.693 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-10T08:35:14.694 DEBUG:teuthology.orchestra.run.smithi155:> uname -r 2024-09-10T08:35:14.712 INFO:teuthology.orchestra.run.smithi155.stdout:5.14.0-503.el9.x86_64 2024-09-10T08:35:14.713 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T08:35:14.713 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-10T08:35:14.713 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum upgrade -y linux-firmware 2024-09-10T08:35:18.394 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 9 - BaseOS 4.5 MB/s | 8.2 MB 00:01 2024-09-10T08:35:19.137 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - BaseOS 3.0 MB/s | 8.2 MB 00:02 2024-09-10T08:35:21.795 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 9 - AppStream 8.9 MB/s | 20 MB 00:02 2024-09-10T08:35:26.037 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 9 - CRB 16 MB/s | 6.5 MB 00:00 2024-09-10T08:35:27.687 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - AppStream 2.8 MB/s | 20 MB 00:07 2024-09-10T08:35:27.905 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 9 - Extras packages 28 kB/s | 19 kB 00:00 2024-09-10T08:35:28.859 INFO:teuthology.orchestra.run.smithi155.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-10T08:35:33.063 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - CRB 4.5 MB/s | 6.5 MB 00:01 2024-09-10T08:35:34.289 INFO:teuthology.orchestra.run.smithi155.stdout:lab-extras 42 kB/s | 1.7 kB 00:00 2024-09-10T08:35:34.580 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - Extras packages 80 kB/s | 19 kB 00:00 2024-09-10T08:35:35.892 INFO:teuthology.orchestra.run.smithi002.stdout:Extra Packages for Enterprise Linux 19 MB/s | 23 MB 00:01 2024-09-10T08:35:36.415 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2024-09-10T08:35:36.416 INFO:teuthology.orchestra.run.smithi155.stdout:Nothing to do. 2024-09-10T08:35:36.416 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2024-09-10T08:35:36.516 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.1... 2024-09-10T08:35:36.516 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T08:35:36.666 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-10T08:35:36.666 DEBUG:teuthology.orchestra.run.smithi155:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-10T08:35:36.669 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi155.front.sepia.ceph.com to complete... 2024-09-10T08:35:41.541 INFO:teuthology.orchestra.run.smithi002.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-10T08:35:42.977 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10 08:35:42 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-10T08:35:42.977 INFO:teuthology.orchestra.run.smithi155.stderr:FINISHED --2024-09-10 08:35:42-- 2024-09-10T08:35:42.977 INFO:teuthology.orchestra.run.smithi155.stderr:Total wall clock time: 6.3s 2024-09-10T08:35:42.977 INFO:teuthology.orchestra.run.smithi155.stderr:Downloaded: 1 files, 343M in 6.0s (57.1 MB/s) 2024-09-10T08:35:42.980 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.1... 2024-09-10T08:35:42.981 DEBUG:teuthology.orchestra.run.smithi155:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-10T08:35:43.718 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-10T08:35:43.719 INFO:teuthology.orchestra.run.smithi002.stdout:Nothing to do. 2024-09-10T08:35:43.719 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-10T08:35:43.799 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-10T08:35:43.800 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-10T08:35:43.937 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-10T08:35:43.938 DEBUG:teuthology.orchestra.run.smithi002:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-10T08:35:43.940 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi002.front.sepia.ceph.com to complete... 2024-09-10T08:35:45.319 INFO:teuthology.orchestra.run.smithi155.stdout:Verifying... ######################################## 2024-09-10T08:35:45.540 INFO:teuthology.orchestra.run.smithi155.stdout:Preparing... ######################################## 2024-09-10T08:35:45.654 INFO:teuthology.orchestra.run.smithi155.stdout:Updating / installing... 2024-09-10T08:35:50.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10 08:35:50 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-10T08:35:50.260 INFO:teuthology.orchestra.run.smithi002.stderr:FINISHED --2024-09-10 08:35:50-- 2024-09-10T08:35:50.260 INFO:teuthology.orchestra.run.smithi002.stderr:Total wall clock time: 6.3s 2024-09-10T08:35:50.260 INFO:teuthology.orchestra.run.smithi002.stderr:Downloaded: 1 files, 343M in 6.0s (57.1 MB/s) 2024-09-10T08:35:50.263 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-10T08:35:50.263 DEBUG:teuthology.orchestra.run.smithi002:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-10T08:35:52.469 INFO:teuthology.orchestra.run.smithi002.stdout:Verifying... ######################################## 2024-09-10T08:35:52.635 INFO:teuthology.orchestra.run.smithi002.stdout:Preparing... ######################################## 2024-09-10T08:35:52.752 INFO:teuthology.orchestra.run.smithi002.stdout:Updating / installing... 2024-09-10T08:35:53.695 INFO:teuthology.orchestra.run.smithi155.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-10T08:36:01.084 INFO:teuthology.orchestra.run.smithi002.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-10T08:36:33.436 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi155.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-10T08:36:33.437 DEBUG:teuthology.orchestra.run.smithi155:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-10T08:36:33.516 INFO:teuthology.orchestra.run.smithi155.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T08:36:33.517 INFO:teuthology.orchestra.run.smithi155.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T08:36:33.517 INFO:teuthology.orchestra.run.smithi155.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T08:36:33.517 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-10T08:36:33.517 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-10T08:36:33.517 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-10T08:36:33.517 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-10T08:36:33.517 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-10T08:36:33.517 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-10T08:36:33.518 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-10T08:36:33.518 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-10T08:36:33.518 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-10T08:36:33.518 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-10T08:36:33.518 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-10T08:36:33.518 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-10T08:36:33.518 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-10T08:36:33.518 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-10T08:36:33.518 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-10T08:36:33.518 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-10T08:36:33.518 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-10T08:36:33.518 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-10T08:36:33.519 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-10T08:36:33.519 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-10T08:36:33.519 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-10T08:36:33.519 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-10T08:36:33.519 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-10T08:36:33.519 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-10T08:36:33.519 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-10T08:36:33.519 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-10T08:36:33.519 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-10T08:36:33.519 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-10T08:36:33.519 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-10T08:36:33.519 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-10T08:36:33.520 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-10T08:36:33.520 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-10T08:36:33.520 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-10T08:36:33.520 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-10T08:36:33.520 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-10T08:36:33.520 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-10T08:36:33.520 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-10T08:36:33.520 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-10T08:36:33.520 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-10T08:36:33.520 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-10T08:36:33.520 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-10T08:36:33.520 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-10T08:36:33.520 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-10T08:36:33.521 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-10T08:36:33.521 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-10T08:36:33.521 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-10T08:36:33.521 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-10T08:36:33.521 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-10T08:36:33.521 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-10T08:36:33.521 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-10T08:36:33.521 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-10T08:36:33.521 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-10T08:36:33.521 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-10T08:36:33.521 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-10T08:36:33.521 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-10T08:36:33.522 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-10T08:36:33.522 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-10T08:36:33.522 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-10T08:36:33.522 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-10T08:36:33.522 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-10T08:36:33.522 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-10T08:36:33.522 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-10T08:36:33.522 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-10T08:36:33.522 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-10T08:36:33.522 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-10T08:36:33.523 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-10T08:36:33.523 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-10T08:36:33.523 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-10T08:36:33.523 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-10T08:36:33.523 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-10T08:36:33.523 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-10T08:36:33.523 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-10T08:36:33.523 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-10T08:36:33.523 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-10T08:36:33.523 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-10T08:36:33.523 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-10T08:36:33.523 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-10T08:36:33.523 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-10T08:36:33.524 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-10T08:36:33.524 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-10T08:36:33.524 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-10T08:36:33.524 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-10T08:36:33.524 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-10T08:36:33.524 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-10T08:36:33.524 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-10T08:36:33.524 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-10T08:36:33.524 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-10T08:36:33.524 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-10T08:36:33.524 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-10T08:36:33.524 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-10T08:36:33.524 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-10T08:36:33.525 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-10T08:36:33.525 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-10T08:36:33.525 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-10T08:36:33.525 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-10T08:36:33.525 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-10T08:36:33.525 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-10T08:36:33.525 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-10T08:36:33.525 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-10T08:36:33.525 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-10T08:36:33.525 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-10T08:36:33.525 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-10T08:36:33.525 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-10T08:36:33.525 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-10T08:36:33.526 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-10T08:36:33.526 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-10T08:36:33.526 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-10T08:36:33.526 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-10T08:36:33.526 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-10T08:36:33.526 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-10T08:36:33.526 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-10T08:36:33.526 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-10T08:36:33.526 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-10T08:36:33.526 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-10T08:36:33.526 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-10T08:36:33.526 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-10T08:36:33.526 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-10T08:36:33.527 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-10T08:36:33.527 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-10T08:36:33.527 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-10T08:36:33.527 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-10T08:36:33.527 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-10T08:36:33.527 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-10T08:36:33.527 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-10T08:36:33.527 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-10T08:36:33.527 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-10T08:36:33.528 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-10T08:36:33.528 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-10T08:36:33.528 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-10T08:36:33.528 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-10T08:36:33.528 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-10T08:36:33.528 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-10T08:36:33.528 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-10T08:36:33.528 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-10T08:36:33.528 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-10T08:36:33.528 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-10T08:36:33.528 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-10T08:36:33.528 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-10T08:36:33.529 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-10T08:36:33.529 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-10T08:36:33.529 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-10T08:36:33.529 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-10T08:36:33.529 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-10T08:36:33.529 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-10T08:36:33.529 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-10T08:36:33.529 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-10T08:36:33.529 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-10T08:36:33.529 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-10T08:36:33.529 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-10T08:36:33.529 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-10T08:36:33.529 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-10T08:36:33.530 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-10T08:36:33.530 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-10T08:36:33.530 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-10T08:36:33.530 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-10T08:36:33.530 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-10T08:36:33.530 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-10T08:36:33.530 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-10T08:36:33.530 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-10T08:36:33.530 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-10T08:36:33.530 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-10T08:36:33.530 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-10T08:36:33.530 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-10T08:36:33.530 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-10T08:36:33.531 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-10T08:36:33.531 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-10T08:36:33.531 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-10T08:36:33.531 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-10T08:36:33.531 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-10T08:36:33.531 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-10T08:36:33.531 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-10T08:36:33.531 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-10T08:36:33.531 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-10T08:36:33.531 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-10T08:36:33.531 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-10T08:36:33.531 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-10T08:36:33.531 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-10T08:36:33.531 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-10T08:36:33.532 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-10T08:36:33.532 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-10T08:36:33.532 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-10T08:36:33.532 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-10T08:36:33.532 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-10T08:36:33.532 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-10T08:36:33.532 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-10T08:36:33.532 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-10T08:36:33.532 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-10T08:36:33.532 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-10T08:36:33.532 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-10T08:36:33.532 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-10T08:36:33.532 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-10T08:36:33.533 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-10T08:36:33.533 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-10T08:36:33.533 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-10T08:36:33.533 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-10T08:36:33.533 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-10T08:36:33.533 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-10T08:36:33.533 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-10T08:36:33.533 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-10T08:36:33.533 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-10T08:36:33.533 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-10T08:36:33.533 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-10T08:36:33.533 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-10T08:36:33.533 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-10T08:36:33.534 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-10T08:36:33.534 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-10T08:36:33.534 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-10T08:36:33.534 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-10T08:36:33.534 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-10T08:36:33.534 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-10T08:36:33.534 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-10T08:36:33.534 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-10T08:36:33.534 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-10T08:36:33.534 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-10T08:36:33.534 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-10T08:36:33.534 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-10T08:36:33.534 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-10T08:36:33.534 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-10T08:36:33.535 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-10T08:36:33.535 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-10T08:36:33.535 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-10T08:36:33.535 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-10T08:36:33.535 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-10T08:36:33.535 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-10T08:36:33.535 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-10T08:36:33.535 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-10T08:36:33.535 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-10T08:36:33.535 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-10T08:36:33.535 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-10T08:36:33.535 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-10T08:36:33.535 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-10T08:36:33.536 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-10T08:36:33.536 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-10T08:36:33.536 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-10T08:36:33.536 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-10T08:36:33.536 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-10T08:36:33.536 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-10T08:36:33.536 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-10T08:36:33.536 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-10T08:36:33.536 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-10T08:36:33.536 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-10T08:36:33.536 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-10T08:36:33.536 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-10T08:36:33.536 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-10T08:36:33.537 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-10T08:36:33.537 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-10T08:36:33.537 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-10T08:36:33.537 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-10T08:36:33.537 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-10T08:36:33.537 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-10T08:36:33.537 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-10T08:36:33.537 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-10T08:36:33.537 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-10T08:36:33.537 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-10T08:36:33.537 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-10T08:36:33.537 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-10T08:36:33.537 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-10T08:36:33.538 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-10T08:36:33.538 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-10T08:36:33.538 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-10T08:36:33.538 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-10T08:36:33.538 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-10T08:36:33.538 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-10T08:36:33.538 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-10T08:36:33.538 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-10T08:36:33.538 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-10T08:36:33.538 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-10T08:36:33.538 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-10T08:36:33.538 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-10T08:36:33.538 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-10T08:36:33.539 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-10T08:36:33.539 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-10T08:36:33.539 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-10T08:36:33.539 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-10T08:36:33.539 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-10T08:36:33.539 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-10T08:36:33.539 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-10T08:36:33.539 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-10T08:36:33.540 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-10T08:36:33.540 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-10T08:36:33.540 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-10T08:36:33.540 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-10T08:36:33.540 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-10T08:36:33.540 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-10T08:36:33.540 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-10T08:36:33.540 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-10T08:36:33.540 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-10T08:36:33.540 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-10T08:36:33.540 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-10T08:36:33.540 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-10T08:36:33.540 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-10T08:36:33.541 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-10T08:36:33.541 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-10T08:36:33.541 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-10T08:36:33.541 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-10T08:36:33.541 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-10T08:36:33.541 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-10T08:36:33.541 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-10T08:36:33.541 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-10T08:36:33.541 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-10T08:36:33.541 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-10T08:36:33.541 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-10T08:36:33.541 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-10T08:36:33.542 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-10T08:36:33.542 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-10T08:36:33.542 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-10T08:36:33.542 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-10T08:36:33.542 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-10T08:36:33.542 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-10T08:36:33.542 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-10T08:36:33.542 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-10T08:36:33.542 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-10T08:36:33.542 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-10T08:36:33.542 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-10T08:36:33.542 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-10T08:36:33.542 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-10T08:36:33.542 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-10T08:36:33.543 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-10T08:36:33.543 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-10T08:36:33.543 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-10T08:36:33.543 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-10T08:36:33.543 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-10T08:36:33.543 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-10T08:36:33.543 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-10T08:36:33.543 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-10T08:36:33.543 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-10T08:36:33.543 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-10T08:36:33.543 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-10T08:36:33.543 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-10T08:36:33.543 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-10T08:36:33.543 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-10T08:36:33.544 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-10T08:36:33.544 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-10T08:36:33.544 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-10T08:36:33.544 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-10T08:36:33.544 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-10T08:36:33.544 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-10T08:36:33.544 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-10T08:36:33.544 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-10T08:36:33.544 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-10T08:36:33.544 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-10T08:36:33.544 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-10T08:36:33.544 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-10T08:36:33.545 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-10T08:36:33.545 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-10T08:36:33.545 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-10T08:36:33.545 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-10T08:36:33.545 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-10T08:36:33.545 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-10T08:36:33.545 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-10T08:36:33.545 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-10T08:36:33.545 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-10T08:36:33.545 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-10T08:36:33.545 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-10T08:36:33.545 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-10T08:36:33.546 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-10T08:36:33.546 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-10T08:36:33.546 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-10T08:36:33.546 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-10T08:36:33.546 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-10T08:36:33.546 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-10T08:36:33.546 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-10T08:36:33.546 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-10T08:36:33.546 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-10T08:36:33.546 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-10T08:36:33.546 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-10T08:36:33.546 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-10T08:36:33.547 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-10T08:36:33.547 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-10T08:36:33.547 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-10T08:36:33.547 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-10T08:36:33.547 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-10T08:36:33.547 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-10T08:36:33.547 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-10T08:36:33.547 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-10T08:36:33.547 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-10T08:36:33.547 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-10T08:36:33.547 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-10T08:36:33.547 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-10T08:36:33.548 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-10T08:36:33.548 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-10T08:36:33.548 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-10T08:36:33.548 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-10T08:36:33.548 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-10T08:36:33.548 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-10T08:36:33.548 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-10T08:36:33.548 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-10T08:36:33.548 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-10T08:36:33.548 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-10T08:36:33.548 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-10T08:36:33.548 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-10T08:36:33.548 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-10T08:36:33.549 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-10T08:36:33.549 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-10T08:36:33.549 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-10T08:36:33.549 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-10T08:36:33.549 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-10T08:36:33.549 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-10T08:36:33.549 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-10T08:36:33.549 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-10T08:36:33.549 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-10T08:36:33.549 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-10T08:36:33.549 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-10T08:36:33.549 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-10T08:36:33.549 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-10T08:36:33.550 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-10T08:36:33.550 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-10T08:36:33.550 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-10T08:36:33.550 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-10T08:36:33.550 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-10T08:36:33.550 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-10T08:36:33.550 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-10T08:36:33.550 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-10T08:36:33.550 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-10T08:36:33.550 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-10T08:36:33.550 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-10T08:36:33.550 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-10T08:36:33.550 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-10T08:36:33.551 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-10T08:36:33.551 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-10T08:36:33.551 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-10T08:36:33.551 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-10T08:36:33.551 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-10T08:36:33.551 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-10T08:36:33.551 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-10T08:36:33.551 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-10T08:36:33.551 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-10T08:36:33.551 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-10T08:36:33.551 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-10T08:36:33.551 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-10T08:36:33.551 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-10T08:36:33.552 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-10T08:36:33.552 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-10T08:36:33.552 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-10T08:36:33.552 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-10T08:36:33.552 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-10T08:36:33.552 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-10T08:36:33.552 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-10T08:36:33.552 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-10T08:36:33.552 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-10T08:36:33.552 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-10T08:36:33.552 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-10T08:36:33.552 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-10T08:36:33.552 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-10T08:36:33.553 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-10T08:36:33.553 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-10T08:36:33.553 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-10T08:36:33.553 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-10T08:36:33.553 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-10T08:36:33.553 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-10T08:36:33.553 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-10T08:36:33.553 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-10T08:36:33.553 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-10T08:36:33.553 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-10T08:36:33.553 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-10T08:36:33.553 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-10T08:36:33.553 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-10T08:36:33.554 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-10T08:36:33.554 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-10T08:36:33.554 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-10T08:36:33.554 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-10T08:36:33.554 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-10T08:36:33.554 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-10T08:36:33.554 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-10T08:36:33.554 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-10T08:36:33.554 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-10T08:36:33.554 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-10T08:36:33.554 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-10T08:36:33.554 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-10T08:36:33.554 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-10T08:36:33.555 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-10T08:36:33.555 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-10T08:36:33.555 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-10T08:36:33.555 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-10T08:36:33.555 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-10T08:36:33.555 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-10T08:36:33.555 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-10T08:36:33.555 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-10T08:36:33.555 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-10T08:36:33.555 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-10T08:36:33.555 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-10T08:36:33.555 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-10T08:36:33.555 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-10T08:36:33.556 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-10T08:36:33.556 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-10T08:36:33.556 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-10T08:36:33.556 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-10T08:36:33.556 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-10T08:36:33.556 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-10T08:36:33.556 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-10T08:36:33.556 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-10T08:36:33.556 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-10T08:36:33.556 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-10T08:36:33.556 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-10T08:36:33.556 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-10T08:36:33.557 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-10T08:36:33.557 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-10T08:36:33.557 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-10T08:36:33.557 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-10T08:36:33.557 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-10T08:36:33.557 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-10T08:36:33.557 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-10T08:36:33.557 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-10T08:36:33.557 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-10T08:36:33.557 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-10T08:36:33.557 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-10T08:36:33.557 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-10T08:36:33.557 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-10T08:36:33.558 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-10T08:36:33.558 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-10T08:36:33.558 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-10T08:36:33.558 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-10T08:36:33.558 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-10T08:36:33.558 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-10T08:36:33.558 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-10T08:36:33.558 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-10T08:36:33.558 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-10T08:36:33.558 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-10T08:36:33.558 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-10T08:36:33.558 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-10T08:36:33.559 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-10T08:36:33.559 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-10T08:36:33.559 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-10T08:36:33.559 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-10T08:36:33.559 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-10T08:36:33.559 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-10T08:36:33.559 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-10T08:36:33.559 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-10T08:36:33.559 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-10T08:36:33.559 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-10T08:36:33.559 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-10T08:36:33.559 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-10T08:36:33.559 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-10T08:36:33.559 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-10T08:36:33.560 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-10T08:36:33.560 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-10T08:36:33.560 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-10T08:36:33.560 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-10T08:36:33.560 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-10T08:36:33.560 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-10T08:36:33.560 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-10T08:36:33.560 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-10T08:36:33.560 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-10T08:36:33.560 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-10T08:36:33.560 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-10T08:36:33.560 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-10T08:36:33.560 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-10T08:36:33.561 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-10T08:36:33.561 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-10T08:36:33.561 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-10T08:36:33.561 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-10T08:36:33.561 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-10T08:36:33.561 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-10T08:36:33.561 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-10T08:36:33.561 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-10T08:36:33.561 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-10T08:36:33.561 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-10T08:36:33.561 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-10T08:36:33.561 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-10T08:36:33.561 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-10T08:36:33.562 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-10T08:36:33.562 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-10T08:36:33.562 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-10T08:36:33.562 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-10T08:36:33.562 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-10T08:36:33.562 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-10T08:36:33.562 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-10T08:36:33.562 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-10T08:36:33.562 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-10T08:36:33.562 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-10T08:36:33.562 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-10T08:36:33.562 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-10T08:36:33.562 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-10T08:36:33.563 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-10T08:36:33.563 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-10T08:36:33.563 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-10T08:36:33.563 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-10T08:36:33.563 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-10T08:36:33.563 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-10T08:36:33.563 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-10T08:36:33.563 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-10T08:36:33.563 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-10T08:36:33.563 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-10T08:36:33.563 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-10T08:36:33.563 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-10T08:36:33.564 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-10T08:36:33.564 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-10T08:36:33.564 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-10T08:36:33.564 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-10T08:36:33.564 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-10T08:36:33.564 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-10T08:36:33.564 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-10T08:36:33.564 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-10T08:36:33.564 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-10T08:36:33.564 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-10T08:36:33.564 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-10T08:36:33.564 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-10T08:36:33.564 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-10T08:36:33.564 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-10T08:36:33.565 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-10T08:36:33.565 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-10T08:36:33.565 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-10T08:36:33.565 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-10T08:36:33.565 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-10T08:36:33.565 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-10T08:36:33.565 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-10T08:36:33.565 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-10T08:36:33.565 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-10T08:36:33.565 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-10T08:36:33.565 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-10T08:36:33.565 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-10T08:36:33.565 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-10T08:36:33.566 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-10T08:36:33.566 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-10T08:36:33.566 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-10T08:36:33.566 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-10T08:36:33.566 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-10T08:36:33.566 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-10T08:36:33.566 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-10T08:36:33.566 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-10T08:36:33.566 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-10T08:36:33.566 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-10T08:36:33.566 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-10T08:36:33.566 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-10T08:36:33.566 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-10T08:36:33.566 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-10T08:36:33.567 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-10T08:36:33.567 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-10T08:36:33.567 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-10T08:36:33.567 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-10T08:36:33.567 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-10T08:36:33.567 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-10T08:36:33.567 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-10T08:36:33.567 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-10T08:36:33.567 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-10T08:36:33.567 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-10T08:36:33.567 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-10T08:36:33.567 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-10T08:36:33.568 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-10T08:36:33.568 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-10T08:36:33.568 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-10T08:36:33.568 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-10T08:36:33.568 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-10T08:36:33.568 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-10T08:36:33.568 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-10T08:36:33.568 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-10T08:36:33.568 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-10T08:36:33.568 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-10T08:36:33.568 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-10T08:36:33.568 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-10T08:36:33.568 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-10T08:36:33.569 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-10T08:36:33.569 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-10T08:36:33.569 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-10T08:36:33.569 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-10T08:36:33.569 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-10T08:36:33.569 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-10T08:36:33.569 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-10T08:36:33.569 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-10T08:36:33.569 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-10T08:36:33.569 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-10T08:36:33.569 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-10T08:36:33.569 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-10T08:36:33.569 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-10T08:36:33.570 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-10T08:36:33.570 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-10T08:36:33.570 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-10T08:36:33.570 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-10T08:36:33.570 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-10T08:36:33.570 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-10T08:36:33.570 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-10T08:36:33.570 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-10T08:36:33.570 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-10T08:36:33.570 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-10T08:36:33.570 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-10T08:36:33.570 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-10T08:36:33.571 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-10T08:36:33.571 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-10T08:36:33.571 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-10T08:36:33.571 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-10T08:36:33.571 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-10T08:36:33.571 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-10T08:36:33.571 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-10T08:36:33.571 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-10T08:36:33.571 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-10T08:36:33.571 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-10T08:36:33.571 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-10T08:36:33.571 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-10T08:36:33.571 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-10T08:36:33.572 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-10T08:36:33.572 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-10T08:36:33.572 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-10T08:36:33.572 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-10T08:36:33.572 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-10T08:36:33.572 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-10T08:36:33.572 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-10T08:36:33.572 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-10T08:36:33.572 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-10T08:36:33.572 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-10T08:36:33.572 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-10T08:36:33.572 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-10T08:36:33.573 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-10T08:36:33.573 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-10T08:36:33.573 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-10T08:36:33.573 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-10T08:36:33.573 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-10T08:36:33.573 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-10T08:36:33.573 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-10T08:36:33.573 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-10T08:36:33.574 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-10T08:36:33.574 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-10T08:36:33.574 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-10T08:36:33.574 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-10T08:36:33.574 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-10T08:36:33.574 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-10T08:36:33.574 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-10T08:36:33.574 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-10T08:36:33.574 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-10T08:36:33.574 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-10T08:36:33.574 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-10T08:36:33.574 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-10T08:36:33.574 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-10T08:36:33.574 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-10T08:36:33.575 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-10T08:36:33.575 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-10T08:36:33.575 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-10T08:36:33.575 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-10T08:36:33.575 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-10T08:36:33.575 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-10T08:36:33.575 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-10T08:36:33.575 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-10T08:36:33.575 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-10T08:36:33.575 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-10T08:36:33.576 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-10T08:36:33.576 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-10T08:36:33.576 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-10T08:36:33.576 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-10T08:36:33.576 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-10T08:36:33.576 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-10T08:36:33.576 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-10T08:36:33.576 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-10T08:36:33.576 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-10T08:36:33.576 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-10T08:36:33.576 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-10T08:36:33.576 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-10T08:36:33.576 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-10T08:36:33.577 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-10T08:36:33.577 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-10T08:36:33.577 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-10T08:36:33.577 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-10T08:36:33.577 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-10T08:36:33.577 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-10T08:36:33.577 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-10T08:36:33.577 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-10T08:36:33.577 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-10T08:36:33.578 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-10T08:36:33.578 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-10T08:36:33.578 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-10T08:36:33.578 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-10T08:36:33.578 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-10T08:36:33.578 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-10T08:36:33.578 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-10T08:36:33.578 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-10T08:36:33.578 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-10T08:36:33.578 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-10T08:36:33.578 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-10T08:36:33.578 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-10T08:36:33.578 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-10T08:36:33.578 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-10T08:36:33.579 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-10T08:36:33.579 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-10T08:36:33.579 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-10T08:36:33.579 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-10T08:36:33.579 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-10T08:36:33.579 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-10T08:36:33.579 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-10T08:36:33.579 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-10T08:36:33.579 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-10T08:36:33.579 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-10T08:36:33.579 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-10T08:36:33.579 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-10T08:36:33.579 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-10T08:36:33.580 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-10T08:36:33.580 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-10T08:36:33.580 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-10T08:36:33.580 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-10T08:36:33.580 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-10T08:36:33.580 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-10T08:36:33.580 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-10T08:36:33.580 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-10T08:36:33.580 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-10T08:36:33.580 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-10T08:36:33.580 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-10T08:36:33.580 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-10T08:36:33.580 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-10T08:36:33.580 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-10T08:36:33.581 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-10T08:36:33.581 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-10T08:36:33.581 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-10T08:36:33.581 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-10T08:36:33.581 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-10T08:36:33.581 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-10T08:36:33.581 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-10T08:36:33.581 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-10T08:36:33.581 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-10T08:36:33.581 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-10T08:36:33.581 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-10T08:36:33.581 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-10T08:36:33.582 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-10T08:36:33.582 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-10T08:36:33.582 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-10T08:36:33.582 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-10T08:36:33.582 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-10T08:36:33.582 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-10T08:36:33.582 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-10T08:36:33.582 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-10T08:36:33.582 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-10T08:36:33.582 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-10T08:36:33.582 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-10T08:36:33.582 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-10T08:36:33.582 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-10T08:36:33.582 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-10T08:36:33.583 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-10T08:36:33.583 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-10T08:36:33.583 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-10T08:36:33.583 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-10T08:36:33.583 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-10T08:36:33.583 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-10T08:36:33.583 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-10T08:36:33.583 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-10T08:36:33.583 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-10T08:36:33.583 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-10T08:36:33.583 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-10T08:36:33.583 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-10T08:36:33.583 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-10T08:36:33.583 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-10T08:36:33.584 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-10T08:36:33.584 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-10T08:36:33.584 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-10T08:36:33.584 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-10T08:36:33.584 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-10T08:36:33.584 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-10T08:36:33.584 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-10T08:36:33.584 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-10T08:36:33.584 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-10T08:36:33.584 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-10T08:36:33.584 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-10T08:36:33.584 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-10T08:36:33.584 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-10T08:36:33.585 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-10T08:36:33.585 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-10T08:36:33.585 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-10T08:36:33.585 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-10T08:36:33.585 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-10T08:36:33.585 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-10T08:36:33.585 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-10T08:36:33.585 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-10T08:36:33.585 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-10T08:36:33.585 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-10T08:36:33.585 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-10T08:36:33.585 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-10T08:36:33.585 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-10T08:36:33.586 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-10T08:36:33.586 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-10T08:36:33.586 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-10T08:36:33.586 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-10T08:36:33.586 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-10T08:36:33.586 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-10T08:36:33.586 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-10T08:36:33.586 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-10T08:36:33.586 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-10T08:36:33.586 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-10T08:36:33.586 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-10T08:36:33.586 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-10T08:36:33.586 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-10T08:36:33.587 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-10T08:36:33.587 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-10T08:36:33.587 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-10T08:36:33.587 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-10T08:36:33.587 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-10T08:36:33.587 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-10T08:36:33.587 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-10T08:36:33.587 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-10T08:36:33.587 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-10T08:36:33.587 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-10T08:36:33.587 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-10T08:36:33.587 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-10T08:36:33.587 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-10T08:36:33.588 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-10T08:36:33.588 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-10T08:36:33.588 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-10T08:36:33.588 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-10T08:36:33.588 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-10T08:36:33.588 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-10T08:36:33.588 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-10T08:36:33.588 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-10T08:36:33.588 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-10T08:36:33.588 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-10T08:36:33.588 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-10T08:36:33.588 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-10T08:36:33.588 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-10T08:36:33.589 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-10T08:36:33.589 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-10T08:36:33.589 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-10T08:36:33.589 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-10T08:36:33.589 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-10T08:36:33.589 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-10T08:36:33.589 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-10T08:36:33.589 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-10T08:36:33.589 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-10T08:36:33.589 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-10T08:36:33.589 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-10T08:36:33.589 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-10T08:36:33.589 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-10T08:36:33.590 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-10T08:36:33.590 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-10T08:36:33.590 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-10T08:36:33.590 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-10T08:36:33.590 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-10T08:36:33.590 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-10T08:36:33.590 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-10T08:36:33.590 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-10T08:36:33.590 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-10T08:36:33.590 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-10T08:36:33.590 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-10T08:36:33.590 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-10T08:36:33.590 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-10T08:36:33.590 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-10T08:36:33.591 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-10T08:36:33.591 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-10T08:36:33.591 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-10T08:36:33.591 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-10T08:36:33.591 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-10T08:36:33.591 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-10T08:36:33.591 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-10T08:36:33.591 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-10T08:36:33.591 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-10T08:36:33.591 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-10T08:36:33.591 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-10T08:36:33.591 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-10T08:36:33.591 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-10T08:36:33.592 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-10T08:36:33.592 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-10T08:36:33.592 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-10T08:36:33.592 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-10T08:36:33.592 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-10T08:36:33.592 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-10T08:36:33.592 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-10T08:36:33.592 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-10T08:36:33.592 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-10T08:36:33.592 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-10T08:36:33.592 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-10T08:36:33.592 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-10T08:36:33.592 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-10T08:36:33.593 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-10T08:36:33.593 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-10T08:36:33.593 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-10T08:36:33.593 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-10T08:36:33.593 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-10T08:36:33.593 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-10T08:36:33.593 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-10T08:36:33.593 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-10T08:36:33.593 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-10T08:36:33.594 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-10T08:36:33.594 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-10T08:36:33.594 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-10T08:36:33.594 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-10T08:36:33.594 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-10T08:36:33.594 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-10T08:36:33.594 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-10T08:36:33.594 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-10T08:36:33.594 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-10T08:36:33.594 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-10T08:36:33.594 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-10T08:36:33.594 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-10T08:36:33.594 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-10T08:36:33.595 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-10T08:36:33.595 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-10T08:36:33.595 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-10T08:36:33.595 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-10T08:36:33.595 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-10T08:36:33.595 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-10T08:36:33.595 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-10T08:36:33.595 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-10T08:36:33.595 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-10T08:36:33.595 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-10T08:36:33.595 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-10T08:36:33.595 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-10T08:36:33.595 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-10T08:36:33.596 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-10T08:36:33.596 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-10T08:36:33.596 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-10T08:36:33.596 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-10T08:36:33.596 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-10T08:36:33.596 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-10T08:36:33.596 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-10T08:36:33.596 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-10T08:36:33.596 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-10T08:36:33.596 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-10T08:36:33.596 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-10T08:36:33.596 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-10T08:36:33.596 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-10T08:36:33.596 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-10T08:36:33.597 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-10T08:36:33.597 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-10T08:36:33.597 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-10T08:36:33.597 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-10T08:36:33.597 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-10T08:36:33.597 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-10T08:36:33.597 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-10T08:36:33.597 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-10T08:36:33.597 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-10T08:36:33.597 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-10T08:36:33.597 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-10T08:36:33.597 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-10T08:36:33.597 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-10T08:36:33.598 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-10T08:36:33.598 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-10T08:36:33.598 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-10T08:36:33.598 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-10T08:36:33.598 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-10T08:36:33.598 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-10T08:36:33.598 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-10T08:36:33.598 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-10T08:36:33.598 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-10T08:36:33.598 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-10T08:36:33.598 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-10T08:36:33.598 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-10T08:36:33.598 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-10T08:36:33.598 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-10T08:36:33.599 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-10T08:36:33.599 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-10T08:36:33.599 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-10T08:36:33.599 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-10T08:36:33.599 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-10T08:36:33.599 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-10T08:36:33.599 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-10T08:36:33.599 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-10T08:36:33.599 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-10T08:36:33.599 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-10T08:36:33.599 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-10T08:36:33.599 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-10T08:36:33.599 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-10T08:36:33.599 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-10T08:36:33.600 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-10T08:36:33.600 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-10T08:36:33.600 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-10T08:36:33.600 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-10T08:36:33.600 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-10T08:36:33.600 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-10T08:36:33.600 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-10T08:36:33.600 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-10T08:36:33.600 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-10T08:36:33.600 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-10T08:36:33.600 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-10T08:36:33.600 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-10T08:36:33.600 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-10T08:36:33.601 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-10T08:36:33.601 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-10T08:36:33.601 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-10T08:36:33.601 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-10T08:36:33.601 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-10T08:36:33.601 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-10T08:36:33.601 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-10T08:36:33.601 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-10T08:36:33.601 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-10T08:36:33.602 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-10T08:36:33.602 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-10T08:36:33.602 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-10T08:36:33.602 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-10T08:36:33.602 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-10T08:36:33.602 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-10T08:36:33.602 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-10T08:36:33.602 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-10T08:36:33.602 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-10T08:36:33.602 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-10T08:36:33.602 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-10T08:36:33.602 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-10T08:36:33.602 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-10T08:36:33.602 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-10T08:36:33.603 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-10T08:36:33.603 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-10T08:36:33.603 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-10T08:36:33.603 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-10T08:36:33.603 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-10T08:36:33.603 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-10T08:36:33.603 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-10T08:36:33.603 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-10T08:36:33.603 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-10T08:36:33.603 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-10T08:36:33.603 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-10T08:36:33.603 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-10T08:36:33.603 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-10T08:36:33.603 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-10T08:36:33.603 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-10T08:36:33.604 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-10T08:36:33.604 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-10T08:36:33.604 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-10T08:36:33.604 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-10T08:36:33.604 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-10T08:36:33.604 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-10T08:36:33.604 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-10T08:36:33.604 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-10T08:36:33.604 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-10T08:36:33.604 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-10T08:36:33.604 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-10T08:36:33.604 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-10T08:36:33.605 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-10T08:36:33.605 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-10T08:36:33.605 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-10T08:36:33.605 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-10T08:36:33.605 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-10T08:36:33.605 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-10T08:36:33.605 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-10T08:36:33.605 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-10T08:36:33.605 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-10T08:36:33.605 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-10T08:36:33.605 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-10T08:36:33.605 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-10T08:36:33.605 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-10T08:36:33.606 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-10T08:36:33.606 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-10T08:36:33.606 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-10T08:36:33.606 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-10T08:36:33.606 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-10T08:36:33.606 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-10T08:36:33.606 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-10T08:36:33.606 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-10T08:36:33.606 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-10T08:36:33.606 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-10T08:36:33.606 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-10T08:36:33.606 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-10T08:36:33.606 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-10T08:36:33.606 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-10T08:36:33.607 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-10T08:36:33.607 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-10T08:36:33.607 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-10T08:36:33.607 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-10T08:36:33.607 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-10T08:36:33.607 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-10T08:36:33.607 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-10T08:36:33.607 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-10T08:36:33.607 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-10T08:36:33.607 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-10T08:36:33.607 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-10T08:36:33.607 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-10T08:36:33.607 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-10T08:36:33.607 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-10T08:36:33.608 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-10T08:36:33.608 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-10T08:36:33.608 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-10T08:36:33.608 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-10T08:36:33.608 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-10T08:36:33.608 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-10T08:36:33.608 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-10T08:36:33.608 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-10T08:36:33.608 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-10T08:36:33.608 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-10T08:36:33.608 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-10T08:36:33.608 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-10T08:36:33.608 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-10T08:36:33.608 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-10T08:36:33.609 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-10T08:36:33.609 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-10T08:36:33.609 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-10T08:36:33.609 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-10T08:36:33.609 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-10T08:36:33.609 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-10T08:36:33.609 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-10T08:36:33.609 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-10T08:36:33.609 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-10T08:36:33.609 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-10T08:36:33.609 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-10T08:36:33.609 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-10T08:36:33.610 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-10T08:36:33.610 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-10T08:36:33.610 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-10T08:36:33.610 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-10T08:36:33.610 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-10T08:36:33.610 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-10T08:36:33.610 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-10T08:36:33.610 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-10T08:36:33.610 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-10T08:36:33.610 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-10T08:36:33.610 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-10T08:36:33.610 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-10T08:36:33.610 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-10T08:36:33.610 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-10T08:36:33.610 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-10T08:36:33.611 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-10T08:36:33.611 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-10T08:36:33.611 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-10T08:36:33.611 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-10T08:36:33.611 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-10T08:36:33.611 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-10T08:36:33.611 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-10T08:36:33.611 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-10T08:36:33.611 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-10T08:36:33.611 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-10T08:36:33.611 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-10T08:36:33.611 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-10T08:36:33.611 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-10T08:36:33.611 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-10T08:36:33.612 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-10T08:36:33.612 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-10T08:36:33.612 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-10T08:36:33.612 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-10T08:36:33.612 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-10T08:36:33.612 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-10T08:36:33.612 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-10T08:36:33.612 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-10T08:36:33.612 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-10T08:36:33.612 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-10T08:36:33.612 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-10T08:36:33.612 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-10T08:36:33.612 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-10T08:36:33.612 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-10T08:36:33.613 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-10T08:36:33.613 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-10T08:36:33.613 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-10T08:36:33.613 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-10T08:36:33.613 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-10T08:36:33.613 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-10T08:36:33.613 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-10T08:36:33.613 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-10T08:36:33.613 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-10T08:36:33.613 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-10T08:36:33.613 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-10T08:36:33.613 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-10T08:36:33.614 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-10T08:36:33.614 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-10T08:36:33.614 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-10T08:36:33.614 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-10T08:36:33.614 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-10T08:36:33.614 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-10T08:36:33.614 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-10T08:36:33.614 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-10T08:36:33.614 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-10T08:36:33.614 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-10T08:36:33.614 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-10T08:36:33.614 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-10T08:36:33.614 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-10T08:36:33.614 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-10T08:36:33.615 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-10T08:36:33.615 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-10T08:36:33.615 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-10T08:36:33.615 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-10T08:36:33.615 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-10T08:36:33.615 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-10T08:36:33.615 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-10T08:36:33.615 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-10T08:36:33.615 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-10T08:36:33.615 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-10T08:36:33.615 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-10T08:36:33.615 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-10T08:36:33.615 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-10T08:36:33.616 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-10T08:36:33.616 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-10T08:36:33.616 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-10T08:36:33.616 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-10T08:36:33.616 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-10T08:36:33.616 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-10T08:36:33.616 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-10T08:36:33.616 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-10T08:36:33.616 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-10T08:36:33.616 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-10T08:36:33.616 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-10T08:36:33.616 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-10T08:36:33.616 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-10T08:36:33.616 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-10T08:36:33.617 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-10T08:36:33.617 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-10T08:36:33.617 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-10T08:36:33.617 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-10T08:36:33.617 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-10T08:36:33.617 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-10T08:36:33.617 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-10T08:36:33.617 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-10T08:36:33.617 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-10T08:36:33.617 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-10T08:36:33.617 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-10T08:36:33.617 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-10T08:36:33.617 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-10T08:36:33.618 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-10T08:36:33.618 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-10T08:36:33.618 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-10T08:36:33.618 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-10T08:36:33.618 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-10T08:36:33.618 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-10T08:36:33.618 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-10T08:36:33.618 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-10T08:36:33.618 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-10T08:36:33.618 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-10T08:36:33.618 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-10T08:36:33.618 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-10T08:36:33.618 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-10T08:36:33.618 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-10T08:36:33.619 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-10T08:36:33.619 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-10T08:36:33.619 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-10T08:36:33.619 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-10T08:36:33.619 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-10T08:36:33.619 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-10T08:36:33.619 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-10T08:36:33.619 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-10T08:36:33.619 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-10T08:36:33.619 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-10T08:36:33.619 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-10T08:36:33.619 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-10T08:36:33.619 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-10T08:36:33.620 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-10T08:36:33.620 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-10T08:36:33.620 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-10T08:36:33.620 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-10T08:36:33.620 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-10T08:36:33.620 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-10T08:36:33.620 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-10T08:36:33.620 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-10T08:36:33.620 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-10T08:36:33.620 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-10T08:36:33.620 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-10T08:36:33.620 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-10T08:36:33.620 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-10T08:36:33.620 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-10T08:36:33.621 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-10T08:36:33.621 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-10T08:36:33.621 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-10T08:36:33.621 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-10T08:36:33.621 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-10T08:36:33.621 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-10T08:36:33.621 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-10T08:36:33.621 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-10T08:36:33.621 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-10T08:36:33.621 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-10T08:36:33.621 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-10T08:36:33.621 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-10T08:36:33.621 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-10T08:36:33.621 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-10T08:36:33.622 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-10T08:36:33.622 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-10T08:36:33.622 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-10T08:36:33.622 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-10T08:36:33.622 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-10T08:36:33.622 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-10T08:36:33.622 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-10T08:36:33.622 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-10T08:36:33.622 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-10T08:36:33.622 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-10T08:36:33.622 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-10T08:36:33.622 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-10T08:36:33.622 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-10T08:36:33.622 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-10T08:36:33.623 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-10T08:36:33.623 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-10T08:36:33.623 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-10T08:36:33.623 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-10T08:36:33.623 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-10T08:36:33.623 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-10T08:36:33.623 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-10T08:36:33.623 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-10T08:36:33.623 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-10T08:36:33.623 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-10T08:36:33.623 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-10T08:36:33.623 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-10T08:36:33.623 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-10T08:36:33.624 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-10T08:36:33.624 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-10T08:36:33.624 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-10T08:36:33.624 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-10T08:36:33.624 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-10T08:36:33.624 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-10T08:36:33.624 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-10T08:36:33.624 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-10T08:36:33.624 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-10T08:36:33.624 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-10T08:36:33.624 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-10T08:36:33.624 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-10T08:36:33.625 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-10T08:36:33.625 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-10T08:36:33.625 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-10T08:36:33.625 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-10T08:36:33.625 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-10T08:36:33.625 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-10T08:36:33.625 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-10T08:36:33.625 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-10T08:36:33.625 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-10T08:36:33.625 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-10T08:36:33.625 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-10T08:36:33.625 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-10T08:36:33.625 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-10T08:36:33.626 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-10T08:36:33.626 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-10T08:36:33.626 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-10T08:36:33.626 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-10T08:36:33.626 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-10T08:36:33.626 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-10T08:36:33.626 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-10T08:36:33.626 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-10T08:36:33.626 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-10T08:36:33.626 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-10T08:36:33.626 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-10T08:36:33.626 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-10T08:36:33.626 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-10T08:36:33.627 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-10T08:36:33.627 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-10T08:36:33.627 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-10T08:36:33.627 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-10T08:36:33.627 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-10T08:36:33.627 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-10T08:36:33.627 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-10T08:36:33.627 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-10T08:36:33.627 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-10T08:36:33.627 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-10T08:36:33.627 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-10T08:36:33.627 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-10T08:36:33.628 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-10T08:36:33.628 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-10T08:36:33.628 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-10T08:36:33.628 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-10T08:36:33.628 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-10T08:36:33.628 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-10T08:36:33.628 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-10T08:36:33.628 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-10T08:36:33.628 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-10T08:36:33.628 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-10T08:36:33.628 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-10T08:36:33.628 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-10T08:36:33.628 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-10T08:36:33.628 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-10T08:36:33.629 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-10T08:36:33.629 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-10T08:36:33.629 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-10T08:36:33.629 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-10T08:36:33.629 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-10T08:36:33.629 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-10T08:36:33.629 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-10T08:36:33.629 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-10T08:36:33.629 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-10T08:36:33.629 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-10T08:36:33.629 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-10T08:36:33.629 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-10T08:36:33.629 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-10T08:36:33.629 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-10T08:36:33.630 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-10T08:36:33.630 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-10T08:36:33.630 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-10T08:36:33.630 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-10T08:36:33.630 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-10T08:36:33.630 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-10T08:36:33.630 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-10T08:36:33.630 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-10T08:36:33.630 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-10T08:36:33.630 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-10T08:36:33.630 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-10T08:36:33.630 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-10T08:36:33.630 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-10T08:36:33.631 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-10T08:36:33.631 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-10T08:36:33.631 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-10T08:36:33.631 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-10T08:36:33.631 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-10T08:36:33.631 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-10T08:36:33.631 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-10T08:36:33.631 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-10T08:36:33.631 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-10T08:36:33.631 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-10T08:36:33.631 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-10T08:36:33.631 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-10T08:36:33.631 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-10T08:36:33.632 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-10T08:36:33.632 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-10T08:36:33.632 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-10T08:36:33.632 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-10T08:36:33.632 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-10T08:36:33.632 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-10T08:36:33.632 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-10T08:36:33.632 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-10T08:36:33.632 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-10T08:36:33.632 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-10T08:36:33.632 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-10T08:36:33.632 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-10T08:36:33.632 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-10T08:36:33.633 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-10T08:36:33.633 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-10T08:36:33.633 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-10T08:36:33.633 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-10T08:36:33.633 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-10T08:36:33.633 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-10T08:36:33.633 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-10T08:36:33.633 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-10T08:36:33.633 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-10T08:36:33.633 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-10T08:36:33.633 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-10T08:36:33.633 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-10T08:36:33.633 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-10T08:36:33.634 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-10T08:36:33.634 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-10T08:36:33.634 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-10T08:36:33.634 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-10T08:36:33.634 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-10T08:36:33.634 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-10T08:36:33.634 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-10T08:36:33.634 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-10T08:36:33.634 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-10T08:36:33.634 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-10T08:36:33.634 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-10T08:36:33.634 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-10T08:36:33.634 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-10T08:36:33.634 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-10T08:36:33.634 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-10T08:36:33.635 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-10T08:36:33.635 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-10T08:36:33.635 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-10T08:36:33.635 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-10T08:36:33.635 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-10T08:36:33.635 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-10T08:36:33.635 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-10T08:36:33.635 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-10T08:36:33.635 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-10T08:36:33.635 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-10T08:36:33.635 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-10T08:36:33.635 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-10T08:36:33.635 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-10T08:36:33.635 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-10T08:36:33.635 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-10T08:36:33.635 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-10T08:36:33.636 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-10T08:36:33.636 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-10T08:36:33.636 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-10T08:36:33.636 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-10T08:36:33.636 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-10T08:36:33.636 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-10T08:36:33.636 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-10T08:36:33.636 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-10T08:36:33.636 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-10T08:36:33.636 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-10T08:36:33.636 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-10T08:36:33.636 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-10T08:36:33.636 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-10T08:36:33.637 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-10T08:36:33.637 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-10T08:36:33.637 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-10T08:36:33.637 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-10T08:36:33.637 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-10T08:36:33.637 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-10T08:36:33.637 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-10T08:36:33.637 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-10T08:36:33.637 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-10T08:36:33.637 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-10T08:36:33.637 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-10T08:36:33.637 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-10T08:36:33.637 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-10T08:36:33.637 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-10T08:36:33.638 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-10T08:36:33.638 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-10T08:36:33.638 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-10T08:36:33.638 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-10T08:36:33.638 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-10T08:36:33.638 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-10T08:36:33.638 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-10T08:36:33.638 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-10T08:36:33.638 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-10T08:36:33.638 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-10T08:36:33.638 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-10T08:36:33.638 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-10T08:36:33.638 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-10T08:36:33.638 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-10T08:36:33.639 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-10T08:36:33.639 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-10T08:36:33.639 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-10T08:36:33.639 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-10T08:36:33.639 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-10T08:36:33.639 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-10T08:36:33.639 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-10T08:36:33.639 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-10T08:36:33.639 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-10T08:36:33.639 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-10T08:36:33.639 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-10T08:36:33.639 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-10T08:36:33.639 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-10T08:36:33.639 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-10T08:36:33.640 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-10T08:36:33.640 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-10T08:36:33.640 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-10T08:36:33.640 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-10T08:36:33.640 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-10T08:36:33.640 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-10T08:36:33.640 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-10T08:36:33.640 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-10T08:36:33.640 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-10T08:36:33.640 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-10T08:36:33.640 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-10T08:36:33.640 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-10T08:36:33.640 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-10T08:36:33.641 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-10T08:36:33.641 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-10T08:36:33.641 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-10T08:36:33.641 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-10T08:36:33.641 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-10T08:36:33.641 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-10T08:36:33.641 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-10T08:36:33.641 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-10T08:36:33.641 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-10T08:36:33.641 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-10T08:36:33.641 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-10T08:36:33.641 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-10T08:36:33.641 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-10T08:36:33.642 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-10T08:36:33.642 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-10T08:36:33.642 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-10T08:36:33.642 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-10T08:36:33.642 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-10T08:36:33.642 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-10T08:36:33.642 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-10T08:36:33.642 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-10T08:36:33.642 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-10T08:36:33.642 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-10T08:36:33.642 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-10T08:36:33.642 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-10T08:36:33.642 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-10T08:36:33.642 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-10T08:36:33.643 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-10T08:36:33.643 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-10T08:36:33.643 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-10T08:36:33.643 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-10T08:36:33.643 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-10T08:36:33.643 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-10T08:36:33.643 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-10T08:36:33.643 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-10T08:36:33.643 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-10T08:36:33.643 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-10T08:36:33.643 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-10T08:36:33.643 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-10T08:36:33.643 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-10T08:36:33.643 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-10T08:36:33.643 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-10T08:36:33.644 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-10T08:36:33.644 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-10T08:36:33.644 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-10T08:36:33.644 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-10T08:36:33.644 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-10T08:36:33.644 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-10T08:36:33.644 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-10T08:36:33.644 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-10T08:36:33.644 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-10T08:36:33.644 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-10T08:36:33.644 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-10T08:36:33.644 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-10T08:36:33.644 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-10T08:36:33.645 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-10T08:36:33.645 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-10T08:36:33.645 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-10T08:36:33.645 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-10T08:36:33.645 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-10T08:36:33.645 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-10T08:36:33.645 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-10T08:36:33.645 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-10T08:36:33.645 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-10T08:36:33.645 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-10T08:36:33.645 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-10T08:36:33.645 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-10T08:36:33.645 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-10T08:36:33.646 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-10T08:36:33.646 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-10T08:36:33.646 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-10T08:36:33.646 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-10T08:36:33.646 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-10T08:36:33.646 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-10T08:36:33.646 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-10T08:36:33.646 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-10T08:36:33.646 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-10T08:36:33.646 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-10T08:36:33.646 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-10T08:36:33.646 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-10T08:36:33.646 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-10T08:36:33.646 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-10T08:36:33.647 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-10T08:36:33.647 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-10T08:36:33.647 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-10T08:36:33.647 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-10T08:36:33.647 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-10T08:36:33.647 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-10T08:36:33.647 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-10T08:36:33.647 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-10T08:36:33.647 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-10T08:36:33.647 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-10T08:36:33.647 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-10T08:36:33.647 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-10T08:36:33.647 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-10T08:36:33.647 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-10T08:36:33.647 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-10T08:36:33.648 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-10T08:36:33.648 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-10T08:36:33.648 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-10T08:36:33.648 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-10T08:36:33.648 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-10T08:36:33.648 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-10T08:36:33.648 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-10T08:36:33.648 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-10T08:36:33.648 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-10T08:36:33.648 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-10T08:36:33.648 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-10T08:36:33.648 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-10T08:36:33.648 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-10T08:36:33.648 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-10T08:36:33.649 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-10T08:36:33.649 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-10T08:36:33.649 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-10T08:36:33.649 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-10T08:36:33.649 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-10T08:36:33.649 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-10T08:36:33.649 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-10T08:36:33.649 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-10T08:36:33.649 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-10T08:36:33.649 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-10T08:36:33.649 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-10T08:36:33.649 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-10T08:36:33.649 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-10T08:36:33.649 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-10T08:36:33.650 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-10T08:36:33.650 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-10T08:36:33.650 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-10T08:36:33.650 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-10T08:36:33.650 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-10T08:36:33.650 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-10T08:36:33.650 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-10T08:36:33.650 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-10T08:36:33.650 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-10T08:36:33.650 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-10T08:36:33.650 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-10T08:36:33.650 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-10T08:36:33.650 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-10T08:36:33.651 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-10T08:36:33.651 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-10T08:36:33.651 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-10T08:36:33.651 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-10T08:36:33.651 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-10T08:36:33.651 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-10T08:36:33.651 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-10T08:36:33.651 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-10T08:36:33.651 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-10T08:36:33.651 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-10T08:36:33.651 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-10T08:36:33.651 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-10T08:36:33.651 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-10T08:36:33.651 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-10T08:36:33.652 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-10T08:36:33.652 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-10T08:36:33.652 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-10T08:36:33.652 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-10T08:36:33.652 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-10T08:36:33.652 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-10T08:36:33.652 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-10T08:36:33.652 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-10T08:36:33.652 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-10T08:36:33.652 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-10T08:36:33.652 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-10T08:36:33.652 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-10T08:36:33.652 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-10T08:36:33.652 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-10T08:36:33.652 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-10T08:36:33.653 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-10T08:36:33.653 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-10T08:36:33.653 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-10T08:36:33.653 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-10T08:36:33.653 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-10T08:36:33.653 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-10T08:36:33.653 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-10T08:36:33.653 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-10T08:36:33.653 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-10T08:36:33.653 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-10T08:36:33.653 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-10T08:36:33.653 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-10T08:36:33.653 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-10T08:36:33.654 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-10T08:36:33.654 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-10T08:36:33.654 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-10T08:36:33.654 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-10T08:36:33.654 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-10T08:36:33.654 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-10T08:36:33.654 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-10T08:36:33.654 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-10T08:36:33.654 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-10T08:36:33.654 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-10T08:36:33.654 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-10T08:36:33.654 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-10T08:36:33.654 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-10T08:36:33.654 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-10T08:36:33.655 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-10T08:36:33.655 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-10T08:36:33.655 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-10T08:36:33.655 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-10T08:36:33.655 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-10T08:36:33.655 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-10T08:36:33.655 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-10T08:36:33.655 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-10T08:36:33.655 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-10T08:36:33.655 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-10T08:36:33.655 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-10T08:36:33.655 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-10T08:36:33.655 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-10T08:36:33.656 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-10T08:36:33.656 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-10T08:36:33.656 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-10T08:36:33.656 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-10T08:36:33.656 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-10T08:36:33.656 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-10T08:36:33.656 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-10T08:36:33.656 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-10T08:36:33.656 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-10T08:36:33.656 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-10T08:36:33.656 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-10T08:36:33.656 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-10T08:36:33.656 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-10T08:36:33.657 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-10T08:36:33.657 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-10T08:36:33.657 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-10T08:36:33.657 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-10T08:36:33.657 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-10T08:36:33.657 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-10T08:36:33.657 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-10T08:36:33.657 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-10T08:36:33.657 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-10T08:36:33.657 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-10T08:36:33.657 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-10T08:36:33.657 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-10T08:36:33.657 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-10T08:36:33.657 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-10T08:36:33.658 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-10T08:36:33.658 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-10T08:36:33.658 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-10T08:36:33.658 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-10T08:36:33.658 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-10T08:36:33.658 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-10T08:36:33.658 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-10T08:36:33.658 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-10T08:36:33.658 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-10T08:36:33.658 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-10T08:36:33.658 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-10T08:36:33.658 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-10T08:36:33.658 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-10T08:36:33.659 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-10T08:36:33.659 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-10T08:36:33.659 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-10T08:36:33.659 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-10T08:36:33.659 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-10T08:36:33.659 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-10T08:36:33.659 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-10T08:36:33.659 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-10T08:36:33.659 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-10T08:36:33.659 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-10T08:36:33.659 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-10T08:36:33.659 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-10T08:36:33.659 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-10T08:36:33.660 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-10T08:36:33.660 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-10T08:36:33.660 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-10T08:36:33.660 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-10T08:36:33.660 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-10T08:36:33.660 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-10T08:36:33.660 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-10T08:36:33.660 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-10T08:36:33.660 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-10T08:36:33.660 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-10T08:36:33.660 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-10T08:36:33.660 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-10T08:36:33.660 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-10T08:36:33.661 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-10T08:36:33.661 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-10T08:36:33.661 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-10T08:36:33.661 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-10T08:36:33.661 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-10T08:36:33.661 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-10T08:36:33.661 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-10T08:36:33.661 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-10T08:36:33.661 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-10T08:36:33.661 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-10T08:36:33.661 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-10T08:36:33.661 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-10T08:36:33.661 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-10T08:36:33.661 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-10T08:36:33.661 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-10T08:36:33.662 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-10T08:36:33.662 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-10T08:36:33.662 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-10T08:36:33.662 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-10T08:36:33.662 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-10T08:36:33.662 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-10T08:36:33.662 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-10T08:36:33.662 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-10T08:36:33.662 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-10T08:36:33.662 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-10T08:36:33.662 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-10T08:36:33.662 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-10T08:36:33.662 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-10T08:36:33.662 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-10T08:36:33.663 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-10T08:36:33.663 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-10T08:36:33.663 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-10T08:36:33.663 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-10T08:36:33.663 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-10T08:36:33.663 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-10T08:36:33.663 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-10T08:36:33.663 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-10T08:36:33.663 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-10T08:36:33.663 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-10T08:36:33.663 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-10T08:36:33.663 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-10T08:36:33.663 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-10T08:36:33.663 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-10T08:36:33.663 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-10T08:36:33.664 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-10T08:36:33.664 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-10T08:36:33.664 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-10T08:36:33.664 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-10T08:36:33.664 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-10T08:36:33.664 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-10T08:36:33.664 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-10T08:36:33.664 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-10T08:36:33.664 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-10T08:36:33.664 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-10T08:36:33.664 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-10T08:36:33.664 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-10T08:36:33.665 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-10T08:36:33.665 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-10T08:36:33.665 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-10T08:36:33.665 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-10T08:36:33.665 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-10T08:36:33.665 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-10T08:36:33.665 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-10T08:36:33.665 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-10T08:36:33.665 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-10T08:36:33.665 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-10T08:36:33.665 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-10T08:36:33.665 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-10T08:36:33.665 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-10T08:36:33.666 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-10T08:36:33.666 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-10T08:36:33.666 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-10T08:36:33.666 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-10T08:36:33.666 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-10T08:36:33.666 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-10T08:36:33.666 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-10T08:36:33.666 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-10T08:36:33.666 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-10T08:36:33.666 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-10T08:36:33.666 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-10T08:36:33.666 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-10T08:36:33.666 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-10T08:36:33.666 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-10T08:36:33.666 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-10T08:36:33.667 INFO:teuthology.orchestra.run.smithi155.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-10T08:36:33.673 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T08:36:33.673 DEBUG:teuthology.orchestra.run.smithi155:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-10T08:36:33.697 INFO:teuthology.orchestra.run.smithi155.stdout:postinstall scriptlet (using /bin/sh): 2024-09-10T08:36:33.698 INFO:teuthology.orchestra.run.smithi155.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-10T08:36:33.698 INFO:teuthology.orchestra.run.smithi155.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-10T08:36:33.698 INFO:teuthology.orchestra.run.smithi155.stdout:fi 2024-09-10T08:36:33.698 INFO:teuthology.orchestra.run.smithi155.stdout:for file in vmlinuz System.map config; do 2024-09-10T08:36:33.698 INFO:teuthology.orchestra.run.smithi155.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-10T08:36:33.698 INFO:teuthology.orchestra.run.smithi155.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-10T08:36:33.698 INFO:teuthology.orchestra.run.smithi155.stdout: fi 2024-09-10T08:36:33.698 INFO:teuthology.orchestra.run.smithi155.stdout:done 2024-09-10T08:36:33.698 INFO:teuthology.orchestra.run.smithi155.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-10T08:36:33.698 INFO:teuthology.orchestra.run.smithi155.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-10T08:36:33.698 INFO:teuthology.orchestra.run.smithi155.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-10T08:36:33.698 INFO:teuthology.orchestra.run.smithi155.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-10T08:36:33.699 INFO:teuthology.orchestra.run.smithi155.stdout:fi 2024-09-10T08:36:33.699 INFO:teuthology.orchestra.run.smithi155.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-10T08:36:33.699 INFO:teuthology.orchestra.run.smithi155.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T08:36:33.699 INFO:teuthology.orchestra.run.smithi155.stdout:fi 2024-09-10T08:36:33.699 INFO:teuthology.orchestra.run.smithi155.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-10T08:36:33.699 INFO:teuthology.orchestra.run.smithi155.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-10T08:36:33.699 INFO:teuthology.orchestra.run.smithi155.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T08:36:33.699 INFO:teuthology.orchestra.run.smithi155.stdout:fi 2024-09-10T08:36:33.700 DEBUG:teuthology.orchestra.run.smithi155:> sudo rpm -qi grub2-tools 2024-09-10T08:36:33.778 INFO:teuthology.orchestra.run.smithi155.stdout:Name : grub2-tools 2024-09-10T08:36:33.778 INFO:teuthology.orchestra.run.smithi155.stdout:Epoch : 1 2024-09-10T08:36:33.778 INFO:teuthology.orchestra.run.smithi155.stdout:Version : 2.06 2024-09-10T08:36:33.778 INFO:teuthology.orchestra.run.smithi155.stdout:Release : 82.el9 2024-09-10T08:36:33.778 INFO:teuthology.orchestra.run.smithi155.stdout:Architecture: x86_64 2024-09-10T08:36:33.778 INFO:teuthology.orchestra.run.smithi155.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-10T08:36:33.779 INFO:teuthology.orchestra.run.smithi155.stdout:Group : Unspecified 2024-09-10T08:36:33.779 INFO:teuthology.orchestra.run.smithi155.stdout:Size : 8274670 2024-09-10T08:36:33.779 INFO:teuthology.orchestra.run.smithi155.stdout:License : GPLv3+ 2024-09-10T08:36:33.779 INFO:teuthology.orchestra.run.smithi155.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-10T08:36:33.779 INFO:teuthology.orchestra.run.smithi155.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-10T08:36:33.779 INFO:teuthology.orchestra.run.smithi155.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-10T08:36:33.779 INFO:teuthology.orchestra.run.smithi155.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-10T08:36:33.779 INFO:teuthology.orchestra.run.smithi155.stdout:Packager : builder@centos.org 2024-09-10T08:36:33.779 INFO:teuthology.orchestra.run.smithi155.stdout:Vendor : CentOS 2024-09-10T08:36:33.779 INFO:teuthology.orchestra.run.smithi155.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-10T08:36:33.779 INFO:teuthology.orchestra.run.smithi155.stdout:Summary : Support tools for GRUB. 2024-09-10T08:36:33.779 INFO:teuthology.orchestra.run.smithi155.stdout:Description : 2024-09-10T08:36:33.779 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-10T08:36:33.780 INFO:teuthology.orchestra.run.smithi155.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-10T08:36:33.780 INFO:teuthology.orchestra.run.smithi155.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-10T08:36:33.780 INFO:teuthology.orchestra.run.smithi155.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-10T08:36:33.780 INFO:teuthology.orchestra.run.smithi155.stdout:hardware devices. 2024-09-10T08:36:33.780 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-10T08:36:33.780 INFO:teuthology.orchestra.run.smithi155.stdout:This subpackage provides tools for support of all platforms. 2024-09-10T08:36:33.781 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-10T08:36:33.781 INFO:teuthology.task.kernel:Updating grub on smithi155 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T08:36:33.781 DEBUG:teuthology.orchestra.run.smithi155:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-10T08:36:34.375 INFO:teuthology.orchestra.run.smithi155.stderr:Generating grub configuration file ... 2024-09-10T08:36:35.760 INFO:teuthology.orchestra.run.smithi155.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-10T08:36:35.805 INFO:teuthology.orchestra.run.smithi155.stderr:done 2024-09-10T08:36:35.808 DEBUG:teuthology.orchestra.run.smithi155:> mktemp 2024-09-10T08:36:35.823 INFO:teuthology.orchestra.run.smithi155.stdout:/tmp/tmp.EJiyws34aZ 2024-09-10T08:36:35.824 DEBUG:teuthology.orchestra.run.smithi155:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.EJiyws34aZ 2024-09-10T08:36:35.891 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 0666 /tmp/tmp.EJiyws34aZ 2024-09-10T08:36:36.034 DEBUG:teuthology.orchestra.remote:smithi155:/tmp/tmp.EJiyws34aZ is 6KB 2024-09-10T08:36:36.083 DEBUG:teuthology.orchestra.run.smithi155:> rm -fr /tmp/tmp.EJiyws34aZ 2024-09-10T08:36:36.098 DEBUG:teuthology.orchestra.run.smithi155:> sudo /bin/ls /boot/loader/entries || true 2024-09-10T08:36:36.168 INFO:teuthology.orchestra.run.smithi155.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-10T08:36:36.168 INFO:teuthology.orchestra.run.smithi155.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-10T08:36:36.168 INFO:teuthology.orchestra.run.smithi155.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-10T08:36:36.168 INFO:teuthology.orchestra.run.smithi155.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-10T08:36:36.169 DEBUG:teuthology.orchestra.run.smithi155:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T08:36:36.318 DEBUG:teuthology.orchestra.run.smithi155:> sudo shutdown -r now 2024-09-10T08:36:41.196 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi002.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-10T08:36:41.196 DEBUG:teuthology.orchestra.run.smithi002:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-10T08:36:41.289 INFO:teuthology.orchestra.run.smithi002.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T08:36:41.290 INFO:teuthology.orchestra.run.smithi002.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T08:36:41.290 INFO:teuthology.orchestra.run.smithi002.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T08:36:41.290 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-10T08:36:41.290 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-10T08:36:41.290 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-10T08:36:41.290 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-10T08:36:41.290 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-10T08:36:41.290 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-10T08:36:41.290 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-10T08:36:41.290 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-10T08:36:41.290 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-10T08:36:41.291 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-10T08:36:41.291 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-10T08:36:41.291 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-10T08:36:41.291 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-10T08:36:41.291 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-10T08:36:41.291 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-10T08:36:41.291 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-10T08:36:41.291 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-10T08:36:41.291 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-10T08:36:41.291 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-10T08:36:41.291 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-10T08:36:41.291 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-10T08:36:41.292 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-10T08:36:41.292 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-10T08:36:41.292 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-10T08:36:41.292 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-10T08:36:41.292 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-10T08:36:41.292 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-10T08:36:41.292 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-10T08:36:41.292 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-10T08:36:41.292 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-10T08:36:41.292 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-10T08:36:41.292 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-10T08:36:41.292 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-10T08:36:41.292 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-10T08:36:41.293 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-10T08:36:41.293 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-10T08:36:41.293 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-10T08:36:41.293 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-10T08:36:41.293 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-10T08:36:41.293 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-10T08:36:41.293 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-10T08:36:41.293 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-10T08:36:41.293 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-10T08:36:41.293 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-10T08:36:41.293 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-10T08:36:41.293 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-10T08:36:41.294 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-10T08:36:41.294 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-10T08:36:41.294 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-10T08:36:41.294 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-10T08:36:41.294 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-10T08:36:41.294 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-10T08:36:41.294 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-10T08:36:41.294 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-10T08:36:41.294 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-10T08:36:41.294 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-10T08:36:41.294 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-10T08:36:41.294 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-10T08:36:41.294 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-10T08:36:41.295 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-10T08:36:41.295 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-10T08:36:41.295 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-10T08:36:41.295 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-10T08:36:41.295 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-10T08:36:41.295 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-10T08:36:41.295 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-10T08:36:41.295 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-10T08:36:41.295 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-10T08:36:41.295 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-10T08:36:41.295 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-10T08:36:41.295 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-10T08:36:41.295 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-10T08:36:41.296 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-10T08:36:41.296 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-10T08:36:41.296 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-10T08:36:41.296 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-10T08:36:41.296 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-10T08:36:41.296 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-10T08:36:41.296 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-10T08:36:41.296 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-10T08:36:41.296 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-10T08:36:41.296 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-10T08:36:41.296 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-10T08:36:41.296 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-10T08:36:41.296 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-10T08:36:41.297 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-10T08:36:41.297 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-10T08:36:41.297 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-10T08:36:41.297 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-10T08:36:41.297 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-10T08:36:41.297 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-10T08:36:41.297 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-10T08:36:41.297 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-10T08:36:41.297 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-10T08:36:41.297 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-10T08:36:41.297 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-10T08:36:41.297 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-10T08:36:41.297 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-10T08:36:41.298 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-10T08:36:41.298 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-10T08:36:41.298 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-10T08:36:41.298 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-10T08:36:41.298 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-10T08:36:41.298 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-10T08:36:41.298 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-10T08:36:41.298 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-10T08:36:41.298 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-10T08:36:41.298 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-10T08:36:41.298 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-10T08:36:41.298 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-10T08:36:41.298 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-10T08:36:41.298 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-10T08:36:41.299 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-10T08:36:41.299 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-10T08:36:41.299 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-10T08:36:41.299 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-10T08:36:41.299 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-10T08:36:41.299 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-10T08:36:41.299 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-10T08:36:41.299 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-10T08:36:41.299 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-10T08:36:41.299 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-10T08:36:41.299 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-10T08:36:41.299 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-10T08:36:41.299 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-10T08:36:41.300 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-10T08:36:41.300 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-10T08:36:41.300 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-10T08:36:41.300 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-10T08:36:41.300 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-10T08:36:41.300 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-10T08:36:41.300 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-10T08:36:41.300 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-10T08:36:41.300 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-10T08:36:41.300 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-10T08:36:41.300 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-10T08:36:41.301 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-10T08:36:41.301 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-10T08:36:41.301 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-10T08:36:41.301 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-10T08:36:41.301 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-10T08:36:41.301 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-10T08:36:41.301 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-10T08:36:41.301 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-10T08:36:41.301 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-10T08:36:41.301 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-10T08:36:41.301 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-10T08:36:41.301 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-10T08:36:41.302 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-10T08:36:41.302 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-10T08:36:41.302 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-10T08:36:41.302 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-10T08:36:41.302 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-10T08:36:41.302 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-10T08:36:41.302 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-10T08:36:41.302 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-10T08:36:41.302 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-10T08:36:41.302 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-10T08:36:41.302 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-10T08:36:41.302 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-10T08:36:41.302 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-10T08:36:41.303 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-10T08:36:41.303 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-10T08:36:41.303 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-10T08:36:41.303 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-10T08:36:41.303 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-10T08:36:41.303 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-10T08:36:41.303 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-10T08:36:41.303 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-10T08:36:41.303 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-10T08:36:41.303 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-10T08:36:41.303 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-10T08:36:41.303 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-10T08:36:41.303 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-10T08:36:41.304 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-10T08:36:41.304 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-10T08:36:41.304 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-10T08:36:41.304 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-10T08:36:41.304 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-10T08:36:41.304 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-10T08:36:41.304 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-10T08:36:41.304 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-10T08:36:41.304 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-10T08:36:41.304 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-10T08:36:41.304 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-10T08:36:41.305 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-10T08:36:41.305 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-10T08:36:41.305 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-10T08:36:41.305 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-10T08:36:41.305 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-10T08:36:41.305 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-10T08:36:41.305 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-10T08:36:41.305 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-10T08:36:41.305 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-10T08:36:41.305 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-10T08:36:41.306 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-10T08:36:41.306 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-10T08:36:41.306 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-10T08:36:41.306 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-10T08:36:41.306 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-10T08:36:41.306 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-10T08:36:41.306 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-10T08:36:41.306 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-10T08:36:41.306 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-10T08:36:41.306 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-10T08:36:41.307 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-10T08:36:41.307 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-10T08:36:41.307 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-10T08:36:41.307 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-10T08:36:41.307 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-10T08:36:41.307 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-10T08:36:41.307 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-10T08:36:41.307 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-10T08:36:41.307 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-10T08:36:41.307 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-10T08:36:41.307 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-10T08:36:41.307 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-10T08:36:41.308 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-10T08:36:41.308 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-10T08:36:41.308 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-10T08:36:41.308 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-10T08:36:41.308 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-10T08:36:41.308 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-10T08:36:41.308 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-10T08:36:41.308 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-10T08:36:41.308 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-10T08:36:41.308 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-10T08:36:41.308 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-10T08:36:41.308 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-10T08:36:41.308 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-10T08:36:41.308 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-10T08:36:41.309 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-10T08:36:41.309 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-10T08:36:41.309 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-10T08:36:41.309 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-10T08:36:41.309 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-10T08:36:41.309 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-10T08:36:41.309 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-10T08:36:41.309 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-10T08:36:41.309 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-10T08:36:41.309 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-10T08:36:41.309 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-10T08:36:41.309 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-10T08:36:41.310 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-10T08:36:41.310 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-10T08:36:41.310 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-10T08:36:41.310 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-10T08:36:41.310 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-10T08:36:41.310 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-10T08:36:41.310 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-10T08:36:41.310 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-10T08:36:41.310 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-10T08:36:41.310 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-10T08:36:41.310 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-10T08:36:41.310 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-10T08:36:41.310 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-10T08:36:41.311 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-10T08:36:41.311 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-10T08:36:41.311 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-10T08:36:41.311 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-10T08:36:41.311 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-10T08:36:41.311 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-10T08:36:41.311 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-10T08:36:41.311 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-10T08:36:41.311 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-10T08:36:41.311 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-10T08:36:41.311 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-10T08:36:41.311 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-10T08:36:41.312 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-10T08:36:41.312 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-10T08:36:41.312 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-10T08:36:41.312 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-10T08:36:41.312 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-10T08:36:41.312 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-10T08:36:41.312 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-10T08:36:41.312 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-10T08:36:41.312 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-10T08:36:41.312 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-10T08:36:41.312 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-10T08:36:41.312 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-10T08:36:41.313 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-10T08:36:41.313 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-10T08:36:41.313 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-10T08:36:41.313 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-10T08:36:41.313 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-10T08:36:41.313 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-10T08:36:41.313 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-10T08:36:41.313 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-10T08:36:41.313 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-10T08:36:41.313 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-10T08:36:41.313 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-10T08:36:41.313 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-10T08:36:41.314 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-10T08:36:41.314 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-10T08:36:41.314 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-10T08:36:41.314 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-10T08:36:41.314 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-10T08:36:41.314 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-10T08:36:41.314 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-10T08:36:41.314 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-10T08:36:41.314 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-10T08:36:41.314 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-10T08:36:41.314 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-10T08:36:41.314 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-10T08:36:41.314 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-10T08:36:41.315 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-10T08:36:41.315 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-10T08:36:41.315 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-10T08:36:41.315 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-10T08:36:41.315 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-10T08:36:41.315 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-10T08:36:41.315 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-10T08:36:41.315 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-10T08:36:41.315 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-10T08:36:41.315 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-10T08:36:41.315 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-10T08:36:41.315 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-10T08:36:41.315 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-10T08:36:41.316 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-10T08:36:41.316 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-10T08:36:41.316 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-10T08:36:41.316 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-10T08:36:41.316 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-10T08:36:41.316 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-10T08:36:41.316 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-10T08:36:41.316 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-10T08:36:41.316 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-10T08:36:41.316 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-10T08:36:41.316 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-10T08:36:41.316 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-10T08:36:41.316 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-10T08:36:41.317 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-10T08:36:41.317 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-10T08:36:41.317 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-10T08:36:41.317 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-10T08:36:41.317 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-10T08:36:41.317 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-10T08:36:41.317 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-10T08:36:41.317 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-10T08:36:41.317 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-10T08:36:41.317 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-10T08:36:41.317 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-10T08:36:41.317 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-10T08:36:41.318 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-10T08:36:41.318 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-10T08:36:41.318 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-10T08:36:41.318 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-10T08:36:41.318 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-10T08:36:41.318 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-10T08:36:41.318 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-10T08:36:41.318 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-10T08:36:41.318 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-10T08:36:41.318 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-10T08:36:41.318 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-10T08:36:41.318 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-10T08:36:41.319 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-10T08:36:41.319 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-10T08:36:41.319 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-10T08:36:41.319 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-10T08:36:41.319 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-10T08:36:41.319 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-10T08:36:41.319 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-10T08:36:41.320 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-10T08:36:41.320 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-10T08:36:41.320 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-10T08:36:41.320 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-10T08:36:41.320 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-10T08:36:41.320 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-10T08:36:41.320 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-10T08:36:41.320 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-10T08:36:41.320 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-10T08:36:41.320 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-10T08:36:41.320 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-10T08:36:41.320 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-10T08:36:41.320 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-10T08:36:41.321 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-10T08:36:41.321 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-10T08:36:41.321 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-10T08:36:41.321 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-10T08:36:41.321 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-10T08:36:41.321 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-10T08:36:41.321 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-10T08:36:41.321 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-10T08:36:41.321 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-10T08:36:41.321 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-10T08:36:41.321 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-10T08:36:41.321 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-10T08:36:41.321 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-10T08:36:41.322 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-10T08:36:41.322 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-10T08:36:41.322 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-10T08:36:41.322 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-10T08:36:41.322 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-10T08:36:41.322 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-10T08:36:41.322 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-10T08:36:41.322 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-10T08:36:41.322 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-10T08:36:41.322 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-10T08:36:41.322 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-10T08:36:41.322 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-10T08:36:41.323 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-10T08:36:41.323 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-10T08:36:41.323 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-10T08:36:41.323 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-10T08:36:41.323 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-10T08:36:41.323 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-10T08:36:41.323 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-10T08:36:41.323 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-10T08:36:41.323 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-10T08:36:41.323 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-10T08:36:41.323 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-10T08:36:41.323 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-10T08:36:41.324 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-10T08:36:41.324 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-10T08:36:41.324 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-10T08:36:41.324 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-10T08:36:41.324 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-10T08:36:41.324 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-10T08:36:41.324 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-10T08:36:41.324 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-10T08:36:41.324 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-10T08:36:41.324 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-10T08:36:41.324 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-10T08:36:41.324 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-10T08:36:41.324 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-10T08:36:41.325 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-10T08:36:41.325 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-10T08:36:41.325 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-10T08:36:41.325 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-10T08:36:41.325 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-10T08:36:41.325 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-10T08:36:41.325 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-10T08:36:41.325 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-10T08:36:41.325 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-10T08:36:41.325 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-10T08:36:41.325 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-10T08:36:41.325 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-10T08:36:41.325 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-10T08:36:41.326 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-10T08:36:41.326 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-10T08:36:41.326 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-10T08:36:41.326 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-10T08:36:41.326 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-10T08:36:41.326 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-10T08:36:41.326 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-10T08:36:41.326 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-10T08:36:41.326 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-10T08:36:41.326 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-10T08:36:41.326 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-10T08:36:41.326 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-10T08:36:41.326 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-10T08:36:41.327 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-10T08:36:41.327 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-10T08:36:41.327 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-10T08:36:41.327 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-10T08:36:41.327 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-10T08:36:41.327 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-10T08:36:41.327 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-10T08:36:41.327 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-10T08:36:41.327 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-10T08:36:41.327 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-10T08:36:41.327 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-10T08:36:41.327 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-10T08:36:41.327 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-10T08:36:41.328 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-10T08:36:41.328 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-10T08:36:41.328 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-10T08:36:41.328 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-10T08:36:41.328 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-10T08:36:41.328 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-10T08:36:41.328 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-10T08:36:41.328 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-10T08:36:41.328 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-10T08:36:41.328 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-10T08:36:41.328 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-10T08:36:41.329 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-10T08:36:41.329 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-10T08:36:41.329 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-10T08:36:41.329 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-10T08:36:41.329 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-10T08:36:41.329 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-10T08:36:41.329 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-10T08:36:41.329 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-10T08:36:41.329 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-10T08:36:41.329 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-10T08:36:41.329 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-10T08:36:41.329 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-10T08:36:41.329 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-10T08:36:41.330 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-10T08:36:41.330 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-10T08:36:41.330 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-10T08:36:41.330 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-10T08:36:41.330 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-10T08:36:41.330 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-10T08:36:41.330 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-10T08:36:41.330 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-10T08:36:41.330 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-10T08:36:41.330 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-10T08:36:41.330 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-10T08:36:41.330 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-10T08:36:41.330 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-10T08:36:41.330 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-10T08:36:41.331 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-10T08:36:41.331 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-10T08:36:41.331 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-10T08:36:41.331 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-10T08:36:41.331 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-10T08:36:41.331 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-10T08:36:41.331 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-10T08:36:41.331 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-10T08:36:41.331 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-10T08:36:41.331 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-10T08:36:41.331 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-10T08:36:41.331 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-10T08:36:41.331 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-10T08:36:41.332 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-10T08:36:41.332 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-10T08:36:41.332 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-10T08:36:41.332 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-10T08:36:41.332 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-10T08:36:41.332 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-10T08:36:41.332 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-10T08:36:41.332 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-10T08:36:41.332 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-10T08:36:41.332 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-10T08:36:41.332 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-10T08:36:41.332 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-10T08:36:41.332 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-10T08:36:41.333 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-10T08:36:41.333 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-10T08:36:41.333 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-10T08:36:41.333 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-10T08:36:41.333 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-10T08:36:41.333 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-10T08:36:41.333 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-10T08:36:41.333 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-10T08:36:41.333 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-10T08:36:41.333 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-10T08:36:41.333 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-10T08:36:41.333 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-10T08:36:41.333 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-10T08:36:41.334 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-10T08:36:41.334 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-10T08:36:41.334 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-10T08:36:41.334 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-10T08:36:41.334 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-10T08:36:41.334 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-10T08:36:41.334 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-10T08:36:41.334 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-10T08:36:41.334 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-10T08:36:41.334 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-10T08:36:41.334 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-10T08:36:41.334 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-10T08:36:41.334 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-10T08:36:41.334 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-10T08:36:41.335 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-10T08:36:41.335 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-10T08:36:41.335 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-10T08:36:41.335 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-10T08:36:41.335 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-10T08:36:41.335 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-10T08:36:41.335 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-10T08:36:41.335 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-10T08:36:41.335 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-10T08:36:41.335 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-10T08:36:41.335 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-10T08:36:41.335 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-10T08:36:41.335 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-10T08:36:41.336 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-10T08:36:41.336 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-10T08:36:41.336 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-10T08:36:41.336 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-10T08:36:41.336 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-10T08:36:41.336 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-10T08:36:41.336 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-10T08:36:41.336 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-10T08:36:41.336 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-10T08:36:41.336 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-10T08:36:41.336 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-10T08:36:41.336 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-10T08:36:41.337 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-10T08:36:41.337 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-10T08:36:41.337 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-10T08:36:41.337 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-10T08:36:41.337 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-10T08:36:41.337 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-10T08:36:41.337 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-10T08:36:41.337 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-10T08:36:41.337 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-10T08:36:41.337 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-10T08:36:41.337 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-10T08:36:41.337 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-10T08:36:41.337 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-10T08:36:41.338 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-10T08:36:41.338 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-10T08:36:41.338 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-10T08:36:41.338 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-10T08:36:41.338 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-10T08:36:41.338 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-10T08:36:41.338 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-10T08:36:41.338 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-10T08:36:41.338 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-10T08:36:41.338 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-10T08:36:41.338 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-10T08:36:41.338 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-10T08:36:41.338 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-10T08:36:41.339 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-10T08:36:41.339 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-10T08:36:41.339 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-10T08:36:41.339 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-10T08:36:41.339 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-10T08:36:41.339 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-10T08:36:41.339 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-10T08:36:41.339 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-10T08:36:41.339 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-10T08:36:41.339 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-10T08:36:41.339 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-10T08:36:41.339 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-10T08:36:41.339 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-10T08:36:41.340 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-10T08:36:41.340 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-10T08:36:41.340 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-10T08:36:41.340 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-10T08:36:41.340 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-10T08:36:41.340 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-10T08:36:41.340 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-10T08:36:41.340 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-10T08:36:41.340 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-10T08:36:41.340 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-10T08:36:41.340 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-10T08:36:41.340 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-10T08:36:41.340 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-10T08:36:41.341 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-10T08:36:41.341 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-10T08:36:41.341 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-10T08:36:41.341 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-10T08:36:41.341 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-10T08:36:41.341 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-10T08:36:41.341 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-10T08:36:41.341 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-10T08:36:41.341 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-10T08:36:41.341 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-10T08:36:41.341 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-10T08:36:41.341 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-10T08:36:41.341 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-10T08:36:41.341 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-10T08:36:41.342 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-10T08:36:41.342 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-10T08:36:41.342 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-10T08:36:41.342 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-10T08:36:41.342 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-10T08:36:41.342 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-10T08:36:41.342 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-10T08:36:41.342 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-10T08:36:41.342 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-10T08:36:41.342 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-10T08:36:41.342 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-10T08:36:41.342 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-10T08:36:41.342 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-10T08:36:41.343 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-10T08:36:41.343 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-10T08:36:41.343 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-10T08:36:41.343 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-10T08:36:41.343 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-10T08:36:41.343 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-10T08:36:41.343 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-10T08:36:41.343 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-10T08:36:41.343 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-10T08:36:41.343 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-10T08:36:41.343 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-10T08:36:41.343 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-10T08:36:41.343 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-10T08:36:41.343 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-10T08:36:41.343 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-10T08:36:41.344 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-10T08:36:41.344 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-10T08:36:41.344 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-10T08:36:41.344 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-10T08:36:41.344 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-10T08:36:41.344 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-10T08:36:41.344 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-10T08:36:41.344 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-10T08:36:41.344 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-10T08:36:41.344 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-10T08:36:41.344 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-10T08:36:41.344 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-10T08:36:41.344 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-10T08:36:41.345 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-10T08:36:41.345 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-10T08:36:41.345 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-10T08:36:41.345 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-10T08:36:41.345 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-10T08:36:41.345 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-10T08:36:41.345 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-10T08:36:41.345 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-10T08:36:41.345 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-10T08:36:41.345 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-10T08:36:41.345 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-10T08:36:41.346 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-10T08:36:41.346 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-10T08:36:41.346 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-10T08:36:41.346 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-10T08:36:41.346 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-10T08:36:41.346 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-10T08:36:41.346 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-10T08:36:41.346 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-10T08:36:41.346 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-10T08:36:41.346 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-10T08:36:41.346 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-10T08:36:41.346 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-10T08:36:41.346 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-10T08:36:41.347 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-10T08:36:41.347 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-10T08:36:41.347 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-10T08:36:41.347 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-10T08:36:41.347 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-10T08:36:41.347 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-10T08:36:41.347 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-10T08:36:41.347 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-10T08:36:41.347 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-10T08:36:41.347 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-10T08:36:41.347 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-10T08:36:41.347 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-10T08:36:41.347 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-10T08:36:41.348 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-10T08:36:41.348 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-10T08:36:41.348 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-10T08:36:41.348 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-10T08:36:41.348 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-10T08:36:41.348 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-10T08:36:41.348 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-10T08:36:41.348 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-10T08:36:41.348 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-10T08:36:41.348 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-10T08:36:41.348 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-10T08:36:41.348 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-10T08:36:41.348 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-10T08:36:41.349 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-10T08:36:41.349 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-10T08:36:41.349 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-10T08:36:41.349 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-10T08:36:41.349 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-10T08:36:41.349 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-10T08:36:41.349 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-10T08:36:41.349 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-10T08:36:41.349 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-10T08:36:41.349 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-10T08:36:41.349 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-10T08:36:41.349 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-10T08:36:41.350 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-10T08:36:41.350 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-10T08:36:41.350 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-10T08:36:41.350 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-10T08:36:41.350 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-10T08:36:41.350 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-10T08:36:41.350 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-10T08:36:41.350 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-10T08:36:41.350 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-10T08:36:41.350 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-10T08:36:41.350 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-10T08:36:41.350 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-10T08:36:41.351 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-10T08:36:41.351 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-10T08:36:41.351 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-10T08:36:41.351 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-10T08:36:41.351 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-10T08:36:41.351 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-10T08:36:41.351 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-10T08:36:41.351 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-10T08:36:41.351 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-10T08:36:41.351 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-10T08:36:41.351 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-10T08:36:41.351 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-10T08:36:41.351 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-10T08:36:41.352 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-10T08:36:41.352 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-10T08:36:41.352 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-10T08:36:41.352 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-10T08:36:41.352 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-10T08:36:41.352 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-10T08:36:41.352 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-10T08:36:41.352 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-10T08:36:41.352 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-10T08:36:41.352 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-10T08:36:41.352 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-10T08:36:41.352 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-10T08:36:41.353 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-10T08:36:41.353 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-10T08:36:41.353 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-10T08:36:41.353 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-10T08:36:41.353 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-10T08:36:41.353 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-10T08:36:41.353 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-10T08:36:41.353 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-10T08:36:41.353 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-10T08:36:41.353 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-10T08:36:41.353 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-10T08:36:41.353 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-10T08:36:41.353 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-10T08:36:41.354 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-10T08:36:41.354 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-10T08:36:41.354 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-10T08:36:41.354 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-10T08:36:41.354 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-10T08:36:41.354 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-10T08:36:41.354 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-10T08:36:41.354 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-10T08:36:41.354 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-10T08:36:41.354 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-10T08:36:41.354 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-10T08:36:41.354 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-10T08:36:41.354 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-10T08:36:41.355 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-10T08:36:41.355 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-10T08:36:41.355 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-10T08:36:41.355 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-10T08:36:41.355 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-10T08:36:41.355 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-10T08:36:41.355 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-10T08:36:41.355 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-10T08:36:41.355 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-10T08:36:41.355 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-10T08:36:41.355 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-10T08:36:41.355 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-10T08:36:41.355 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-10T08:36:41.356 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-10T08:36:41.356 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-10T08:36:41.356 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-10T08:36:41.356 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-10T08:36:41.356 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-10T08:36:41.356 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-10T08:36:41.356 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-10T08:36:41.356 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-10T08:36:41.356 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-10T08:36:41.356 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-10T08:36:41.356 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-10T08:36:41.356 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-10T08:36:41.356 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-10T08:36:41.357 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-10T08:36:41.357 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-10T08:36:41.357 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-10T08:36:41.357 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-10T08:36:41.357 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-10T08:36:41.357 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-10T08:36:41.357 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-10T08:36:41.357 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-10T08:36:41.357 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-10T08:36:41.357 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-10T08:36:41.357 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-10T08:36:41.357 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-10T08:36:41.357 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-10T08:36:41.358 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-10T08:36:41.358 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-10T08:36:41.358 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-10T08:36:41.358 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-10T08:36:41.358 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-10T08:36:41.358 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-10T08:36:41.358 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-10T08:36:41.358 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-10T08:36:41.358 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-10T08:36:41.358 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-10T08:36:41.358 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-10T08:36:41.358 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-10T08:36:41.358 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-10T08:36:41.359 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-10T08:36:41.359 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-10T08:36:41.359 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-10T08:36:41.359 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-10T08:36:41.359 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-10T08:36:41.359 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-10T08:36:41.359 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-10T08:36:41.359 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-10T08:36:41.359 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-10T08:36:41.359 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-10T08:36:41.359 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-10T08:36:41.359 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-10T08:36:41.359 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-10T08:36:41.360 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-10T08:36:41.360 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-10T08:36:41.360 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-10T08:36:41.360 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-10T08:36:41.360 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-10T08:36:41.360 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-10T08:36:41.360 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-10T08:36:41.360 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-10T08:36:41.360 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-10T08:36:41.360 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-10T08:36:41.360 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-10T08:36:41.360 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-10T08:36:41.360 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-10T08:36:41.361 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-10T08:36:41.361 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-10T08:36:41.361 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-10T08:36:41.361 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-10T08:36:41.361 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-10T08:36:41.361 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-10T08:36:41.361 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-10T08:36:41.361 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-10T08:36:41.361 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-10T08:36:41.361 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-10T08:36:41.361 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-10T08:36:41.361 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-10T08:36:41.362 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-10T08:36:41.362 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-10T08:36:41.362 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-10T08:36:41.362 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-10T08:36:41.362 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-10T08:36:41.362 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-10T08:36:41.362 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-10T08:36:41.362 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-10T08:36:41.362 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-10T08:36:41.362 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-10T08:36:41.362 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-10T08:36:41.362 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-10T08:36:41.362 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-10T08:36:41.363 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-10T08:36:41.363 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-10T08:36:41.363 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-10T08:36:41.363 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-10T08:36:41.363 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-10T08:36:41.363 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-10T08:36:41.363 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-10T08:36:41.363 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-10T08:36:41.363 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-10T08:36:41.363 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-10T08:36:41.363 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-10T08:36:41.363 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-10T08:36:41.363 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-10T08:36:41.364 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-10T08:36:41.364 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-10T08:36:41.364 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-10T08:36:41.364 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-10T08:36:41.364 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-10T08:36:41.364 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-10T08:36:41.364 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-10T08:36:41.364 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-10T08:36:41.364 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-10T08:36:41.364 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-10T08:36:41.364 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-10T08:36:41.364 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-10T08:36:41.365 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-10T08:36:41.365 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-10T08:36:41.365 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-10T08:36:41.365 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-10T08:36:41.365 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-10T08:36:41.365 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-10T08:36:41.365 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-10T08:36:41.365 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-10T08:36:41.365 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-10T08:36:41.365 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-10T08:36:41.365 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-10T08:36:41.365 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-10T08:36:41.365 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-10T08:36:41.366 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-10T08:36:41.366 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-10T08:36:41.366 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-10T08:36:41.366 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-10T08:36:41.366 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-10T08:36:41.366 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-10T08:36:41.366 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-10T08:36:41.366 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-10T08:36:41.366 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-10T08:36:41.366 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-10T08:36:41.366 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-10T08:36:41.366 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-10T08:36:41.367 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-10T08:36:41.367 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-10T08:36:41.367 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-10T08:36:41.367 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-10T08:36:41.367 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-10T08:36:41.367 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-10T08:36:41.367 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-10T08:36:41.367 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-10T08:36:41.367 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-10T08:36:41.367 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-10T08:36:41.367 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-10T08:36:41.367 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-10T08:36:41.367 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-10T08:36:41.368 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-10T08:36:41.368 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-10T08:36:41.368 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-10T08:36:41.368 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-10T08:36:41.368 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-10T08:36:41.368 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-10T08:36:41.368 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-10T08:36:41.368 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-10T08:36:41.368 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-10T08:36:41.368 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-10T08:36:41.368 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-10T08:36:41.368 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-10T08:36:41.368 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-10T08:36:41.369 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-10T08:36:41.369 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-10T08:36:41.369 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-10T08:36:41.369 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-10T08:36:41.369 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-10T08:36:41.369 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-10T08:36:41.369 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-10T08:36:41.369 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-10T08:36:41.369 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-10T08:36:41.369 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-10T08:36:41.369 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-10T08:36:41.369 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-10T08:36:41.369 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-10T08:36:41.370 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-10T08:36:41.370 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-10T08:36:41.370 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-10T08:36:41.370 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-10T08:36:41.370 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-10T08:36:41.370 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-10T08:36:41.370 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-10T08:36:41.370 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-10T08:36:41.370 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-10T08:36:41.370 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-10T08:36:41.370 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-10T08:36:41.370 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-10T08:36:41.370 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-10T08:36:41.371 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-10T08:36:41.371 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-10T08:36:41.371 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-10T08:36:41.371 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-10T08:36:41.371 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-10T08:36:41.371 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-10T08:36:41.371 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-10T08:36:41.371 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-10T08:36:41.371 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-10T08:36:41.371 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-10T08:36:41.371 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-10T08:36:41.371 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-10T08:36:41.371 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-10T08:36:41.372 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-10T08:36:41.372 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-10T08:36:41.372 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-10T08:36:41.372 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-10T08:36:41.372 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-10T08:36:41.372 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-10T08:36:41.372 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-10T08:36:41.372 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-10T08:36:41.372 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-10T08:36:41.372 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-10T08:36:41.372 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-10T08:36:41.372 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-10T08:36:41.372 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-10T08:36:41.373 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-10T08:36:41.373 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-10T08:36:41.373 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-10T08:36:41.373 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-10T08:36:41.373 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-10T08:36:41.373 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-10T08:36:41.373 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-10T08:36:41.373 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-10T08:36:41.373 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-10T08:36:41.373 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-10T08:36:41.373 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-10T08:36:41.373 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-10T08:36:41.374 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-10T08:36:41.374 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-10T08:36:41.374 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-10T08:36:41.374 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-10T08:36:41.374 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-10T08:36:41.374 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-10T08:36:41.374 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-10T08:36:41.374 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-10T08:36:41.374 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-10T08:36:41.374 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-10T08:36:41.374 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-10T08:36:41.374 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-10T08:36:41.374 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-10T08:36:41.375 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-10T08:36:41.375 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-10T08:36:41.375 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-10T08:36:41.375 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-10T08:36:41.375 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-10T08:36:41.375 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-10T08:36:41.375 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-10T08:36:41.375 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-10T08:36:41.375 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-10T08:36:41.375 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-10T08:36:41.375 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-10T08:36:41.375 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-10T08:36:41.375 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-10T08:36:41.376 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-10T08:36:41.376 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-10T08:36:41.376 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-10T08:36:41.376 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-10T08:36:41.376 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-10T08:36:41.376 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-10T08:36:41.376 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-10T08:36:41.376 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-10T08:36:41.376 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-10T08:36:41.376 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-10T08:36:41.376 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-10T08:36:41.376 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-10T08:36:41.376 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-10T08:36:41.377 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-10T08:36:41.377 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-10T08:36:41.377 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-10T08:36:41.377 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-10T08:36:41.377 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-10T08:36:41.377 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-10T08:36:41.377 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-10T08:36:41.377 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-10T08:36:41.377 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-10T08:36:41.377 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-10T08:36:41.377 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-10T08:36:41.377 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-10T08:36:41.377 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-10T08:36:41.377 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-10T08:36:41.378 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-10T08:36:41.378 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-10T08:36:41.378 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-10T08:36:41.378 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-10T08:36:41.378 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-10T08:36:41.378 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-10T08:36:41.378 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-10T08:36:41.378 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-10T08:36:41.378 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-10T08:36:41.378 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-10T08:36:41.378 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-10T08:36:41.378 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-10T08:36:41.378 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-10T08:36:41.379 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-10T08:36:41.379 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-10T08:36:41.379 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-10T08:36:41.379 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-10T08:36:41.379 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-10T08:36:41.379 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-10T08:36:41.379 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-10T08:36:41.379 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-10T08:36:41.379 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-10T08:36:41.379 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-10T08:36:41.379 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-10T08:36:41.379 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-10T08:36:41.379 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-10T08:36:41.380 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-10T08:36:41.380 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-10T08:36:41.380 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-10T08:36:41.380 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-10T08:36:41.380 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-10T08:36:41.380 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-10T08:36:41.380 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-10T08:36:41.380 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-10T08:36:41.380 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-10T08:36:41.380 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-10T08:36:41.380 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-10T08:36:41.380 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-10T08:36:41.380 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-10T08:36:41.381 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-10T08:36:41.381 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-10T08:36:41.381 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-10T08:36:41.381 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-10T08:36:41.381 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-10T08:36:41.381 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-10T08:36:41.381 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-10T08:36:41.381 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-10T08:36:41.381 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-10T08:36:41.381 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-10T08:36:41.381 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-10T08:36:41.381 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-10T08:36:41.381 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-10T08:36:41.382 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-10T08:36:41.382 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-10T08:36:41.382 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-10T08:36:41.382 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-10T08:36:41.382 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-10T08:36:41.382 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-10T08:36:41.382 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-10T08:36:41.382 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-10T08:36:41.382 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-10T08:36:41.382 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-10T08:36:41.382 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-10T08:36:41.382 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-10T08:36:41.382 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-10T08:36:41.383 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-10T08:36:41.383 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-10T08:36:41.383 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-10T08:36:41.383 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-10T08:36:41.383 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-10T08:36:41.383 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-10T08:36:41.383 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-10T08:36:41.383 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-10T08:36:41.383 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-10T08:36:41.383 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-10T08:36:41.383 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-10T08:36:41.383 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-10T08:36:41.383 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-10T08:36:41.384 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-10T08:36:41.384 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-10T08:36:41.384 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-10T08:36:41.384 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-10T08:36:41.384 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-10T08:36:41.384 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-10T08:36:41.384 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-10T08:36:41.384 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-10T08:36:41.384 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-10T08:36:41.384 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-10T08:36:41.384 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-10T08:36:41.384 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-10T08:36:41.384 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-10T08:36:41.385 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-10T08:36:41.385 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-10T08:36:41.385 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-10T08:36:41.385 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-10T08:36:41.385 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-10T08:36:41.385 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-10T08:36:41.385 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-10T08:36:41.385 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-10T08:36:41.385 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-10T08:36:41.385 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-10T08:36:41.385 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-10T08:36:41.385 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-10T08:36:41.386 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-10T08:36:41.386 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-10T08:36:41.386 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-10T08:36:41.386 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-10T08:36:41.386 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-10T08:36:41.386 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-10T08:36:41.386 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-10T08:36:41.386 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-10T08:36:41.386 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-10T08:36:41.386 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-10T08:36:41.386 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-10T08:36:41.386 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-10T08:36:41.386 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-10T08:36:41.387 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-10T08:36:41.387 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-10T08:36:41.387 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-10T08:36:41.387 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-10T08:36:41.387 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-10T08:36:41.387 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-10T08:36:41.387 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-10T08:36:41.387 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-10T08:36:41.387 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-10T08:36:41.387 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-10T08:36:41.387 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-10T08:36:41.387 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-10T08:36:41.387 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-10T08:36:41.388 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-10T08:36:41.388 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-10T08:36:41.388 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-10T08:36:41.388 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-10T08:36:41.388 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-10T08:36:41.388 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-10T08:36:41.388 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-10T08:36:41.388 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-10T08:36:41.388 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-10T08:36:41.388 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-10T08:36:41.388 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-10T08:36:41.388 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-10T08:36:41.388 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-10T08:36:41.389 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-10T08:36:41.389 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-10T08:36:41.389 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-10T08:36:41.389 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-10T08:36:41.389 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-10T08:36:41.389 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-10T08:36:41.389 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-10T08:36:41.389 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-10T08:36:41.389 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-10T08:36:41.389 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-10T08:36:41.389 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-10T08:36:41.389 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-10T08:36:41.389 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-10T08:36:41.390 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-10T08:36:41.390 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-10T08:36:41.390 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-10T08:36:41.390 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-10T08:36:41.390 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-10T08:36:41.390 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-10T08:36:41.390 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-10T08:36:41.390 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-10T08:36:41.390 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-10T08:36:41.390 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-10T08:36:41.390 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-10T08:36:41.390 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-10T08:36:41.390 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-10T08:36:41.390 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-10T08:36:41.391 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-10T08:36:41.391 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-10T08:36:41.391 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-10T08:36:41.391 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-10T08:36:41.391 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-10T08:36:41.391 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-10T08:36:41.391 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-10T08:36:41.391 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-10T08:36:41.391 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-10T08:36:41.391 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-10T08:36:41.391 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-10T08:36:41.391 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-10T08:36:41.391 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-10T08:36:41.392 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-10T08:36:41.392 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-10T08:36:41.392 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-10T08:36:41.392 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-10T08:36:41.392 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-10T08:36:41.392 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-10T08:36:41.392 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-10T08:36:41.392 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-10T08:36:41.392 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-10T08:36:41.392 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-10T08:36:41.392 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-10T08:36:41.392 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-10T08:36:41.392 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-10T08:36:41.393 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-10T08:36:41.393 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-10T08:36:41.393 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-10T08:36:41.393 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-10T08:36:41.393 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-10T08:36:41.393 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-10T08:36:41.393 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-10T08:36:41.393 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-10T08:36:41.393 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-10T08:36:41.393 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-10T08:36:41.393 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-10T08:36:41.393 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-10T08:36:41.393 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-10T08:36:41.394 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-10T08:36:41.394 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-10T08:36:41.394 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-10T08:36:41.394 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-10T08:36:41.394 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-10T08:36:41.394 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-10T08:36:41.394 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-10T08:36:41.394 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-10T08:36:41.394 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-10T08:36:41.394 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-10T08:36:41.394 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-10T08:36:41.394 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-10T08:36:41.394 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-10T08:36:41.394 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-10T08:36:41.395 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-10T08:36:41.395 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-10T08:36:41.395 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-10T08:36:41.395 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-10T08:36:41.395 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-10T08:36:41.395 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-10T08:36:41.395 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-10T08:36:41.395 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-10T08:36:41.395 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-10T08:36:41.395 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-10T08:36:41.395 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-10T08:36:41.395 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-10T08:36:41.395 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-10T08:36:41.396 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-10T08:36:41.396 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-10T08:36:41.396 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-10T08:36:41.396 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-10T08:36:41.396 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-10T08:36:41.396 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-10T08:36:41.396 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-10T08:36:41.396 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-10T08:36:41.396 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-10T08:36:41.396 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-10T08:36:41.396 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-10T08:36:41.396 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-10T08:36:41.397 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-10T08:36:41.397 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-10T08:36:41.397 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-10T08:36:41.397 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-10T08:36:41.397 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-10T08:36:41.397 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-10T08:36:41.397 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-10T08:36:41.397 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-10T08:36:41.397 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-10T08:36:41.397 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-10T08:36:41.397 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-10T08:36:41.397 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-10T08:36:41.397 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-10T08:36:41.398 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-10T08:36:41.398 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-10T08:36:41.398 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-10T08:36:41.398 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-10T08:36:41.398 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-10T08:36:41.398 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-10T08:36:41.398 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-10T08:36:41.398 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-10T08:36:41.398 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-10T08:36:41.398 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-10T08:36:41.398 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-10T08:36:41.398 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-10T08:36:41.398 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-10T08:36:41.399 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-10T08:36:41.399 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-10T08:36:41.399 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-10T08:36:41.399 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-10T08:36:41.399 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-10T08:36:41.399 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-10T08:36:41.399 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-10T08:36:41.399 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-10T08:36:41.399 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-10T08:36:41.399 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-10T08:36:41.399 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-10T08:36:41.399 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-10T08:36:41.399 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-10T08:36:41.400 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-10T08:36:41.400 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-10T08:36:41.400 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-10T08:36:41.400 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-10T08:36:41.400 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-10T08:36:41.400 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-10T08:36:41.400 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-10T08:36:41.400 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-10T08:36:41.400 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-10T08:36:41.400 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-10T08:36:41.400 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-10T08:36:41.400 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-10T08:36:41.401 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-10T08:36:41.401 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-10T08:36:41.401 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-10T08:36:41.401 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-10T08:36:41.401 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-10T08:36:41.401 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-10T08:36:41.401 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-10T08:36:41.401 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-10T08:36:41.401 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-10T08:36:41.401 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-10T08:36:41.401 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-10T08:36:41.401 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-10T08:36:41.401 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-10T08:36:41.402 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-10T08:36:41.402 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-10T08:36:41.402 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-10T08:36:41.402 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-10T08:36:41.402 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-10T08:36:41.402 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-10T08:36:41.402 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-10T08:36:41.402 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-10T08:36:41.402 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-10T08:36:41.402 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-10T08:36:41.402 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-10T08:36:41.402 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-10T08:36:41.402 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-10T08:36:41.403 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-10T08:36:41.403 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-10T08:36:41.403 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-10T08:36:41.403 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-10T08:36:41.403 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-10T08:36:41.403 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-10T08:36:41.403 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-10T08:36:41.403 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-10T08:36:41.403 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-10T08:36:41.403 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-10T08:36:41.403 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-10T08:36:41.403 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-10T08:36:41.404 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-10T08:36:41.404 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-10T08:36:41.404 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-10T08:36:41.404 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-10T08:36:41.404 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-10T08:36:41.404 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-10T08:36:41.404 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-10T08:36:41.404 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-10T08:36:41.404 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-10T08:36:41.404 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-10T08:36:41.404 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-10T08:36:41.404 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-10T08:36:41.404 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-10T08:36:41.405 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-10T08:36:41.405 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-10T08:36:41.405 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-10T08:36:41.405 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-10T08:36:41.405 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-10T08:36:41.405 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-10T08:36:41.405 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-10T08:36:41.405 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-10T08:36:41.405 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-10T08:36:41.405 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-10T08:36:41.405 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-10T08:36:41.405 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-10T08:36:41.406 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-10T08:36:41.406 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-10T08:36:41.406 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-10T08:36:41.406 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-10T08:36:41.406 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-10T08:36:41.406 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-10T08:36:41.406 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-10T08:36:41.406 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-10T08:36:41.406 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-10T08:36:41.406 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-10T08:36:41.406 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-10T08:36:41.406 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-10T08:36:41.406 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-10T08:36:41.407 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-10T08:36:41.407 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-10T08:36:41.407 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-10T08:36:41.407 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-10T08:36:41.407 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-10T08:36:41.407 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-10T08:36:41.407 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-10T08:36:41.407 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-10T08:36:41.407 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-10T08:36:41.407 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-10T08:36:41.407 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-10T08:36:41.407 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-10T08:36:41.408 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-10T08:36:41.408 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-10T08:36:41.408 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-10T08:36:41.408 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-10T08:36:41.408 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-10T08:36:41.408 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-10T08:36:41.408 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-10T08:36:41.408 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-10T08:36:41.408 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-10T08:36:41.408 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-10T08:36:41.408 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-10T08:36:41.408 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-10T08:36:41.408 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-10T08:36:41.409 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-10T08:36:41.409 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-10T08:36:41.409 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-10T08:36:41.409 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-10T08:36:41.409 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-10T08:36:41.409 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-10T08:36:41.409 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-10T08:36:41.409 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-10T08:36:41.409 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-10T08:36:41.409 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-10T08:36:41.409 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-10T08:36:41.409 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-10T08:36:41.410 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-10T08:36:41.410 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-10T08:36:41.410 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-10T08:36:41.410 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-10T08:36:41.410 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-10T08:36:41.410 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-10T08:36:41.410 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-10T08:36:41.410 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-10T08:36:41.410 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-10T08:36:41.410 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-10T08:36:41.410 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-10T08:36:41.410 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-10T08:36:41.410 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-10T08:36:41.411 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-10T08:36:41.411 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-10T08:36:41.411 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-10T08:36:41.411 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-10T08:36:41.411 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-10T08:36:41.411 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-10T08:36:41.411 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-10T08:36:41.411 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-10T08:36:41.411 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-10T08:36:41.411 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-10T08:36:41.411 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-10T08:36:41.411 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-10T08:36:41.412 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-10T08:36:41.412 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-10T08:36:41.412 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-10T08:36:41.412 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-10T08:36:41.412 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-10T08:36:41.412 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-10T08:36:41.412 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-10T08:36:41.412 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-10T08:36:41.412 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-10T08:36:41.412 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-10T08:36:41.412 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-10T08:36:41.412 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-10T08:36:41.412 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-10T08:36:41.413 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-10T08:36:41.413 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-10T08:36:41.413 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-10T08:36:41.413 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-10T08:36:41.413 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-10T08:36:41.413 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-10T08:36:41.413 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-10T08:36:41.413 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-10T08:36:41.413 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-10T08:36:41.413 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-10T08:36:41.413 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-10T08:36:41.413 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-10T08:36:41.413 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-10T08:36:41.414 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-10T08:36:41.414 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-10T08:36:41.414 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-10T08:36:41.414 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-10T08:36:41.414 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-10T08:36:41.414 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-10T08:36:41.414 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-10T08:36:41.414 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-10T08:36:41.414 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-10T08:36:41.414 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-10T08:36:41.414 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-10T08:36:41.414 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-10T08:36:41.414 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-10T08:36:41.414 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-10T08:36:41.415 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-10T08:36:41.415 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-10T08:36:41.415 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-10T08:36:41.415 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-10T08:36:41.415 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-10T08:36:41.415 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-10T08:36:41.415 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-10T08:36:41.415 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-10T08:36:41.415 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-10T08:36:41.415 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-10T08:36:41.415 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-10T08:36:41.415 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-10T08:36:41.416 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-10T08:36:41.416 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-10T08:36:41.416 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-10T08:36:41.416 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-10T08:36:41.416 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-10T08:36:41.416 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-10T08:36:41.416 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-10T08:36:41.416 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-10T08:36:41.416 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-10T08:36:41.416 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-10T08:36:41.416 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-10T08:36:41.416 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-10T08:36:41.416 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-10T08:36:41.417 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-10T08:36:41.417 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-10T08:36:41.417 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-10T08:36:41.417 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-10T08:36:41.417 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-10T08:36:41.417 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-10T08:36:41.417 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-10T08:36:41.417 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-10T08:36:41.417 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-10T08:36:41.417 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-10T08:36:41.417 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-10T08:36:41.417 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-10T08:36:41.417 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-10T08:36:41.418 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-10T08:36:41.418 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-10T08:36:41.418 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-10T08:36:41.418 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-10T08:36:41.418 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-10T08:36:41.418 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-10T08:36:41.418 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-10T08:36:41.418 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-10T08:36:41.418 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-10T08:36:41.418 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-10T08:36:41.418 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-10T08:36:41.418 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-10T08:36:41.418 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-10T08:36:41.419 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-10T08:36:41.419 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-10T08:36:41.419 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-10T08:36:41.419 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-10T08:36:41.419 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-10T08:36:41.419 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-10T08:36:41.419 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-10T08:36:41.419 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-10T08:36:41.419 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-10T08:36:41.419 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-10T08:36:41.419 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-10T08:36:41.419 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-10T08:36:41.419 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-10T08:36:41.420 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-10T08:36:41.420 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-10T08:36:41.420 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-10T08:36:41.420 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-10T08:36:41.420 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-10T08:36:41.420 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-10T08:36:41.420 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-10T08:36:41.420 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-10T08:36:41.420 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-10T08:36:41.420 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-10T08:36:41.420 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-10T08:36:41.420 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-10T08:36:41.420 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-10T08:36:41.421 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-10T08:36:41.421 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-10T08:36:41.421 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-10T08:36:41.421 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-10T08:36:41.421 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-10T08:36:41.421 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-10T08:36:41.421 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-10T08:36:41.421 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-10T08:36:41.421 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-10T08:36:41.421 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-10T08:36:41.421 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-10T08:36:41.421 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-10T08:36:41.421 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-10T08:36:41.422 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-10T08:36:41.422 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-10T08:36:41.422 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-10T08:36:41.422 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-10T08:36:41.422 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-10T08:36:41.422 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-10T08:36:41.422 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-10T08:36:41.422 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-10T08:36:41.422 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-10T08:36:41.422 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-10T08:36:41.422 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-10T08:36:41.422 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-10T08:36:41.422 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-10T08:36:41.422 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-10T08:36:41.423 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-10T08:36:41.423 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-10T08:36:41.423 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-10T08:36:41.423 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-10T08:36:41.423 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-10T08:36:41.423 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-10T08:36:41.423 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-10T08:36:41.423 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-10T08:36:41.423 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-10T08:36:41.423 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-10T08:36:41.423 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-10T08:36:41.423 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-10T08:36:41.423 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-10T08:36:41.423 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-10T08:36:41.424 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-10T08:36:41.424 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-10T08:36:41.424 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-10T08:36:41.424 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-10T08:36:41.424 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-10T08:36:41.424 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-10T08:36:41.424 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-10T08:36:41.424 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-10T08:36:41.424 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-10T08:36:41.424 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-10T08:36:41.424 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-10T08:36:41.424 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-10T08:36:41.425 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-10T08:36:41.425 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-10T08:36:41.425 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-10T08:36:41.425 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-10T08:36:41.425 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-10T08:36:41.425 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-10T08:36:41.425 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-10T08:36:41.425 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-10T08:36:41.425 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-10T08:36:41.425 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-10T08:36:41.425 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-10T08:36:41.425 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-10T08:36:41.425 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-10T08:36:41.425 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-10T08:36:41.426 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-10T08:36:41.426 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-10T08:36:41.426 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-10T08:36:41.426 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-10T08:36:41.426 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-10T08:36:41.426 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-10T08:36:41.426 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-10T08:36:41.426 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-10T08:36:41.426 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-10T08:36:41.426 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-10T08:36:41.426 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-10T08:36:41.426 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-10T08:36:41.426 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-10T08:36:41.427 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-10T08:36:41.427 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-10T08:36:41.427 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-10T08:36:41.427 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-10T08:36:41.427 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-10T08:36:41.427 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-10T08:36:41.427 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-10T08:36:41.427 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-10T08:36:41.427 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-10T08:36:41.427 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-10T08:36:41.427 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-10T08:36:41.427 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-10T08:36:41.427 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-10T08:36:41.428 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-10T08:36:41.428 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-10T08:36:41.428 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-10T08:36:41.428 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-10T08:36:41.428 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-10T08:36:41.428 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-10T08:36:41.428 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-10T08:36:41.428 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-10T08:36:41.428 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-10T08:36:41.428 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-10T08:36:41.428 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-10T08:36:41.428 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-10T08:36:41.428 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-10T08:36:41.429 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-10T08:36:41.429 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-10T08:36:41.429 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-10T08:36:41.429 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-10T08:36:41.429 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-10T08:36:41.429 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-10T08:36:41.429 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-10T08:36:41.429 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-10T08:36:41.429 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-10T08:36:41.429 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-10T08:36:41.429 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-10T08:36:41.429 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-10T08:36:41.430 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-10T08:36:41.430 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-10T08:36:41.430 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-10T08:36:41.430 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-10T08:36:41.430 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-10T08:36:41.430 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-10T08:36:41.430 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-10T08:36:41.430 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-10T08:36:41.430 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-10T08:36:41.430 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-10T08:36:41.430 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-10T08:36:41.430 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-10T08:36:41.430 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-10T08:36:41.431 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-10T08:36:41.431 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-10T08:36:41.431 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-10T08:36:41.431 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-10T08:36:41.431 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-10T08:36:41.431 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-10T08:36:41.431 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-10T08:36:41.431 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-10T08:36:41.431 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-10T08:36:41.431 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-10T08:36:41.431 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-10T08:36:41.431 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-10T08:36:41.431 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-10T08:36:41.432 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-10T08:36:41.432 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-10T08:36:41.432 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-10T08:36:41.432 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-10T08:36:41.432 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-10T08:36:41.432 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-10T08:36:41.432 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-10T08:36:41.432 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-10T08:36:41.432 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-10T08:36:41.432 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-10T08:36:41.432 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-10T08:36:41.432 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-10T08:36:41.433 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-10T08:36:41.433 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-10T08:36:41.433 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-10T08:36:41.433 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-10T08:36:41.433 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-10T08:36:41.433 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-10T08:36:41.433 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-10T08:36:41.433 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-10T08:36:41.433 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-10T08:36:41.433 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-10T08:36:41.433 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-10T08:36:41.434 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-10T08:36:41.434 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-10T08:36:41.434 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-10T08:36:41.434 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-10T08:36:41.434 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-10T08:36:41.434 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-10T08:36:41.434 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-10T08:36:41.434 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-10T08:36:41.434 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-10T08:36:41.434 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-10T08:36:41.434 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-10T08:36:41.434 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-10T08:36:41.435 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-10T08:36:41.435 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-10T08:36:41.435 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-10T08:36:41.435 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-10T08:36:41.435 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-10T08:36:41.435 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-10T08:36:41.435 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-10T08:36:41.435 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-10T08:36:41.435 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-10T08:36:41.435 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-10T08:36:41.435 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-10T08:36:41.435 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-10T08:36:41.436 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-10T08:36:41.436 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-10T08:36:41.436 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-10T08:36:41.436 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-10T08:36:41.436 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-10T08:36:41.436 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-10T08:36:41.436 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-10T08:36:41.436 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-10T08:36:41.436 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-10T08:36:41.436 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-10T08:36:41.436 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-10T08:36:41.436 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-10T08:36:41.437 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-10T08:36:41.437 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-10T08:36:41.437 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-10T08:36:41.437 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-10T08:36:41.437 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-10T08:36:41.437 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-10T08:36:41.437 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-10T08:36:41.437 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-10T08:36:41.437 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-10T08:36:41.437 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-10T08:36:41.437 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-10T08:36:41.437 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-10T08:36:41.437 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-10T08:36:41.438 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-10T08:36:41.438 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-10T08:36:41.438 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-10T08:36:41.438 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-10T08:36:41.438 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-10T08:36:41.438 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-10T08:36:41.438 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-10T08:36:41.438 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-10T08:36:41.438 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-10T08:36:41.438 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-10T08:36:41.438 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-10T08:36:41.438 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-10T08:36:41.438 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-10T08:36:41.439 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-10T08:36:41.439 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-10T08:36:41.439 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-10T08:36:41.439 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-10T08:36:41.439 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-10T08:36:41.439 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-10T08:36:41.439 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-10T08:36:41.439 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-10T08:36:41.439 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-10T08:36:41.439 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-10T08:36:41.439 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-10T08:36:41.439 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-10T08:36:41.439 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-10T08:36:41.439 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-10T08:36:41.440 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-10T08:36:41.440 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-10T08:36:41.440 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-10T08:36:41.440 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-10T08:36:41.440 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-10T08:36:41.440 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-10T08:36:41.440 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-10T08:36:41.440 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-10T08:36:41.440 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-10T08:36:41.440 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-10T08:36:41.440 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-10T08:36:41.440 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-10T08:36:41.441 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-10T08:36:41.441 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-10T08:36:41.441 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-10T08:36:41.441 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-10T08:36:41.441 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-10T08:36:41.441 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-10T08:36:41.441 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-10T08:36:41.441 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-10T08:36:41.441 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-10T08:36:41.441 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-10T08:36:41.441 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-10T08:36:41.441 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-10T08:36:41.441 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-10T08:36:41.441 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-10T08:36:41.442 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-10T08:36:41.442 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-10T08:36:41.442 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-10T08:36:41.442 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-10T08:36:41.442 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-10T08:36:41.442 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-10T08:36:41.442 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-10T08:36:41.442 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-10T08:36:41.442 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-10T08:36:41.442 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-10T08:36:41.442 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-10T08:36:41.442 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-10T08:36:41.442 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-10T08:36:41.443 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-10T08:36:41.443 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-10T08:36:41.443 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-10T08:36:41.443 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-10T08:36:41.443 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-10T08:36:41.443 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-10T08:36:41.443 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-10T08:36:41.443 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-10T08:36:41.443 INFO:teuthology.orchestra.run.smithi002.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-10T08:36:41.447 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T08:36:41.447 DEBUG:teuthology.orchestra.run.smithi002:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-10T08:36:41.471 INFO:teuthology.orchestra.run.smithi002.stdout:postinstall scriptlet (using /bin/sh): 2024-09-10T08:36:41.471 INFO:teuthology.orchestra.run.smithi002.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-10T08:36:41.471 INFO:teuthology.orchestra.run.smithi002.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-10T08:36:41.472 INFO:teuthology.orchestra.run.smithi002.stdout:fi 2024-09-10T08:36:41.472 INFO:teuthology.orchestra.run.smithi002.stdout:for file in vmlinuz System.map config; do 2024-09-10T08:36:41.472 INFO:teuthology.orchestra.run.smithi002.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-10T08:36:41.472 INFO:teuthology.orchestra.run.smithi002.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-10T08:36:41.472 INFO:teuthology.orchestra.run.smithi002.stdout: fi 2024-09-10T08:36:41.472 INFO:teuthology.orchestra.run.smithi002.stdout:done 2024-09-10T08:36:41.472 INFO:teuthology.orchestra.run.smithi002.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-10T08:36:41.472 INFO:teuthology.orchestra.run.smithi002.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-10T08:36:41.472 INFO:teuthology.orchestra.run.smithi002.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-10T08:36:41.472 INFO:teuthology.orchestra.run.smithi002.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-10T08:36:41.472 INFO:teuthology.orchestra.run.smithi002.stdout:fi 2024-09-10T08:36:41.472 INFO:teuthology.orchestra.run.smithi002.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-10T08:36:41.473 INFO:teuthology.orchestra.run.smithi002.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T08:36:41.473 INFO:teuthology.orchestra.run.smithi002.stdout:fi 2024-09-10T08:36:41.473 INFO:teuthology.orchestra.run.smithi002.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-10T08:36:41.473 INFO:teuthology.orchestra.run.smithi002.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-10T08:36:41.473 INFO:teuthology.orchestra.run.smithi002.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T08:36:41.473 INFO:teuthology.orchestra.run.smithi002.stdout:fi 2024-09-10T08:36:41.474 DEBUG:teuthology.orchestra.run.smithi002:> sudo rpm -qi grub2-tools 2024-09-10T08:36:41.549 INFO:teuthology.orchestra.run.smithi002.stdout:Name : grub2-tools 2024-09-10T08:36:41.549 INFO:teuthology.orchestra.run.smithi002.stdout:Epoch : 1 2024-09-10T08:36:41.550 INFO:teuthology.orchestra.run.smithi002.stdout:Version : 2.06 2024-09-10T08:36:41.550 INFO:teuthology.orchestra.run.smithi002.stdout:Release : 82.el9 2024-09-10T08:36:41.550 INFO:teuthology.orchestra.run.smithi002.stdout:Architecture: x86_64 2024-09-10T08:36:41.550 INFO:teuthology.orchestra.run.smithi002.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-10T08:36:41.550 INFO:teuthology.orchestra.run.smithi002.stdout:Group : Unspecified 2024-09-10T08:36:41.551 INFO:teuthology.orchestra.run.smithi002.stdout:Size : 8274670 2024-09-10T08:36:41.551 INFO:teuthology.orchestra.run.smithi002.stdout:License : GPLv3+ 2024-09-10T08:36:41.551 INFO:teuthology.orchestra.run.smithi002.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-10T08:36:41.551 INFO:teuthology.orchestra.run.smithi002.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-10T08:36:41.551 INFO:teuthology.orchestra.run.smithi002.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-10T08:36:41.552 INFO:teuthology.orchestra.run.smithi002.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-10T08:36:41.552 INFO:teuthology.orchestra.run.smithi002.stdout:Packager : builder@centos.org 2024-09-10T08:36:41.552 INFO:teuthology.orchestra.run.smithi002.stdout:Vendor : CentOS 2024-09-10T08:36:41.552 INFO:teuthology.orchestra.run.smithi002.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-10T08:36:41.553 INFO:teuthology.orchestra.run.smithi002.stdout:Summary : Support tools for GRUB. 2024-09-10T08:36:41.553 INFO:teuthology.orchestra.run.smithi002.stdout:Description : 2024-09-10T08:36:41.553 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:36:41.553 INFO:teuthology.orchestra.run.smithi002.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-10T08:36:41.553 INFO:teuthology.orchestra.run.smithi002.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-10T08:36:41.553 INFO:teuthology.orchestra.run.smithi002.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-10T08:36:41.553 INFO:teuthology.orchestra.run.smithi002.stdout:hardware devices. 2024-09-10T08:36:41.554 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:36:41.554 INFO:teuthology.orchestra.run.smithi002.stdout:This subpackage provides tools for support of all platforms. 2024-09-10T08:36:41.555 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-10T08:36:41.555 INFO:teuthology.task.kernel:Updating grub on smithi002 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T08:36:41.555 DEBUG:teuthology.orchestra.run.smithi002:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-10T08:36:42.193 INFO:teuthology.orchestra.run.smithi002.stderr:Generating grub configuration file ... 2024-09-10T08:36:43.560 INFO:teuthology.orchestra.run.smithi002.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-10T08:36:43.584 INFO:teuthology.orchestra.run.smithi002.stderr:done 2024-09-10T08:36:43.586 DEBUG:teuthology.orchestra.run.smithi002:> mktemp 2024-09-10T08:36:43.602 INFO:teuthology.orchestra.run.smithi002.stdout:/tmp/tmp.hTTw4x1UQ2 2024-09-10T08:36:43.602 DEBUG:teuthology.orchestra.run.smithi002:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.hTTw4x1UQ2 2024-09-10T08:36:43.669 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0666 /tmp/tmp.hTTw4x1UQ2 2024-09-10T08:36:43.806 DEBUG:teuthology.orchestra.remote:smithi002:/tmp/tmp.hTTw4x1UQ2 is 6KB 2024-09-10T08:36:43.853 DEBUG:teuthology.orchestra.run.smithi002:> rm -fr /tmp/tmp.hTTw4x1UQ2 2024-09-10T08:36:43.868 DEBUG:teuthology.orchestra.run.smithi002:> sudo /bin/ls /boot/loader/entries || true 2024-09-10T08:36:43.937 INFO:teuthology.orchestra.run.smithi002.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-10T08:36:43.937 INFO:teuthology.orchestra.run.smithi002.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-10T08:36:43.937 INFO:teuthology.orchestra.run.smithi002.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-10T08:36:43.937 INFO:teuthology.orchestra.run.smithi002.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-10T08:36:43.938 DEBUG:teuthology.orchestra.run.smithi002:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-10T08:36:44.095 DEBUG:teuthology.orchestra.run.smithi002:> sudo shutdown -r now 2024-09-10T08:37:06.341 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-09-10T08:37:06.341 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2024-09-10T08:37:06.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T08:37:14.105 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-10T08:37:14.105 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-09-10T08:37:14.106 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T08:37:24.669 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.155 2024-09-10T08:37:32.605 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.2 2024-09-10T08:37:33.672 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2024-09-10T08:37:33.673 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T08:37:36.733 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.155 2024-09-10T08:37:41.610 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-09-10T08:37:41.611 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T08:37:48.741 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2024-09-10T08:37:48.742 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T08:38:07.169 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.155 2024-09-10T08:38:22.183 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2024-09-10T08:38:22.184 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T08:38:23.803 DEBUG:teuthology.orchestra.run.smithi155:> true 2024-09-10T08:38:24.352 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi155.front.sepia.ceph.com' 2024-09-10T08:38:24.352 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-10T08:38:24.353 DEBUG:teuthology.orchestra.run.smithi155:> uname -r 2024-09-10T08:38:24.388 INFO:teuthology.orchestra.run.smithi155.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-10T08:38:24.388 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T08:38:24.388 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T08:38:24.388 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-10T08:38:25.390 DEBUG:teuthology.parallel:result is None 2024-09-10T08:38:41.614 DEBUG:teuthology.orchestra.remote:timed out 2024-09-10T08:38:53.615 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-09-10T08:38:53.617 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T08:38:54.024 DEBUG:teuthology.orchestra.run.smithi002:> true 2024-09-10T08:38:54.507 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-09-10T08:38:54.507 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-10T08:38:54.508 DEBUG:teuthology.orchestra.run.smithi002:> uname -r 2024-09-10T08:38:54.541 INFO:teuthology.orchestra.run.smithi002.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-10T08:38:54.541 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-10T08:38:54.542 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T08:38:54.542 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-10T08:38:55.545 DEBUG:teuthology.parallel:result is None 2024-09-10T08:38:55.545 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-10T08:38:55.552 INFO:teuthology.task.internal:Creating test directory... 2024-09-10T08:38:55.553 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T08:38:55.557 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T08:38:55.599 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-10T08:38:55.606 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-10T08:38:55.636 INFO:teuthology.task.internal:Creating archive directory... 2024-09-10T08:38:55.637 DEBUG:teuthology.orchestra.run.smithi002:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T08:38:55.641 DEBUG:teuthology.orchestra.run.smithi155:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T08:38:55.697 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-10T08:38:55.703 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-10T08:38:55.703 DEBUG:teuthology.orchestra.run.smithi002:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T08:38:55.707 DEBUG:teuthology.orchestra.run.smithi155:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T08:38:55.799 INFO:teuthology.orchestra.run.smithi002.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T08:38:55.831 INFO:teuthology.orchestra.run.smithi002.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T08:38:55.841 INFO:teuthology.orchestra.run.smithi155.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T08:38:55.873 INFO:teuthology.orchestra.run.smithi155.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T08:38:55.876 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-10T08:38:55.883 INFO:teuthology.task.internal:Configuring sudo... 2024-09-10T08:38:55.884 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T08:38:55.887 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T08:38:55.943 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-10T08:38:55.953 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-10T08:38:55.953 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T08:38:55.957 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T08:38:55.991 DEBUG:teuthology.orchestra.run.smithi002:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T08:38:56.084 DEBUG:teuthology.orchestra.run.smithi002:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T08:38:56.176 DEBUG:teuthology.orchestra.run.smithi002:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T08:38:56.232 DEBUG:teuthology.orchestra.run.smithi002:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T08:38:56.308 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T08:38:56.308 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T08:38:56.363 DEBUG:teuthology.orchestra.run.smithi155:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T08:38:56.424 DEBUG:teuthology.orchestra.run.smithi155:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T08:38:56.509 DEBUG:teuthology.orchestra.run.smithi155:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T08:38:56.572 DEBUG:teuthology.orchestra.run.smithi155:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T08:38:56.642 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-10T08:38:56.642 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T08:38:56.697 DEBUG:teuthology.orchestra.run.smithi002:> sudo service rsyslog restart 2024-09-10T08:38:56.701 DEBUG:teuthology.orchestra.run.smithi155:> sudo service rsyslog restart 2024-09-10T08:38:56.770 INFO:teuthology.orchestra.run.smithi002.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T08:38:56.833 INFO:teuthology.orchestra.run.smithi155.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T08:38:57.184 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-10T08:38:57.192 INFO:teuthology.task.internal:Starting timer... 2024-09-10T08:38:57.192 INFO:teuthology.run_tasks:Running task pcp... 2024-09-10T08:38:57.239 INFO:teuthology.run_tasks:Running task selinux... 2024-09-10T08:38:57.281 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-09-10T08:38:57.282 DEBUG:teuthology.orchestra.run.smithi002:> sudo service auditd rotate 2024-09-10T08:38:57.362 INFO:teuthology.orchestra.run.smithi002.stdout:Rotating logs: 2024-09-10T08:38:57.365 DEBUG:teuthology.orchestra.run.smithi155:> sudo service auditd rotate 2024-09-10T08:38:57.453 INFO:teuthology.orchestra.run.smithi155.stdout:Rotating logs: 2024-09-10T08:38:57.457 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-10T08:38:57.457 DEBUG:teuthology.orchestra.run.smithi002:> /usr/sbin/getenforce 2024-09-10T08:38:57.499 INFO:teuthology.orchestra.run.smithi002.stdout:Permissive 2024-09-10T08:38:57.499 DEBUG:teuthology.orchestra.run.smithi155:> /usr/sbin/getenforce 2024-09-10T08:38:57.537 INFO:teuthology.orchestra.run.smithi155.stdout:Permissive 2024-09-10T08:38:57.537 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi002.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi155.front.sepia.ceph.com': 'permissive'} 2024-09-10T08:38:57.538 DEBUG:teuthology.orchestra.run.smithi002:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T08:38:57.598 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T08:38:57.599 DEBUG:teuthology.orchestra.run.smithi155:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T08:38:57.657 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T08:38:57.658 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-10T08:38:57.658 DEBUG:teuthology.orchestra.run.smithi002:> sudo /usr/sbin/setenforce permissive 2024-09-10T08:38:57.723 DEBUG:teuthology.orchestra.run.smithi155:> sudo /usr/sbin/setenforce permissive 2024-09-10T08:38:57.786 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-10T08:38:57.796 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-10T08:38:57.809 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-10T08:38:57.810 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi002.front.sepia.ceph.com,smithi155.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-10T08:43:45.064 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi002.front.sepia.ceph.com'), Remote(name='ubuntu@smithi155.front.sepia.ceph.com')] 2024-09-10T08:43:45.066 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-09-10T08:43:45.067 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T08:43:45.156 DEBUG:teuthology.orchestra.run.smithi002:> true 2024-09-10T08:43:45.271 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-09-10T08:43:45.271 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2024-09-10T08:43:45.272 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T08:43:45.366 DEBUG:teuthology.orchestra.run.smithi155:> true 2024-09-10T08:43:45.475 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi155.front.sepia.ceph.com' 2024-09-10T08:43:45.475 INFO:teuthology.run_tasks:Running task clock... 2024-09-10T08:43:45.486 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-10T08:43:45.487 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T08:43:45.487 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T08:43:45.491 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T08:43:45.491 DEBUG:teuthology.orchestra.run.smithi155:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T08:43:45.550 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T08:43:45.577 INFO:teuthology.orchestra.run.smithi155.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-10T08:43:45.579 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T08:43:45.607 INFO:teuthology.orchestra.run.smithi155.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-10T08:43:45.630 INFO:teuthology.orchestra.run.smithi002.stderr:sudo: ntpd: command not found 2024-09-10T08:43:45.654 INFO:teuthology.orchestra.run.smithi002.stdout:506 Cannot talk to daemon 2024-09-10T08:43:45.658 INFO:teuthology.orchestra.run.smithi155.stderr:sudo: ntpd: command not found 2024-09-10T08:43:45.683 INFO:teuthology.orchestra.run.smithi155.stdout:506 Cannot talk to daemon 2024-09-10T08:43:45.684 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T08:43:45.713 INFO:teuthology.orchestra.run.smithi155.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-10T08:43:45.713 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T08:43:45.742 INFO:teuthology.orchestra.run.smithi155.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-10T08:43:45.807 INFO:teuthology.orchestra.run.smithi002.stderr:bash: line 1: ntpq: command not found 2024-09-10T08:43:45.813 INFO:teuthology.orchestra.run.smithi002.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T08:43:45.813 INFO:teuthology.orchestra.run.smithi002.stdout:=============================================================================== 2024-09-10T08:43:45.813 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T08:43:45.813 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T08:43:45.814 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T08:43:45.814 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T08:43:45.832 INFO:teuthology.orchestra.run.smithi155.stderr:bash: line 1: ntpq: command not found 2024-09-10T08:43:45.838 INFO:teuthology.orchestra.run.smithi155.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T08:43:45.838 INFO:teuthology.orchestra.run.smithi155.stdout:=============================================================================== 2024-09-10T08:43:45.838 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T08:43:45.838 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T08:43:45.838 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T08:43:45.838 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T08:43:45.839 INFO:teuthology.run_tasks:Running task install... 2024-09-10T08:43:45.847 DEBUG:teuthology.task.install:project ceph 2024-09-10T08:43:45.847 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b'}} 2024-09-10T08:43:45.848 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b'} 2024-09-10T08:43:45.848 INFO:teuthology.task.install:Using flavor: default 2024-09-10T08:43:45.853 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-10T08:43:45.853 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-10T08:43:45.854 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b', 'tag': None, 'wait_for_package': False} 2024-09-10T08:43:45.854 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T08:43:45.857 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b', 'tag': None, 'wait_for_package': False} 2024-09-10T08:43:45.857 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T08:43:46.005 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/ 2024-09-10T08:43:46.005 INFO:teuthology.task.install.rpm:Package version is 19.1.1-305.g1cf819b7 2024-09-10T08:43:46.009 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/ 2024-09-10T08:43:46.009 INFO:teuthology.task.install.rpm:Package version is 19.1.1-305.g1cf819b7 2024-09-10T08:43:46.116 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T08:43:46.117 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T08:43:46.117 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T08:43:46.123 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240909.165402-squid/1cf819b7212a6048e92fc78c4eff963344f6d56b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-10T08:43:46.123 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-10T08:43:46.123 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-10T08:43:46.174 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-10T08:43:46.174 DEBUG:teuthology.orchestra.run.smithi002:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1cf819b7212a6048e92fc78c4eff963344f6d56b/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T08:43:46.179 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-10T08:43:46.180 DEBUG:teuthology.orchestra.run.smithi155:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1cf819b7212a6048e92fc78c4eff963344f6d56b/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-10T08:43:46.272 DEBUG:teuthology.orchestra.run.smithi002:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T08:43:46.277 DEBUG:teuthology.orchestra.run.smithi155:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-10T08:43:46.351 DEBUG:teuthology.orchestra.run.smithi002:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T08:43:46.355 DEBUG:teuthology.orchestra.run.smithi155:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-10T08:43:46.409 INFO:teuthology.orchestra.run.smithi002.stdout:check_obsoletes = 1 2024-09-10T08:43:46.410 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum clean all 2024-09-10T08:43:46.410 INFO:teuthology.orchestra.run.smithi155.stdout:check_obsoletes = 1 2024-09-10T08:43:46.414 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum clean all 2024-09-10T08:43:46.690 INFO:teuthology.orchestra.run.smithi002.stdout:45 files removed 2024-09-10T08:43:46.699 INFO:teuthology.orchestra.run.smithi155.stdout:45 files removed 2024-09-10T08:43:46.723 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-10T08:43:46.732 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-10T08:43:47.438 INFO:teuthology.orchestra.run.smithi155.stdout:ceph packages for x86_64 270 kB/s | 84 kB 00:00 2024-09-10T08:43:47.440 INFO:teuthology.orchestra.run.smithi002.stdout:ceph packages for x86_64 269 kB/s | 84 kB 00:00 2024-09-10T08:43:47.732 INFO:teuthology.orchestra.run.smithi002.stdout:ceph noarch packages 48 kB/s | 12 kB 00:00 2024-09-10T08:43:47.746 INFO:teuthology.orchestra.run.smithi155.stdout:ceph noarch packages 44 kB/s | 12 kB 00:00 2024-09-10T08:43:48.025 INFO:teuthology.orchestra.run.smithi002.stdout:ceph source packages 7.4 kB/s | 1.9 kB 00:00 2024-09-10T08:43:48.033 INFO:teuthology.orchestra.run.smithi155.stdout:ceph source packages 7.6 kB/s | 1.9 kB 00:00 2024-09-10T08:43:48.750 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.2 MB 00:00 2024-09-10T08:43:49.758 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - BaseOS 4.9 MB/s | 8.2 MB 00:01 2024-09-10T08:43:54.476 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 9 - AppStream 4.5 MB/s | 20 MB 00:04 2024-09-10T08:43:55.600 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - AppStream 4.4 MB/s | 20 MB 00:04 2024-09-10T08:44:00.185 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - CRB 17 MB/s | 6.5 MB 00:00 2024-09-10T08:44:00.268 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 9 - CRB 3.8 MB/s | 6.5 MB 00:01 2024-09-10T08:44:01.752 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - Extras packages 90 kB/s | 19 kB 00:00 2024-09-10T08:44:01.785 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 9 - Extras packages 82 kB/s | 19 kB 00:00 2024-09-10T08:44:03.372 INFO:teuthology.orchestra.run.smithi002.stdout:Extra Packages for Enterprise Linux 15 MB/s | 23 MB 00:01 2024-09-10T08:44:03.440 INFO:teuthology.orchestra.run.smithi155.stdout:Extra Packages for Enterprise Linux 15 MB/s | 23 MB 00:01 2024-09-10T08:44:09.887 INFO:teuthology.orchestra.run.smithi155.stdout:lab-extras 16 kB/s | 1.7 kB 00:00 2024-09-10T08:44:09.961 INFO:teuthology.orchestra.run.smithi002.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-09-10T08:44:12.366 INFO:teuthology.orchestra.run.smithi155.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T08:44:12.367 INFO:teuthology.orchestra.run.smithi155.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T08:44:12.378 INFO:teuthology.orchestra.run.smithi155.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-10T08:44:12.379 INFO:teuthology.orchestra.run.smithi155.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-10T08:44:12.380 INFO:teuthology.orchestra.run.smithi155.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-10T08:44:12.381 INFO:teuthology.orchestra.run.smithi155.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-10T08:44:12.382 INFO:teuthology.orchestra.run.smithi155.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-10T08:44:12.385 INFO:teuthology.orchestra.run.smithi155.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-10T08:44:12.385 INFO:teuthology.orchestra.run.smithi155.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-10T08:44:12.450 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2024-09-10T08:44:12.470 INFO:teuthology.orchestra.run.smithi155.stdout:====================================================================================== 2024-09-10T08:44:12.470 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repository Size 2024-09-10T08:44:12.470 INFO:teuthology.orchestra.run.smithi155.stdout:====================================================================================== 2024-09-10T08:44:12.470 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2024-09-10T08:44:12.470 INFO:teuthology.orchestra.run.smithi155.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-10T08:44:12.470 INFO:teuthology.orchestra.run.smithi155.stdout: ceph x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 6.5 k 2024-09-10T08:44:12.471 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-base x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 5.4 M 2024-09-10T08:44:12.471 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-fuse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 897 k 2024-09-10T08:44:12.471 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 145 k 2024-09-10T08:44:12.471 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 1.5 M 2024-09-10T08:44:12.471 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-cephadm noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 146 k 2024-09-10T08:44:12.471 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-dashboard noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 3.6 M 2024-09-10T08:44:12.471 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 7.4 M 2024-09-10T08:44:12.471 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-rook noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 49 k 2024-09-10T08:44:12.471 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-radosgw x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 11 M 2024-09-10T08:44:12.471 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-test x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 49 M 2024-09-10T08:44:12.471 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-volume noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 285 k 2024-09-10T08:44:12.472 INFO:teuthology.orchestra.run.smithi155.stdout: cephadm noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 766 k 2024-09-10T08:44:12.472 INFO:teuthology.orchestra.run.smithi155.stdout: cephfs-mirror x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 228 k 2024-09-10T08:44:12.472 INFO:teuthology.orchestra.run.smithi155.stdout: cephfs-shell x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 27 k 2024-09-10T08:44:12.472 INFO:teuthology.orchestra.run.smithi155.stdout: cephfs-top noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 18 k 2024-09-10T08:44:12.472 INFO:teuthology.orchestra.run.smithi155.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-10T08:44:12.472 INFO:teuthology.orchestra.run.smithi155.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-10T08:44:12.472 INFO:teuthology.orchestra.run.smithi155.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-10T08:44:12.472 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs-devel x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 32 k 2024-09-10T08:44:12.472 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 751 k 2024-09-10T08:44:12.472 INFO:teuthology.orchestra.run.smithi155.stdout: librados-devel x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 127 k 2024-09-10T08:44:12.472 INFO:teuthology.orchestra.run.smithi155.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-10T08:44:12.472 INFO:teuthology.orchestra.run.smithi155.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-10T08:44:12.473 INFO:teuthology.orchestra.run.smithi155.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-10T08:44:12.473 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-10T08:44:12.473 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-10T08:44:12.473 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-10T08:44:12.473 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cephfs x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 161 k 2024-09-10T08:44:12.473 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rados x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 320 k 2024-09-10T08:44:12.473 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rbd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 301 k 2024-09-10T08:44:12.473 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rgw x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 99 k 2024-09-10T08:44:12.473 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-fuse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 85 k 2024-09-10T08:44:12.473 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-mirror x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.1 M 2024-09-10T08:44:12.473 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-nbd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 170 k 2024-09-10T08:44:12.473 INFO:teuthology.orchestra.run.smithi155.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-10T08:44:12.473 INFO:teuthology.orchestra.run.smithi155.stdout:Upgrading: 2024-09-10T08:44:12.474 INFO:teuthology.orchestra.run.smithi155.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-10T08:44:12.474 INFO:teuthology.orchestra.run.smithi155.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-10T08:44:12.474 INFO:teuthology.orchestra.run.smithi155.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-10T08:44:12.474 INFO:teuthology.orchestra.run.smithi155.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-10T08:44:12.474 INFO:teuthology.orchestra.run.smithi155.stdout: librados2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.4 M 2024-09-10T08:44:12.474 INFO:teuthology.orchestra.run.smithi155.stdout: librbd1 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.2 M 2024-09-10T08:44:12.474 INFO:teuthology.orchestra.run.smithi155.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-10T08:44:12.474 INFO:teuthology.orchestra.run.smithi155.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-10T08:44:12.474 INFO:teuthology.orchestra.run.smithi155.stdout:Installing dependencies: 2024-09-10T08:44:12.474 INFO:teuthology.orchestra.run.smithi155.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T08:44:12.474 INFO:teuthology.orchestra.run.smithi155.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-10T08:44:12.474 INFO:teuthology.orchestra.run.smithi155.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T08:44:12.475 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-common x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 21 M 2024-09-10T08:44:12.475 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-grafana-dashboards noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 32 k 2024-09-10T08:44:12.475 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mds x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 2.4 M 2024-09-10T08:44:12.475 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-modules-core noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 249 k 2024-09-10T08:44:12.475 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mon x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 4.7 M 2024-09-10T08:44:12.475 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-osd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 17 M 2024-09-10T08:44:12.475 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-prometheus-alerts noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 16 k 2024-09-10T08:44:12.475 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-selinux x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 25 k 2024-09-10T08:44:12.475 INFO:teuthology.orchestra.run.smithi155.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T08:44:12.475 INFO:teuthology.orchestra.run.smithi155.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T08:44:12.475 INFO:teuthology.orchestra.run.smithi155.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T08:44:12.475 INFO:teuthology.orchestra.run.smithi155.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T08:44:12.475 INFO:teuthology.orchestra.run.smithi155.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T08:44:12.476 INFO:teuthology.orchestra.run.smithi155.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T08:44:12.476 INFO:teuthology.orchestra.run.smithi155.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T08:44:12.476 INFO:teuthology.orchestra.run.smithi155.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T08:44:12.476 INFO:teuthology.orchestra.run.smithi155.stdout: libcephsqlite x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 164 k 2024-09-10T08:44:12.476 INFO:teuthology.orchestra.run.smithi155.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T08:44:12.476 INFO:teuthology.orchestra.run.smithi155.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T08:44:12.476 INFO:teuthology.orchestra.run.smithi155.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T08:44:12.476 INFO:teuthology.orchestra.run.smithi155.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T08:44:12.476 INFO:teuthology.orchestra.run.smithi155.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T08:44:12.476 INFO:teuthology.orchestra.run.smithi155.stdout: libradosstriper1 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 506 k 2024-09-10T08:44:12.476 INFO:teuthology.orchestra.run.smithi155.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T08:44:12.476 INFO:teuthology.orchestra.run.smithi155.stdout: librgw2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 5.3 M 2024-09-10T08:44:12.476 INFO:teuthology.orchestra.run.smithi155.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T08:44:12.477 INFO:teuthology.orchestra.run.smithi155.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-10T08:44:12.477 INFO:teuthology.orchestra.run.smithi155.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T08:44:12.477 INFO:teuthology.orchestra.run.smithi155.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T08:44:12.477 INFO:teuthology.orchestra.run.smithi155.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T08:44:12.477 INFO:teuthology.orchestra.run.smithi155.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T08:44:12.477 INFO:teuthology.orchestra.run.smithi155.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T08:44:12.477 INFO:teuthology.orchestra.run.smithi155.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T08:44:12.477 INFO:teuthology.orchestra.run.smithi155.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T08:44:12.477 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-10T08:44:12.477 INFO:teuthology.orchestra.run.smithi155.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T08:44:12.477 INFO:teuthology.orchestra.run.smithi155.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T08:44:12.477 INFO:teuthology.orchestra.run.smithi155.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T08:44:12.477 INFO:teuthology.orchestra.run.smithi155.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-10T08:44:12.478 INFO:teuthology.orchestra.run.smithi155.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T08:44:12.478 INFO:teuthology.orchestra.run.smithi155.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T08:44:12.478 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T08:44:12.478 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-argparse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 45 k 2024-09-10T08:44:12.478 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-common x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 136 k 2024-09-10T08:44:12.478 INFO:teuthology.orchestra.run.smithi155.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T08:44:12.478 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T08:44:12.478 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T08:44:12.478 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T08:44:12.478 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-10T08:44:12.478 INFO:teuthology.orchestra.run.smithi155.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-10T08:44:12.478 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T08:44:12.478 INFO:teuthology.orchestra.run.smithi155.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T08:44:12.479 INFO:teuthology.orchestra.run.smithi155.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T08:44:12.479 INFO:teuthology.orchestra.run.smithi155.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T08:44:12.479 INFO:teuthology.orchestra.run.smithi155.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T08:44:12.479 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T08:44:12.479 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T08:44:12.479 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T08:44:12.479 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T08:44:12.479 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T08:44:12.479 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T08:44:12.479 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T08:44:12.479 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T08:44:12.479 INFO:teuthology.orchestra.run.smithi155.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T08:44:12.479 INFO:teuthology.orchestra.run.smithi155.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T08:44:12.479 INFO:teuthology.orchestra.run.smithi155.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T08:44:12.480 INFO:teuthology.orchestra.run.smithi155.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T08:44:12.480 INFO:teuthology.orchestra.run.smithi155.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T08:44:12.480 INFO:teuthology.orchestra.run.smithi155.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T08:44:12.480 INFO:teuthology.orchestra.run.smithi155.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T08:44:12.480 INFO:teuthology.orchestra.run.smithi155.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T08:44:12.480 INFO:teuthology.orchestra.run.smithi155.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T08:44:12.480 INFO:teuthology.orchestra.run.smithi155.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T08:44:12.480 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T08:44:12.480 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T08:44:12.480 INFO:teuthology.orchestra.run.smithi155.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T08:44:12.480 INFO:teuthology.orchestra.run.smithi155.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T08:44:12.481 INFO:teuthology.orchestra.run.smithi155.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T08:44:12.481 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T08:44:12.481 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T08:44:12.481 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T08:44:12.481 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T08:44:12.481 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-10T08:44:12.481 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T08:44:12.481 INFO:teuthology.orchestra.run.smithi155.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T08:44:12.481 INFO:teuthology.orchestra.run.smithi155.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T08:44:12.481 INFO:teuthology.orchestra.run.smithi155.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T08:44:12.481 INFO:teuthology.orchestra.run.smithi155.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T08:44:12.481 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T08:44:12.481 INFO:teuthology.orchestra.run.smithi155.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T08:44:12.482 INFO:teuthology.orchestra.run.smithi155.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T08:44:12.482 INFO:teuthology.orchestra.run.smithi155.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T08:44:12.482 INFO:teuthology.orchestra.run.smithi155.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T08:44:12.482 INFO:teuthology.orchestra.run.smithi155.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T08:44:12.482 INFO:teuthology.orchestra.run.smithi155.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-10T08:44:12.482 INFO:teuthology.orchestra.run.smithi155.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T08:44:12.482 INFO:teuthology.orchestra.run.smithi155.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T08:44:12.482 INFO:teuthology.orchestra.run.smithi155.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T08:44:12.482 INFO:teuthology.orchestra.run.smithi155.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T08:44:12.482 INFO:teuthology.orchestra.run.smithi155.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T08:44:12.482 INFO:teuthology.orchestra.run.smithi155.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T08:44:12.482 INFO:teuthology.orchestra.run.smithi155.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T08:44:12.482 INFO:teuthology.orchestra.run.smithi155.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T08:44:12.483 INFO:teuthology.orchestra.run.smithi155.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T08:44:12.483 INFO:teuthology.orchestra.run.smithi155.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-10T08:44:12.483 INFO:teuthology.orchestra.run.smithi155.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T08:44:12.483 INFO:teuthology.orchestra.run.smithi155.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-10T08:44:12.483 INFO:teuthology.orchestra.run.smithi155.stdout:Installing weak dependencies: 2024-09-10T08:44:12.483 INFO:teuthology.orchestra.run.smithi155.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T08:44:12.483 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-10T08:44:12.483 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2024-09-10T08:44:12.483 INFO:teuthology.orchestra.run.smithi155.stdout:====================================================================================== 2024-09-10T08:44:12.483 INFO:teuthology.orchestra.run.smithi155.stdout:Install 148 Packages 2024-09-10T08:44:12.483 INFO:teuthology.orchestra.run.smithi155.stdout:Upgrade 8 Packages 2024-09-10T08:44:12.483 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-10T08:44:12.484 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 226 M 2024-09-10T08:44:12.484 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2024-09-10T08:44:12.583 INFO:teuthology.orchestra.run.smithi002.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T08:44:12.584 INFO:teuthology.orchestra.run.smithi002.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-10T08:44:12.597 INFO:teuthology.orchestra.run.smithi002.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-10T08:44:12.598 INFO:teuthology.orchestra.run.smithi002.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-10T08:44:12.599 INFO:teuthology.orchestra.run.smithi002.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-10T08:44:12.600 INFO:teuthology.orchestra.run.smithi002.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-10T08:44:12.601 INFO:teuthology.orchestra.run.smithi002.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-10T08:44:12.604 INFO:teuthology.orchestra.run.smithi002.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-10T08:44:12.605 INFO:teuthology.orchestra.run.smithi002.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-10T08:44:12.676 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-10T08:44:12.692 INFO:teuthology.orchestra.run.smithi002.stdout:====================================================================================== 2024-09-10T08:44:12.693 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2024-09-10T08:44:12.693 INFO:teuthology.orchestra.run.smithi002.stdout:====================================================================================== 2024-09-10T08:44:12.693 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-10T08:44:12.693 INFO:teuthology.orchestra.run.smithi002.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-10T08:44:12.693 INFO:teuthology.orchestra.run.smithi002.stdout: ceph x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 6.5 k 2024-09-10T08:44:12.693 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-base x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 5.4 M 2024-09-10T08:44:12.693 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-fuse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 897 k 2024-09-10T08:44:12.693 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 145 k 2024-09-10T08:44:12.693 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 1.5 M 2024-09-10T08:44:12.693 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-cephadm noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 146 k 2024-09-10T08:44:12.693 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-dashboard noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 3.6 M 2024-09-10T08:44:12.694 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 7.4 M 2024-09-10T08:44:12.694 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-rook noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 49 k 2024-09-10T08:44:12.694 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-radosgw x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 11 M 2024-09-10T08:44:12.694 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-test x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 49 M 2024-09-10T08:44:12.694 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-volume noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 285 k 2024-09-10T08:44:12.694 INFO:teuthology.orchestra.run.smithi002.stdout: cephadm noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 766 k 2024-09-10T08:44:12.694 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-mirror x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 228 k 2024-09-10T08:44:12.694 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-shell x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 27 k 2024-09-10T08:44:12.694 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-top noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 18 k 2024-09-10T08:44:12.694 INFO:teuthology.orchestra.run.smithi002.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-10T08:44:12.694 INFO:teuthology.orchestra.run.smithi002.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-10T08:44:12.694 INFO:teuthology.orchestra.run.smithi002.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-10T08:44:12.694 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs-devel x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 32 k 2024-09-10T08:44:12.695 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 751 k 2024-09-10T08:44:12.695 INFO:teuthology.orchestra.run.smithi002.stdout: librados-devel x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 127 k 2024-09-10T08:44:12.695 INFO:teuthology.orchestra.run.smithi002.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-10T08:44:12.695 INFO:teuthology.orchestra.run.smithi002.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-10T08:44:12.695 INFO:teuthology.orchestra.run.smithi002.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-10T08:44:12.695 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-10T08:44:12.695 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-10T08:44:12.695 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-10T08:44:12.695 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cephfs x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 161 k 2024-09-10T08:44:12.695 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rados x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 320 k 2024-09-10T08:44:12.695 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rbd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 301 k 2024-09-10T08:44:12.695 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rgw x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 99 k 2024-09-10T08:44:12.695 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-fuse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 85 k 2024-09-10T08:44:12.695 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-mirror x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.1 M 2024-09-10T08:44:12.696 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-nbd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 170 k 2024-09-10T08:44:12.696 INFO:teuthology.orchestra.run.smithi002.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-10T08:44:12.696 INFO:teuthology.orchestra.run.smithi002.stdout:Upgrading: 2024-09-10T08:44:12.696 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-10T08:44:12.696 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-10T08:44:12.696 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-10T08:44:12.696 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-10T08:44:12.696 INFO:teuthology.orchestra.run.smithi002.stdout: librados2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.4 M 2024-09-10T08:44:12.696 INFO:teuthology.orchestra.run.smithi002.stdout: librbd1 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 3.2 M 2024-09-10T08:44:12.696 INFO:teuthology.orchestra.run.smithi002.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-10T08:44:12.696 INFO:teuthology.orchestra.run.smithi002.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-10T08:44:12.696 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2024-09-10T08:44:12.696 INFO:teuthology.orchestra.run.smithi002.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-10T08:44:12.697 INFO:teuthology.orchestra.run.smithi002.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-10T08:44:12.697 INFO:teuthology.orchestra.run.smithi002.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-10T08:44:12.697 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-common x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 21 M 2024-09-10T08:44:12.697 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-grafana-dashboards noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 32 k 2024-09-10T08:44:12.697 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mds x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 2.4 M 2024-09-10T08:44:12.697 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-modules-core noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 249 k 2024-09-10T08:44:12.697 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mon x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 4.7 M 2024-09-10T08:44:12.697 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-osd x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 17 M 2024-09-10T08:44:12.697 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-prometheus-alerts noarch 2:19.1.1-305.g1cf819b7.el9 ceph-noarch 16 k 2024-09-10T08:44:12.697 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-selinux x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 25 k 2024-09-10T08:44:12.697 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-10T08:44:12.697 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-10T08:44:12.697 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-10T08:44:12.698 INFO:teuthology.orchestra.run.smithi002.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-10T08:44:12.698 INFO:teuthology.orchestra.run.smithi002.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-10T08:44:12.698 INFO:teuthology.orchestra.run.smithi002.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-10T08:44:12.698 INFO:teuthology.orchestra.run.smithi002.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-10T08:44:12.698 INFO:teuthology.orchestra.run.smithi002.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-10T08:44:12.698 INFO:teuthology.orchestra.run.smithi002.stdout: libcephsqlite x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 164 k 2024-09-10T08:44:12.698 INFO:teuthology.orchestra.run.smithi002.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-10T08:44:12.698 INFO:teuthology.orchestra.run.smithi002.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-10T08:44:12.698 INFO:teuthology.orchestra.run.smithi002.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-10T08:44:12.698 INFO:teuthology.orchestra.run.smithi002.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-10T08:44:12.698 INFO:teuthology.orchestra.run.smithi002.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-10T08:44:12.698 INFO:teuthology.orchestra.run.smithi002.stdout: libradosstriper1 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 506 k 2024-09-10T08:44:12.698 INFO:teuthology.orchestra.run.smithi002.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-10T08:44:12.699 INFO:teuthology.orchestra.run.smithi002.stdout: librgw2 x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 5.3 M 2024-09-10T08:44:12.699 INFO:teuthology.orchestra.run.smithi002.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-10T08:44:12.699 INFO:teuthology.orchestra.run.smithi002.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-10T08:44:12.699 INFO:teuthology.orchestra.run.smithi002.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-10T08:44:12.699 INFO:teuthology.orchestra.run.smithi002.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-10T08:44:12.699 INFO:teuthology.orchestra.run.smithi002.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-10T08:44:12.699 INFO:teuthology.orchestra.run.smithi002.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-10T08:44:12.699 INFO:teuthology.orchestra.run.smithi002.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-10T08:44:12.699 INFO:teuthology.orchestra.run.smithi002.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-10T08:44:12.699 INFO:teuthology.orchestra.run.smithi002.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-10T08:44:12.699 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-10T08:44:12.699 INFO:teuthology.orchestra.run.smithi002.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-10T08:44:12.699 INFO:teuthology.orchestra.run.smithi002.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-10T08:44:12.699 INFO:teuthology.orchestra.run.smithi002.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-10T08:44:12.700 INFO:teuthology.orchestra.run.smithi002.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-10T08:44:12.700 INFO:teuthology.orchestra.run.smithi002.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-10T08:44:12.700 INFO:teuthology.orchestra.run.smithi002.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-10T08:44:12.700 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-10T08:44:12.700 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-argparse x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 45 k 2024-09-10T08:44:12.700 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-common x86_64 2:19.1.1-305.g1cf819b7.el9 ceph 136 k 2024-09-10T08:44:12.700 INFO:teuthology.orchestra.run.smithi002.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-10T08:44:12.700 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-10T08:44:12.700 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-10T08:44:12.700 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-10T08:44:12.700 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-10T08:44:12.700 INFO:teuthology.orchestra.run.smithi002.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-10T08:44:12.701 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-10T08:44:12.701 INFO:teuthology.orchestra.run.smithi002.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-10T08:44:12.701 INFO:teuthology.orchestra.run.smithi002.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-10T08:44:12.701 INFO:teuthology.orchestra.run.smithi002.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-10T08:44:12.701 INFO:teuthology.orchestra.run.smithi002.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-10T08:44:12.701 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-10T08:44:12.701 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-10T08:44:12.701 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-10T08:44:12.701 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-10T08:44:12.701 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-10T08:44:12.701 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-10T08:44:12.701 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-10T08:44:12.701 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-10T08:44:12.701 INFO:teuthology.orchestra.run.smithi002.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-10T08:44:12.702 INFO:teuthology.orchestra.run.smithi002.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-10T08:44:12.702 INFO:teuthology.orchestra.run.smithi002.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-10T08:44:12.702 INFO:teuthology.orchestra.run.smithi002.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-10T08:44:12.702 INFO:teuthology.orchestra.run.smithi002.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-10T08:44:12.702 INFO:teuthology.orchestra.run.smithi002.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-10T08:44:12.702 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-10T08:44:12.702 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-10T08:44:12.702 INFO:teuthology.orchestra.run.smithi002.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-10T08:44:12.702 INFO:teuthology.orchestra.run.smithi002.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-10T08:44:12.702 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-10T08:44:12.702 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-10T08:44:12.702 INFO:teuthology.orchestra.run.smithi002.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-10T08:44:12.702 INFO:teuthology.orchestra.run.smithi002.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-10T08:44:12.703 INFO:teuthology.orchestra.run.smithi002.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-10T08:44:12.703 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-10T08:44:12.703 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-10T08:44:12.703 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-10T08:44:12.703 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-10T08:44:12.703 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-10T08:44:12.703 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-10T08:44:12.703 INFO:teuthology.orchestra.run.smithi002.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-10T08:44:12.703 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-10T08:44:12.703 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-10T08:44:12.703 INFO:teuthology.orchestra.run.smithi002.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-10T08:44:12.703 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-10T08:44:12.703 INFO:teuthology.orchestra.run.smithi002.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-10T08:44:12.703 INFO:teuthology.orchestra.run.smithi002.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-10T08:44:12.704 INFO:teuthology.orchestra.run.smithi002.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-10T08:44:12.704 INFO:teuthology.orchestra.run.smithi002.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-10T08:44:12.704 INFO:teuthology.orchestra.run.smithi002.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-10T08:44:12.704 INFO:teuthology.orchestra.run.smithi002.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-10T08:44:12.704 INFO:teuthology.orchestra.run.smithi002.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-10T08:44:12.704 INFO:teuthology.orchestra.run.smithi002.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-10T08:44:12.704 INFO:teuthology.orchestra.run.smithi002.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-10T08:44:12.704 INFO:teuthology.orchestra.run.smithi002.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-10T08:44:12.704 INFO:teuthology.orchestra.run.smithi002.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-10T08:44:12.704 INFO:teuthology.orchestra.run.smithi002.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-10T08:44:12.704 INFO:teuthology.orchestra.run.smithi002.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-10T08:44:12.704 INFO:teuthology.orchestra.run.smithi002.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-10T08:44:12.704 INFO:teuthology.orchestra.run.smithi002.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-10T08:44:12.704 INFO:teuthology.orchestra.run.smithi002.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-10T08:44:12.705 INFO:teuthology.orchestra.run.smithi002.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-10T08:44:12.705 INFO:teuthology.orchestra.run.smithi002.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-10T08:44:12.705 INFO:teuthology.orchestra.run.smithi002.stdout:Installing weak dependencies: 2024-09-10T08:44:12.705 INFO:teuthology.orchestra.run.smithi002.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-10T08:44:12.705 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:44:12.705 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-10T08:44:12.705 INFO:teuthology.orchestra.run.smithi002.stdout:====================================================================================== 2024-09-10T08:44:12.705 INFO:teuthology.orchestra.run.smithi002.stdout:Install 148 Packages 2024-09-10T08:44:12.705 INFO:teuthology.orchestra.run.smithi002.stdout:Upgrade 8 Packages 2024-09-10T08:44:12.705 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:44:12.706 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 226 M 2024-09-10T08:44:12.706 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-10T08:44:13.221 INFO:teuthology.orchestra.run.smithi002.stdout:(1/156): ceph-19.1.1-305.g1cf819b7.el9.x86_64.r 48 kB/s | 6.5 kB 00:00 2024-09-10T08:44:13.331 INFO:teuthology.orchestra.run.smithi155.stdout:(1/156): ceph-19.1.1-305.g1cf819b7.el9.x86_64.r 43 kB/s | 6.5 kB 00:00 2024-09-10T08:44:13.413 INFO:teuthology.orchestra.run.smithi002.stdout:(2/156): ceph-fuse-19.1.1-305.g1cf819b7.el9.x86 4.6 MB/s | 897 kB 00:00 2024-09-10T08:44:13.514 INFO:teuthology.orchestra.run.smithi002.stdout:(3/156): ceph-immutable-object-cache-19.1.1-305 1.4 MB/s | 145 kB 00:00 2024-09-10T08:44:13.825 INFO:teuthology.orchestra.run.smithi002.stdout:(4/156): ceph-mds-19.1.1-305.g1cf819b7.el9.x86_ 7.7 MB/s | 2.4 MB 00:00 2024-09-10T08:44:13.964 INFO:teuthology.orchestra.run.smithi155.stdout:(2/156): ceph-fuse-19.1.1-305.g1cf819b7.el9.x86 1.4 MB/s | 897 kB 00:00 2024-09-10T08:44:14.031 INFO:teuthology.orchestra.run.smithi155.stdout:(3/156): ceph-immutable-object-cache-19.1.1-305 2.1 MB/s | 145 kB 00:00 2024-09-10T08:44:14.098 INFO:teuthology.orchestra.run.smithi002.stdout:(5/156): ceph-common-19.1.1-305.g1cf819b7.el9.x 21 MB/s | 21 MB 00:01 2024-09-10T08:44:14.181 INFO:teuthology.orchestra.run.smithi002.stdout:(6/156): ceph-base-19.1.1-305.g1cf819b7.el9.x86 4.9 MB/s | 5.4 MB 00:01 2024-09-10T08:44:14.223 INFO:teuthology.orchestra.run.smithi002.stdout:(7/156): ceph-mgr-19.1.1-305.g1cf819b7.el9.x86_ 3.8 MB/s | 1.5 MB 00:00 2024-09-10T08:44:14.373 INFO:teuthology.orchestra.run.smithi002.stdout:(8/156): ceph-mon-19.1.1-305.g1cf819b7.el9.x86_ 17 MB/s | 4.7 MB 00:00 2024-09-10T08:44:14.440 INFO:teuthology.orchestra.run.smithi002.stdout:(9/156): ceph-selinux-19.1.1-305.g1cf819b7.el9. 379 kB/s | 25 kB 00:00 2024-09-10T08:44:14.448 INFO:teuthology.orchestra.run.smithi155.stdout:(4/156): ceph-base-19.1.1-305.g1cf819b7.el9.x86 4.3 MB/s | 5.4 MB 00:01 2024-09-10T08:44:14.940 INFO:teuthology.orchestra.run.smithi155.stdout:(5/156): ceph-mds-19.1.1-305.g1cf819b7.el9.x86_ 2.6 MB/s | 2.4 MB 00:00 2024-09-10T08:44:15.149 INFO:teuthology.orchestra.run.smithi155.stdout:(6/156): ceph-mgr-19.1.1-305.g1cf819b7.el9.x86_ 2.2 MB/s | 1.5 MB 00:00 2024-09-10T08:44:15.216 INFO:teuthology.orchestra.run.smithi002.stdout:(10/156): ceph-osd-19.1.1-305.g1cf819b7.el9.x86 16 MB/s | 17 MB 00:01 2024-09-10T08:44:15.365 INFO:teuthology.orchestra.run.smithi002.stdout:(11/156): ceph-radosgw-19.1.1-305.g1cf819b7.el9 9.3 MB/s | 11 MB 00:01 2024-09-10T08:44:15.391 INFO:teuthology.orchestra.run.smithi002.stdout:(12/156): cephfs-mirror-19.1.1-305.g1cf819b7.el 1.3 MB/s | 228 kB 00:00 2024-09-10T08:44:15.416 INFO:teuthology.orchestra.run.smithi002.stdout:(13/156): cephfs-shell-19.1.1-305.g1cf819b7.el9 541 kB/s | 27 kB 00:00 2024-09-10T08:44:15.441 INFO:teuthology.orchestra.run.smithi002.stdout:(14/156): libcephfs-devel-19.1.1-305.g1cf819b7. 632 kB/s | 32 kB 00:00 2024-09-10T08:44:15.492 INFO:teuthology.orchestra.run.smithi002.stdout:(15/156): libcephfs2-19.1.1-305.g1cf819b7.el9.x 9.7 MB/s | 751 kB 00:00 2024-09-10T08:44:15.517 INFO:teuthology.orchestra.run.smithi002.stdout:(16/156): libcephsqlite-19.1.1-305.g1cf819b7.el 2.1 MB/s | 164 kB 00:00 2024-09-10T08:44:15.550 INFO:teuthology.orchestra.run.smithi002.stdout:(17/156): librados-devel-19.1.1-305.g1cf819b7.e 2.1 MB/s | 127 kB 00:00 2024-09-10T08:44:15.584 INFO:teuthology.orchestra.run.smithi002.stdout:(18/156): libradosstriper1-19.1.1-305.g1cf819b7 7.4 MB/s | 506 kB 00:00 2024-09-10T08:44:15.643 INFO:teuthology.orchestra.run.smithi002.stdout:(19/156): python3-ceph-argparse-19.1.1-305.g1cf 776 kB/s | 45 kB 00:00 2024-09-10T08:44:15.718 INFO:teuthology.orchestra.run.smithi002.stdout:(20/156): python3-ceph-common-19.1.1-305.g1cf81 1.8 MB/s | 136 kB 00:00 2024-09-10T08:44:15.785 INFO:teuthology.orchestra.run.smithi002.stdout:(21/156): python3-cephfs-19.1.1-305.g1cf819b7.e 2.4 MB/s | 161 kB 00:00 2024-09-10T08:44:15.868 INFO:teuthology.orchestra.run.smithi002.stdout:(22/156): python3-rados-19.1.1-305.g1cf819b7.el 3.8 MB/s | 320 kB 00:00 2024-09-10T08:44:15.957 INFO:teuthology.orchestra.run.smithi155.stdout:(7/156): ceph-mon-19.1.1-305.g1cf819b7.el9.x86_ 4.6 MB/s | 4.7 MB 00:01 2024-09-10T08:44:15.977 INFO:teuthology.orchestra.run.smithi002.stdout:(23/156): librgw2-19.1.1-305.g1cf819b7.el9.x86_ 13 MB/s | 5.3 MB 00:00 2024-09-10T08:44:16.006 INFO:teuthology.orchestra.run.smithi002.stdout:(24/156): python3-rbd-19.1.1-305.g1cf819b7.el9. 2.2 MB/s | 301 kB 00:00 2024-09-10T08:44:16.030 INFO:teuthology.orchestra.run.smithi002.stdout:(25/156): python3-rgw-19.1.1-305.g1cf819b7.el9. 1.9 MB/s | 99 kB 00:00 2024-09-10T08:44:16.063 INFO:teuthology.orchestra.run.smithi002.stdout:(26/156): rbd-fuse-19.1.1-305.g1cf819b7.el9.x86 1.4 MB/s | 85 kB 00:00 2024-09-10T08:44:16.139 INFO:teuthology.orchestra.run.smithi002.stdout:(27/156): rbd-nbd-19.1.1-305.g1cf819b7.el9.x86_ 2.2 MB/s | 170 kB 00:00 2024-09-10T08:44:16.206 INFO:teuthology.orchestra.run.smithi002.stdout:(28/156): ceph-grafana-dashboards-19.1.1-305.g1 477 kB/s | 32 kB 00:00 2024-09-10T08:44:16.273 INFO:teuthology.orchestra.run.smithi002.stdout:(29/156): rbd-mirror-19.1.1-305.g1cf819b7.el9.x 13 MB/s | 3.1 MB 00:00 2024-09-10T08:44:16.298 INFO:teuthology.orchestra.run.smithi002.stdout:(30/156): ceph-mgr-cephadm-19.1.1-305.g1cf819b7 1.6 MB/s | 146 kB 00:00 2024-09-10T08:44:16.607 INFO:teuthology.orchestra.run.smithi002.stdout:(31/156): ceph-mgr-dashboard-19.1.1-305.g1cf819 11 MB/s | 3.6 MB 00:00 2024-09-10T08:44:16.682 INFO:teuthology.orchestra.run.smithi002.stdout:(32/156): ceph-mgr-modules-core-19.1.1-305.g1cf 3.2 MB/s | 249 kB 00:00 2024-09-10T08:44:17.149 INFO:teuthology.orchestra.run.smithi002.stdout:(33/156): ceph-test-19.1.1-305.g1cf819b7.el9.x8 18 MB/s | 49 MB 00:02 2024-09-10T08:44:17.174 INFO:teuthology.orchestra.run.smithi002.stdout:(34/156): ceph-mgr-rook-19.1.1-305.g1cf819b7.el 100 kB/s | 49 kB 00:00 2024-09-10T08:44:17.200 INFO:teuthology.orchestra.run.smithi002.stdout:(35/156): ceph-prometheus-alerts-19.1.1-305.g1c 330 kB/s | 16 kB 00:00 2024-09-10T08:44:17.233 INFO:teuthology.orchestra.run.smithi002.stdout:(36/156): ceph-volume-19.1.1-305.g1cf819b7.el9. 4.8 MB/s | 285 kB 00:00 2024-09-10T08:44:17.350 INFO:teuthology.orchestra.run.smithi002.stdout:(37/156): ceph-mgr-diskprediction-local-19.1.1- 7.0 MB/s | 7.4 MB 00:01 2024-09-10T08:44:17.375 INFO:teuthology.orchestra.run.smithi002.stdout:(38/156): cephfs-top-19.1.1-305.g1cf819b7.el9.n 129 kB/s | 18 kB 00:00 2024-09-10T08:44:17.409 INFO:teuthology.orchestra.run.smithi002.stdout:(39/156): cephadm-19.1.1-305.g1cf819b7.el9.noar 3.6 MB/s | 766 kB 00:00 2024-09-10T08:44:17.459 INFO:teuthology.orchestra.run.smithi002.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 736 kB/s | 80 kB 00:00 2024-09-10T08:44:17.501 INFO:teuthology.orchestra.run.smithi002.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 2.0 MB/s | 191 kB 00:00 2024-09-10T08:44:17.524 INFO:teuthology.orchestra.run.smithi155.stdout:(8/156): ceph-osd-19.1.1-305.g1cf819b7.el9.x86_ 7.1 MB/s | 17 MB 00:02 2024-09-10T08:44:17.543 INFO:teuthology.orchestra.run.smithi002.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2024-09-10T08:44:17.557 INFO:teuthology.orchestra.run.smithi155.stdout:(9/156): ceph-selinux-19.1.1-305.g1cf819b7.el9. 766 kB/s | 25 kB 00:00 2024-09-10T08:44:17.585 INFO:teuthology.orchestra.run.smithi002.stdout:(43/156): libgfortran-11.5.0-2.el9.x86_64.rpm 3.7 MB/s | 801 kB 00:00 2024-09-10T08:44:17.652 INFO:teuthology.orchestra.run.smithi002.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 984 kB/s | 106 kB 00:00 2024-09-10T08:44:17.694 INFO:teuthology.orchestra.run.smithi002.stdout:(45/156): python3-cryptography-36.0.1-4.el9.x86 6.4 MB/s | 1.2 MB 00:00 2024-09-10T08:44:17.719 INFO:teuthology.orchestra.run.smithi002.stdout:(46/156): python3-pycparser-2.20-6.el9.noarch.r 1.0 MB/s | 135 kB 00:00 2024-09-10T08:44:17.761 INFO:teuthology.orchestra.run.smithi002.stdout:(47/156): python3-requests-2.25.1-8.el9.noarch. 1.1 MB/s | 125 kB 00:00 2024-09-10T08:44:17.766 INFO:teuthology.orchestra.run.smithi155.stdout:(10/156): ceph-common-19.1.1-305.g1cf819b7.el9. 4.6 MB/s | 21 MB 00:04 2024-09-10T08:44:17.828 INFO:teuthology.orchestra.run.smithi002.stdout:(48/156): python3-urllib3-1.26.5-6.el9.noarch.r 1.6 MB/s | 215 kB 00:00 2024-09-10T08:44:17.883 INFO:teuthology.orchestra.run.smithi155.stdout:(11/156): ceph-radosgw-19.1.1-305.g1cf819b7.el9 5.5 MB/s | 11 MB 00:01 2024-09-10T08:44:17.908 INFO:teuthology.orchestra.run.smithi155.stdout:(12/156): cephfs-mirror-19.1.1-305.g1cf819b7.el 1.6 MB/s | 228 kB 00:00 2024-09-10T08:44:17.945 INFO:teuthology.orchestra.run.smithi002.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 3.0 MB/s | 689 kB 00:00 2024-09-10T08:44:17.950 INFO:teuthology.orchestra.run.smithi155.stdout:(13/156): cephfs-shell-19.1.1-305.g1cf819b7.el9 405 kB/s | 27 kB 00:00 2024-09-10T08:44:17.971 INFO:teuthology.orchestra.run.smithi002.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 755 kB/s | 107 kB 00:00 2024-09-10T08:44:17.992 INFO:teuthology.orchestra.run.smithi155.stdout:(14/156): libcephfs-devel-19.1.1-305.g1cf819b7. 380 kB/s | 32 kB 00:00 2024-09-10T08:44:17.996 INFO:teuthology.orchestra.run.smithi002.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 433 kB/s | 22 kB 00:00 2024-09-10T08:44:18.038 INFO:teuthology.orchestra.run.smithi002.stdout:(52/156): flexiblas-3.0.4-8.el9.x86_64.rpm 786 kB/s | 33 kB 00:00 2024-09-10T08:44:18.042 INFO:teuthology.orchestra.run.smithi155.stdout:(15/156): libcephsqlite-19.1.1-305.g1cf819b7.el 3.2 MB/s | 164 kB 00:00 2024-09-10T08:44:18.063 INFO:teuthology.orchestra.run.smithi002.stdout:(53/156): flex-2.6.4-9.el9.x86_64.rpm 3.3 MB/s | 313 kB 00:00 2024-09-10T08:44:18.093 INFO:teuthology.orchestra.run.smithi155.stdout:(16/156): libcephfs2-19.1.1-305.g1cf819b7.el9.x 5.2 MB/s | 751 kB 00:00 2024-09-10T08:44:18.105 INFO:teuthology.orchestra.run.smithi002.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 444 kB/s | 18 kB 00:00 2024-09-10T08:44:18.118 INFO:teuthology.orchestra.run.smithi155.stdout:(17/156): librados-devel-19.1.1-305.g1cf819b7.e 1.6 MB/s | 127 kB 00:00 2024-09-10T08:44:18.139 INFO:teuthology.orchestra.run.smithi002.stdout:(55/156): bison-3.7.4-5.el9.x86_64.rpm 2.4 MB/s | 943 kB 00:00 2024-09-10T08:44:18.164 INFO:teuthology.orchestra.run.smithi002.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 190 kB/s | 11 kB 00:00 2024-09-10T08:44:18.185 INFO:teuthology.orchestra.run.smithi155.stdout:(18/156): libradosstriper1-19.1.1-305.g1cf819b7 5.4 MB/s | 506 kB 00:00 2024-09-10T08:44:18.239 INFO:teuthology.orchestra.run.smithi002.stdout:(57/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 15 MB/s | 3.0 MB 00:00 2024-09-10T08:44:18.265 INFO:teuthology.orchestra.run.smithi002.stdout:(58/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.2 MB/s | 160 kB 00:00 2024-09-10T08:44:18.286 INFO:teuthology.orchestra.run.smithi155.stdout:(19/156): python3-ceph-argparse-19.1.1-305.g1cf 449 kB/s | 45 kB 00:00 2024-09-10T08:44:18.290 INFO:teuthology.orchestra.run.smithi002.stdout:(59/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 361 kB/s | 45 kB 00:00 2024-09-10T08:44:18.340 INFO:teuthology.orchestra.run.smithi002.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 6.5 MB/s | 662 kB 00:00 2024-09-10T08:44:18.344 INFO:teuthology.orchestra.run.smithi155.stdout:(20/156): python3-ceph-common-19.1.1-305.g1cf81 2.3 MB/s | 136 kB 00:00 2024-09-10T08:44:18.365 INFO:teuthology.orchestra.run.smithi002.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 328 kB/s | 24 kB 00:00 2024-09-10T08:44:18.391 INFO:teuthology.orchestra.run.smithi002.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 952 kB/s | 47 kB 00:00 2024-09-10T08:44:18.394 INFO:teuthology.orchestra.run.smithi155.stdout:(21/156): python3-cephfs-19.1.1-305.g1cf819b7.e 3.2 MB/s | 161 kB 00:00 2024-09-10T08:44:18.424 INFO:teuthology.orchestra.run.smithi002.stdout:(63/156): libtool-2.4.6-46.el9.x86_64.rpm 4.2 MB/s | 581 kB 00:00 2024-09-10T08:44:18.449 INFO:teuthology.orchestra.run.smithi002.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-09-10T08:44:18.466 INFO:teuthology.orchestra.run.smithi002.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 924 kB/s | 38 kB 00:00 2024-09-10T08:44:18.470 INFO:teuthology.orchestra.run.smithi155.stdout:(22/156): python3-rados-19.1.1-305.g1cf819b7.el 4.2 MB/s | 320 kB 00:00 2024-09-10T08:44:18.492 INFO:teuthology.orchestra.run.smithi002.stdout:(66/156): lua-5.4.4-4.el9.x86_64.rpm 1.8 MB/s | 188 kB 00:00 2024-09-10T08:44:18.537 INFO:teuthology.orchestra.run.smithi155.stdout:(23/156): python3-rbd-19.1.1-305.g1cf819b7.el9. 4.4 MB/s | 301 kB 00:00 2024-09-10T08:44:18.567 INFO:teuthology.orchestra.run.smithi002.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-09-10T08:44:18.587 INFO:teuthology.orchestra.run.smithi155.stdout:(24/156): python3-rgw-19.1.1-305.g1cf819b7.el9. 1.9 MB/s | 99 kB 00:00 2024-09-10T08:44:18.637 INFO:teuthology.orchestra.run.smithi155.stdout:(25/156): rbd-fuse-19.1.1-305.g1cf819b7.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-10T08:44:18.659 INFO:teuthology.orchestra.run.smithi002.stdout:(68/156): openblas-openmp-0.3.26-2.el9.x86_64.r 24 MB/s | 4.9 MB 00:00 2024-09-10T08:44:18.693 INFO:teuthology.orchestra.run.smithi002.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 7.1 MB/s | 910 kB 00:00 2024-09-10T08:44:18.718 INFO:teuthology.orchestra.run.smithi002.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-10T08:44:18.777 INFO:teuthology.orchestra.run.smithi002.stdout:(71/156): protobuf-3.14.0-13.el9.x86_64.rpm 17 MB/s | 1.0 MB 00:00 2024-09-10T08:44:18.813 INFO:teuthology.orchestra.run.smithi155.stdout:(26/156): librgw2-19.1.1-305.g1cf819b7.el9.x86_ 7.7 MB/s | 5.3 MB 00:00 2024-09-10T08:44:18.863 INFO:teuthology.orchestra.run.smithi155.stdout:(27/156): rbd-nbd-19.1.1-305.g1cf819b7.el9.x86_ 3.4 MB/s | 170 kB 00:00 2024-09-10T08:44:18.868 INFO:teuthology.orchestra.run.smithi002.stdout:(72/156): postgresql-server-13.16-1.el9.x86_64. 33 MB/s | 5.8 MB 00:00 2024-09-10T08:44:18.893 INFO:teuthology.orchestra.run.smithi002.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 751 kB/s | 87 kB 00:00 2024-09-10T08:44:18.947 INFO:teuthology.orchestra.run.smithi155.stdout:(28/156): ceph-grafana-dashboards-19.1.1-305.g1 382 kB/s | 32 kB 00:00 2024-09-10T08:44:18.961 INFO:teuthology.orchestra.run.smithi002.stdout:(74/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 9.0 MB/s | 4.4 MB 00:00 2024-09-10T08:44:18.986 INFO:teuthology.orchestra.run.smithi002.stdout:(75/156): python3-colorama-0.4.6-3.el9.noarch.r 666 kB/s | 61 kB 00:00 2024-09-10T08:44:18.997 INFO:teuthology.orchestra.run.smithi155.stdout:(29/156): ceph-mgr-cephadm-19.1.1-305.g1cf819b7 2.9 MB/s | 146 kB 00:00 2024-09-10T08:44:19.020 INFO:teuthology.orchestra.run.smithi002.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 4.1 MB/s | 245 kB 00:00 2024-09-10T08:44:19.045 INFO:teuthology.orchestra.run.smithi002.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.2 MB/s | 248 kB 00:00 2024-09-10T08:44:19.070 INFO:teuthology.orchestra.run.smithi002.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 514 kB/s | 26 kB 00:00 2024-09-10T08:44:19.095 INFO:teuthology.orchestra.run.smithi002.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-09-10T08:44:19.114 INFO:teuthology.orchestra.run.smithi155.stdout:(30/156): rbd-mirror-19.1.1-305.g1cf819b7.el9.x 6.5 MB/s | 3.1 MB 00:00 2024-09-10T08:44:19.129 INFO:teuthology.orchestra.run.smithi002.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-10T08:44:19.154 INFO:teuthology.orchestra.run.smithi002.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 597 kB/s | 35 kB 00:00 2024-09-10T08:44:19.263 INFO:teuthology.orchestra.run.smithi002.stdout:(82/156): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-09-10T08:44:19.330 INFO:teuthology.orchestra.run.smithi002.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.4 MB/s | 250 kB 00:00 2024-09-10T08:44:19.355 INFO:teuthology.orchestra.run.smithi002.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.4 MB/s | 222 kB 00:00 2024-09-10T08:44:19.381 INFO:teuthology.orchestra.run.smithi002.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-10T08:44:19.397 INFO:teuthology.orchestra.run.smithi002.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-09-10T08:44:19.431 INFO:teuthology.orchestra.run.smithi002.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 5.3 MB/s | 269 kB 00:00 2024-09-10T08:44:19.431 INFO:teuthology.orchestra.run.smithi155.stdout:(31/156): ceph-mgr-dashboard-19.1.1-305.g1cf819 8.2 MB/s | 3.6 MB 00:00 2024-09-10T08:44:19.456 INFO:teuthology.orchestra.run.smithi002.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.7 MB/s | 159 kB 00:00 2024-09-10T08:44:19.482 INFO:teuthology.orchestra.run.smithi002.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-10T08:44:19.498 INFO:teuthology.orchestra.run.smithi155.stdout:(32/156): ceph-mgr-modules-core-19.1.1-305.g1cf 3.7 MB/s | 249 kB 00:00 2024-09-10T08:44:19.498 INFO:teuthology.orchestra.run.smithi002.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-10T08:44:19.515 INFO:teuthology.orchestra.run.smithi002.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.6 MB/s | 54 kB 00:00 2024-09-10T08:44:19.548 INFO:teuthology.orchestra.run.smithi155.stdout:(33/156): ceph-mgr-rook-19.1.1-305.g1cf819b7.el 988 kB/s | 49 kB 00:00 2024-09-10T08:44:19.590 INFO:teuthology.orchestra.run.smithi155.stdout:(34/156): ceph-prometheus-alerts-19.1.1-305.g1c 396 kB/s | 16 kB 00:00 2024-09-10T08:44:19.599 INFO:teuthology.orchestra.run.smithi002.stdout:(92/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 11 MB/s | 5.1 MB 00:00 2024-09-10T08:44:19.616 INFO:teuthology.orchestra.run.smithi002.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 417 kB/s | 42 kB 00:00 2024-09-10T08:44:19.633 INFO:teuthology.orchestra.run.smithi002.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.3 MB/s | 44 kB 00:00 2024-09-10T08:44:19.657 INFO:teuthology.orchestra.run.smithi155.stdout:(35/156): ceph-volume-19.1.1-305.g1cf819b7.el9. 4.2 MB/s | 285 kB 00:00 2024-09-10T08:44:19.666 INFO:teuthology.orchestra.run.smithi002.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-10T08:44:19.683 INFO:teuthology.orchestra.run.smithi002.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 713 kB/s | 36 kB 00:00 2024-09-10T08:44:19.700 INFO:teuthology.orchestra.run.smithi002.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2024-09-10T08:44:19.742 INFO:teuthology.orchestra.run.smithi002.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-10T08:44:19.783 INFO:teuthology.orchestra.run.smithi155.stdout:(36/156): cephadm-19.1.1-305.g1cf819b7.el9.noar 6.0 MB/s | 766 kB 00:00 2024-09-10T08:44:19.791 INFO:teuthology.orchestra.run.smithi002.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 639 kB/s | 58 kB 00:00 2024-09-10T08:44:19.818 INFO:teuthology.orchestra.run.smithi002.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.2 MB/s | 96 kB 00:00 2024-09-10T08:44:19.833 INFO:teuthology.orchestra.run.smithi155.stdout:(37/156): cephfs-top-19.1.1-305.g1cf819b7.el9.n 366 kB/s | 18 kB 00:00 2024-09-10T08:44:19.835 INFO:teuthology.orchestra.run.smithi002.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.4 MB/s | 64 kB 00:00 2024-09-10T08:44:19.852 INFO:teuthology.orchestra.run.smithi002.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.3 MB/s | 45 kB 00:00 2024-09-10T08:44:19.910 INFO:teuthology.orchestra.run.smithi002.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 297 kB/s | 22 kB 00:00 2024-09-10T08:44:19.992 INFO:teuthology.orchestra.run.smithi155.stdout:(38/156): ceph-mgr-diskprediction-local-19.1.1- 8.4 MB/s | 7.4 MB 00:00 2024-09-10T08:44:20.017 INFO:teuthology.orchestra.run.smithi155.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 435 kB/s | 80 kB 00:00 2024-09-10T08:44:20.075 INFO:teuthology.orchestra.run.smithi155.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-10T08:44:20.127 INFO:teuthology.orchestra.run.smithi002.stdout:(104/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 26 MB/s | 16 MB 00:00 2024-09-10T08:44:20.134 INFO:teuthology.orchestra.run.smithi155.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.2 MB/s | 253 kB 00:00 2024-09-10T08:44:20.178 INFO:teuthology.orchestra.run.smithi002.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 2.0 MB/s | 548 kB 00:00 2024-09-10T08:44:20.184 INFO:teuthology.orchestra.run.smithi155.stdout:(42/156): libgfortran-11.5.0-2.el9.x86_64.rpm 4.1 MB/s | 801 kB 00:00 2024-09-10T08:44:20.194 INFO:teuthology.orchestra.run.smithi002.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 1.3 MB/s | 19 kB 00:00 2024-09-10T08:44:20.228 INFO:teuthology.orchestra.run.smithi002.stdout:(107/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.2 MB/s | 863 kB 00:00 2024-09-10T08:44:20.243 INFO:teuthology.orchestra.run.smithi155.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-10T08:44:20.295 INFO:teuthology.orchestra.run.smithi002.stdout:(108/156): gperftools-libs-2.9.1-2.el9.x86_64.r 1.8 MB/s | 309 kB 00:00 2024-09-10T08:44:20.318 INFO:teuthology.orchestra.run.smithi155.stdout:(44/156): python3-pycparser-2.20-6.el9.noarch.r 1.8 MB/s | 135 kB 00:00 2024-09-10T08:44:20.328 INFO:teuthology.orchestra.run.smithi002.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.5 MB/s | 49 kB 00:00 2024-09-10T08:44:20.354 INFO:teuthology.orchestra.run.smithi002.stdout:(110/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 207 kB/s | 26 kB 00:00 2024-09-10T08:44:20.361 INFO:teuthology.orchestra.run.smithi155.stdout:(45/156): python3-requests-2.25.1-8.el9.noarch. 2.9 MB/s | 125 kB 00:00 2024-09-10T08:44:20.379 INFO:teuthology.orchestra.run.smithi002.stdout:(111/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-10T08:44:20.413 INFO:teuthology.orchestra.run.smithi002.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-09-10T08:44:20.441 INFO:teuthology.orchestra.run.smithi155.stdout:(46/156): python3-cryptography-36.0.1-4.el9.x86 4.0 MB/s | 1.2 MB 00:00 2024-09-10T08:44:20.470 INFO:teuthology.orchestra.run.smithi155.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 1.9 MB/s | 215 kB 00:00 2024-09-10T08:44:20.472 INFO:teuthology.orchestra.run.smithi002.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.9 MB/s | 839 kB 00:00 2024-09-10T08:44:20.497 INFO:teuthology.orchestra.run.smithi002.stdout:(114/156): python3-asyncssh-2.13.2-5.el9.noarch 6.4 MB/s | 548 kB 00:00 2024-09-10T08:44:20.522 INFO:teuthology.orchestra.run.smithi002.stdout:(115/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 869 kB/s | 43 kB 00:00 2024-09-10T08:44:20.549 INFO:teuthology.orchestra.run.smithi002.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 640 kB/s | 32 kB 00:00 2024-09-10T08:44:20.573 INFO:teuthology.orchestra.run.smithi002.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 280 kB/s | 14 kB 00:00 2024-09-10T08:44:20.606 INFO:teuthology.orchestra.run.smithi002.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-10T08:44:20.620 INFO:teuthology.orchestra.run.smithi155.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 3.8 MB/s | 689 kB 00:00 2024-09-10T08:44:20.640 INFO:teuthology.orchestra.run.smithi002.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 5.3 MB/s | 358 kB 00:00 2024-09-10T08:44:20.670 INFO:teuthology.orchestra.run.smithi155.stdout:(49/156): bison-3.7.4-5.el9.x86_64.rpm 4.6 MB/s | 943 kB 00:00 2024-09-10T08:44:20.673 INFO:teuthology.orchestra.run.smithi002.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.4 MB/s | 303 kB 00:00 2024-09-10T08:44:20.695 INFO:teuthology.orchestra.run.smithi155.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 1.4 MB/s | 107 kB 00:00 2024-09-10T08:44:20.699 INFO:teuthology.orchestra.run.smithi002.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-10T08:44:20.721 INFO:teuthology.orchestra.run.smithi155.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 432 kB/s | 22 kB 00:00 2024-09-10T08:44:20.732 INFO:teuthology.orchestra.run.smithi002.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-10T08:44:20.746 INFO:teuthology.orchestra.run.smithi155.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-09-10T08:44:20.771 INFO:teuthology.orchestra.run.smithi155.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 650 kB/s | 33 kB 00:00 2024-09-10T08:44:20.783 INFO:teuthology.orchestra.run.smithi002.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 214 kB/s | 11 kB 00:00 2024-09-10T08:44:20.813 INFO:teuthology.orchestra.run.smithi155.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 438 kB/s | 18 kB 00:00 2024-09-10T08:44:20.850 INFO:teuthology.orchestra.run.smithi002.stdout:(124/156): libarrow-9.0.0-11.el9.x86_64.rpm 6.7 MB/s | 4.4 MB 00:00 2024-09-10T08:44:20.867 INFO:teuthology.orchestra.run.smithi002.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 211 kB/s | 18 kB 00:00 2024-09-10T08:44:20.880 INFO:teuthology.orchestra.run.smithi155.stdout:(55/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 22 MB/s | 3.0 MB 00:00 2024-09-10T08:44:20.900 INFO:teuthology.orchestra.run.smithi002.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 460 kB/s | 23 kB 00:00 2024-09-10T08:44:20.905 INFO:teuthology.orchestra.run.smithi155.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 121 kB/s | 11 kB 00:00 2024-09-10T08:44:20.917 INFO:teuthology.orchestra.run.smithi002.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 388 kB/s | 19 kB 00:00 2024-09-10T08:44:20.931 INFO:teuthology.orchestra.run.smithi155.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-10T08:44:20.942 INFO:teuthology.orchestra.run.smithi002.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 471 kB/s | 20 kB 00:00 2024-09-10T08:44:20.956 INFO:teuthology.orchestra.run.smithi155.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 907 kB/s | 45 kB 00:00 2024-09-10T08:44:20.968 INFO:teuthology.orchestra.run.smithi002.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-10T08:44:20.990 INFO:teuthology.orchestra.run.smithi155.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-09-10T08:44:21.001 INFO:teuthology.orchestra.run.smithi002.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-10T08:44:21.023 INFO:teuthology.orchestra.run.smithi155.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 8.5 MB/s | 581 kB 00:00 2024-09-10T08:44:21.027 INFO:teuthology.orchestra.run.smithi002.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.2 MB/s | 58 kB 00:00 2024-09-10T08:44:21.040 INFO:teuthology.orchestra.run.smithi155.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 489 kB/s | 24 kB 00:00 2024-09-10T08:44:21.069 INFO:teuthology.orchestra.run.smithi002.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 6.8 MB/s | 1.0 MB 00:00 2024-09-10T08:44:21.074 INFO:teuthology.orchestra.run.smithi155.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 949 kB/s | 47 kB 00:00 2024-09-10T08:44:21.094 INFO:teuthology.orchestra.run.smithi002.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 658 kB/s | 16 kB 00:00 2024-09-10T08:44:21.099 INFO:teuthology.orchestra.run.smithi155.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-09-10T08:44:21.119 INFO:teuthology.orchestra.run.smithi002.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.9 MB/s | 272 kB 00:00 2024-09-10T08:44:21.124 INFO:teuthology.orchestra.run.smithi155.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-09-10T08:44:21.142 INFO:teuthology.orchestra.run.smithi155.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 922 kB/s | 38 kB 00:00 2024-09-10T08:44:21.145 INFO:teuthology.orchestra.run.smithi002.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-09-10T08:44:21.170 INFO:teuthology.orchestra.run.smithi002.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 562 kB/s | 28 kB 00:00 2024-09-10T08:44:21.195 INFO:teuthology.orchestra.run.smithi002.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 614 kB/s | 31 kB 00:00 2024-09-10T08:44:21.274 INFO:teuthology.orchestra.run.smithi002.stdout:(138/156): python3-grpcio-1.46.7-10.el9.x86_64. 3.4 MB/s | 2.0 MB 00:00 2024-09-10T08:44:21.275 INFO:teuthology.orchestra.run.smithi155.stdout:(66/156): openblas-openmp-0.3.26-2.el9.x86_64.r 33 MB/s | 4.9 MB 00:00 2024-09-10T08:44:21.304 INFO:teuthology.orchestra.run.smithi002.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 544 kB/s | 59 kB 00:00 2024-09-10T08:44:21.329 INFO:teuthology.orchestra.run.smithi002.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 652 kB/s | 36 kB 00:00 2024-09-10T08:44:21.350 INFO:teuthology.orchestra.run.smithi155.stdout:(67/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 21 MB/s | 4.4 MB 00:00 2024-09-10T08:44:21.355 INFO:teuthology.orchestra.run.smithi002.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 1.0 MB/s | 188 kB 00:00 2024-09-10T08:44:21.380 INFO:teuthology.orchestra.run.smithi002.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 987 kB/s | 74 kB 00:00 2024-09-10T08:44:21.401 INFO:teuthology.orchestra.run.smithi155.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-09-10T08:44:21.405 INFO:teuthology.orchestra.run.smithi002.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-09-10T08:44:21.430 INFO:teuthology.orchestra.run.smithi002.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 804 kB/s | 20 kB 00:00 2024-09-10T08:44:21.434 INFO:teuthology.orchestra.run.smithi155.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 11 MB/s | 910 kB 00:00 2024-09-10T08:44:21.456 INFO:teuthology.orchestra.run.smithi002.stdout:(145/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-09-10T08:44:21.460 INFO:teuthology.orchestra.run.smithi155.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-10T08:44:21.481 INFO:teuthology.orchestra.run.smithi002.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-10T08:44:21.515 INFO:teuthology.orchestra.run.smithi002.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-09-10T08:44:21.545 INFO:teuthology.orchestra.run.smithi155.stdout:(71/156): protobuf-3.14.0-13.el9.x86_64.rpm 12 MB/s | 1.0 MB 00:00 2024-09-10T08:44:21.590 INFO:teuthology.orchestra.run.smithi002.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-09-10T08:44:21.627 INFO:teuthology.orchestra.run.smithi155.stdout:(72/156): postgresql-server-13.16-1.el9.x86_64. 30 MB/s | 5.8 MB 00:00 2024-09-10T08:44:21.652 INFO:teuthology.orchestra.run.smithi155.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 814 kB/s | 87 kB 00:00 2024-09-10T08:44:21.686 INFO:teuthology.orchestra.run.smithi155.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.8 MB/s | 61 kB 00:00 2024-09-10T08:44:21.778 INFO:teuthology.orchestra.run.smithi155.stdout:(75/156): python3-babel-2.9.1-2.el9.noarch.rpm 40 MB/s | 6.0 MB 00:00 2024-09-10T08:44:21.799 INFO:teuthology.orchestra.run.smithi002.stdout:(149/156): librbd1-19.1.1-305.g1cf819b7.el9.x86 11 MB/s | 3.2 MB 00:00 2024-09-10T08:44:21.803 INFO:teuthology.orchestra.run.smithi155.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.0 MB/s | 245 kB 00:00 2024-09-10T08:44:21.829 INFO:teuthology.orchestra.run.smithi155.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.9 MB/s | 248 kB 00:00 2024-09-10T08:44:21.846 INFO:teuthology.orchestra.run.smithi155.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 613 kB/s | 26 kB 00:00 2024-09-10T08:44:21.857 INFO:teuthology.orchestra.run.smithi002.stdout:(150/156): librados2-19.1.1-305.g1cf819b7.el9.x 9.1 MB/s | 3.4 MB 00:00 2024-09-10T08:44:21.871 INFO:teuthology.orchestra.run.smithi155.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 458 kB/s | 19 kB 00:00 2024-09-10T08:44:21.908 INFO:teuthology.orchestra.run.smithi002.stdout:(151/156): NetworkManager-1.49.90-1.el9.x86_64. 7.3 MB/s | 2.3 MB 00:00 2024-09-10T08:44:21.911 INFO:teuthology.orchestra.run.smithi155.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.6 MB/s | 172 kB 00:00 2024-09-10T08:44:21.941 INFO:teuthology.orchestra.run.smithi002.stdout:(152/156): NetworkManager-team-1.49.90-1.el9.x8 490 kB/s | 41 kB 00:00 2024-09-10T08:44:21.947 INFO:teuthology.orchestra.run.smithi155.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 461 kB/s | 35 kB 00:00 2024-09-10T08:44:21.989 INFO:teuthology.orchestra.run.smithi155.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 5.9 MB/s | 250 kB 00:00 2024-09-10T08:44:21.991 INFO:teuthology.orchestra.run.smithi002.stdout:(153/156): NetworkManager-libnm-1.49.90-1.el9.x 9.4 MB/s | 1.8 MB 00:00 2024-09-10T08:44:22.017 INFO:teuthology.orchestra.run.smithi002.stdout:(154/156): NetworkManager-tui-1.49.90-1.el9.x86 2.2 MB/s | 249 kB 00:00 2024-09-10T08:44:22.081 INFO:teuthology.orchestra.run.smithi155.stdout:(83/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 30 MB/s | 5.1 MB 00:00 2024-09-10T08:44:22.106 INFO:teuthology.orchestra.run.smithi155.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 1.9 MB/s | 222 kB 00:00 2024-09-10T08:44:22.131 INFO:teuthology.orchestra.run.smithi155.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-10T08:44:22.156 INFO:teuthology.orchestra.run.smithi155.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 842 kB/s | 42 kB 00:00 2024-09-10T08:44:22.158 INFO:teuthology.orchestra.run.smithi002.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 14 MB/s | 2.4 MB 00:00 2024-09-10T08:44:22.182 INFO:teuthology.orchestra.run.smithi155.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-09-10T08:44:22.207 INFO:teuthology.orchestra.run.smithi155.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-10T08:44:22.217 INFO:teuthology.orchestra.run.smithi002.stdout:(156/156): openssl-3.2.2-6.el9.x86_64.rpm 4.9 MB/s | 1.4 MB 00:00 2024-09-10T08:44:22.222 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-10T08:44:22.222 INFO:teuthology.orchestra.run.smithi002.stdout:Total 24 MB/s | 226 MB 00:09 2024-09-10T08:44:22.232 INFO:teuthology.orchestra.run.smithi155.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-10T08:44:22.258 INFO:teuthology.orchestra.run.smithi155.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-10T08:44:22.283 INFO:teuthology.orchestra.run.smithi155.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-10T08:44:22.325 INFO:teuthology.orchestra.run.smithi155.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 995 kB/s | 42 kB 00:00 2024-09-10T08:44:22.367 INFO:teuthology.orchestra.run.smithi155.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.0 MB/s | 44 kB 00:00 2024-09-10T08:44:22.409 INFO:teuthology.orchestra.run.smithi155.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 5.2 MB/s | 221 kB 00:00 2024-09-10T08:44:22.451 INFO:teuthology.orchestra.run.smithi155.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 867 kB/s | 36 kB 00:00 2024-09-10T08:44:22.977 INFO:teuthology.orchestra.run.smithi155.stdout:(96/156): ceph-test-19.1.1-305.g1cf819b7.el9.x8 9.0 MB/s | 49 MB 00:05 2024-09-10T08:44:23.001 INFO:teuthology.orchestra.run.smithi155.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 86 kB/s | 47 kB 00:00 2024-09-10T08:44:23.043 INFO:teuthology.orchestra.run.smithi155.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 1.4 MB/s | 58 kB 00:00 2024-09-10T08:44:23.219 INFO:teuthology.orchestra.run.smithi155.stdout:(99/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 17 MB/s | 16 MB 00:00 2024-09-10T08:44:23.244 INFO:teuthology.orchestra.run.smithi155.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 478 kB/s | 96 kB 00:00 2024-09-10T08:44:23.270 INFO:teuthology.orchestra.run.smithi155.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.3 MB/s | 64 kB 00:00 2024-09-10T08:44:23.295 INFO:teuthology.orchestra.run.smithi155.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 898 kB/s | 45 kB 00:00 2024-09-10T08:44:23.320 INFO:teuthology.orchestra.run.smithi155.stdout:(103/156): socat-1.7.4.1-6.el9.x86_64.rpm 887 kB/s | 304 kB 00:00 2024-09-10T08:44:23.395 INFO:teuthology.orchestra.run.smithi155.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 7.1 MB/s | 548 kB 00:00 2024-09-10T08:44:23.421 INFO:teuthology.orchestra.run.smithi155.stdout:(105/156): lua-devel-5.4.4-4.el9.x86_64.rpm 148 kB/s | 22 kB 00:00 2024-09-10T08:44:23.479 INFO:teuthology.orchestra.run.smithi155.stdout:(106/156): gperftools-libs-2.9.1-2.el9.x86_64.r 3.6 MB/s | 309 kB 00:00 2024-09-10T08:44:23.505 INFO:teuthology.orchestra.run.smithi155.stdout:(107/156): grpc-data-1.46.7-10.el9.noarch.rpm 233 kB/s | 19 kB 00:00 2024-09-10T08:44:23.522 INFO:teuthology.orchestra.run.smithi155.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.6 MB/s | 26 kB 00:00 2024-09-10T08:44:23.555 INFO:teuthology.orchestra.run.smithi155.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2024-09-10T08:44:23.589 INFO:teuthology.orchestra.run.smithi155.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-10T08:44:23.622 INFO:teuthology.orchestra.run.smithi155.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 4.5 MB/s | 151 kB 00:00 2024-09-10T08:44:23.714 INFO:teuthology.orchestra.run.smithi155.stdout:(112/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.0 MB/s | 863 kB 00:00 2024-09-10T08:44:23.765 INFO:teuthology.orchestra.run.smithi155.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 5.8 MB/s | 839 kB 00:00 2024-09-10T08:44:23.798 INFO:teuthology.orchestra.run.smithi155.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.4 MB/s | 43 kB 00:00 2024-09-10T08:44:23.824 INFO:teuthology.orchestra.run.smithi155.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-10T08:44:23.849 INFO:teuthology.orchestra.run.smithi155.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 574 kB/s | 14 kB 00:00 2024-09-10T08:44:23.882 INFO:teuthology.orchestra.run.smithi155.stdout:(117/156): python3-asyncssh-2.13.2-5.el9.noarch 3.2 MB/s | 548 kB 00:00 2024-09-10T08:44:23.908 INFO:teuthology.orchestra.run.smithi155.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-10T08:44:23.941 INFO:teuthology.orchestra.run.smithi155.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-10T08:44:23.975 INFO:teuthology.orchestra.run.smithi155.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.4 MB/s | 303 kB 00:00 2024-09-10T08:44:24.000 INFO:teuthology.orchestra.run.smithi155.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-10T08:44:24.084 INFO:teuthology.orchestra.run.smithi155.stdout:(122/156): libarrow-9.0.0-11.el9.x86_64.rpm 7.3 MB/s | 4.4 MB 00:00 2024-09-10T08:44:24.109 INFO:teuthology.orchestra.run.smithi155.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 429 kB/s | 11 kB 00:00 2024-09-10T08:44:24.135 INFO:teuthology.orchestra.run.smithi155.stdout:(124/156): python3-grpcio-tools-1.46.7-10.el9.x 1.1 MB/s | 144 kB 00:00 2024-09-10T08:44:24.160 INFO:teuthology.orchestra.run.smithi155.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-09-10T08:44:24.185 INFO:teuthology.orchestra.run.smithi155.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 464 kB/s | 23 kB 00:00 2024-09-10T08:44:24.211 INFO:teuthology.orchestra.run.smithi155.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 386 kB/s | 19 kB 00:00 2024-09-10T08:44:24.236 INFO:teuthology.orchestra.run.smithi155.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 391 kB/s | 20 kB 00:00 2024-09-10T08:44:24.269 INFO:teuthology.orchestra.run.smithi155.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.4 MB/s | 46 kB 00:00 2024-09-10T08:44:24.302 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-10T08:44:24.303 INFO:teuthology.orchestra.run.smithi155.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-10T08:44:24.328 INFO:teuthology.orchestra.run.smithi155.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-10T08:44:24.379 INFO:teuthology.orchestra.run.smithi155.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 6.1 MB/s | 1.0 MB 00:00 2024-09-10T08:44:24.404 INFO:teuthology.orchestra.run.smithi155.stdout:(133/156): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-09-10T08:44:24.429 INFO:teuthology.orchestra.run.smithi155.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 329 kB/s | 16 kB 00:00 2024-09-10T08:44:24.454 INFO:teuthology.orchestra.run.smithi155.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-09-10T08:44:24.480 INFO:teuthology.orchestra.run.smithi155.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 562 kB/s | 28 kB 00:00 2024-09-10T08:44:24.501 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-10T08:44:24.502 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-10T08:44:24.505 INFO:teuthology.orchestra.run.smithi155.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 1.2 MB/s | 31 kB 00:00 2024-09-10T08:44:24.556 INFO:teuthology.orchestra.run.smithi155.stdout:(138/156): python3-grpcio-1.46.7-10.el9.x86_64. 3.5 MB/s | 2.0 MB 00:00 2024-09-10T08:44:24.581 INFO:teuthology.orchestra.run.smithi155.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-09-10T08:44:24.606 INFO:teuthology.orchestra.run.smithi155.stdout:(140/156): python3-rsa-4.9-2.el9.noarch.rpm 587 kB/s | 59 kB 00:00 2024-09-10T08:44:24.631 INFO:teuthology.orchestra.run.smithi155.stdout:(141/156): python3-tempora-5.0.0-2.el9.noarch.r 474 kB/s | 36 kB 00:00 2024-09-10T08:44:24.657 INFO:teuthology.orchestra.run.smithi155.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 989 kB/s | 74 kB 00:00 2024-09-10T08:44:24.690 INFO:teuthology.orchestra.run.smithi155.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-09-10T08:44:24.715 INFO:teuthology.orchestra.run.smithi155.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-09-10T08:44:24.741 INFO:teuthology.orchestra.run.smithi155.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 399 kB/s | 20 kB 00:00 2024-09-10T08:44:24.799 INFO:teuthology.orchestra.run.smithi155.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 2.2 MB/s | 191 kB 00:00 2024-09-10T08:44:24.828 INFO:teuthology.orchestra.run.smithi155.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 2.4 MB/s | 427 kB 00:00 2024-09-10T08:44:24.904 INFO:teuthology.orchestra.run.smithi155.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 9.7 MB/s | 1.6 MB 00:00 2024-09-10T08:44:25.171 INFO:teuthology.orchestra.run.smithi155.stdout:(149/156): librbd1-19.1.1-305.g1cf819b7.el9.x86 9.2 MB/s | 3.2 MB 00:00 2024-09-10T08:44:25.296 INFO:teuthology.orchestra.run.smithi155.stdout:(150/156): librados2-19.1.1-305.g1cf819b7.el9.x 6.9 MB/s | 3.4 MB 00:00 2024-09-10T08:44:25.363 INFO:teuthology.orchestra.run.smithi155.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 614 kB/s | 41 kB 00:00 2024-09-10T08:44:25.439 INFO:teuthology.orchestra.run.smithi155.stdout:(152/156): NetworkManager-tui-1.49.90-1.el9.x86 3.2 MB/s | 249 kB 00:00 2024-09-10T08:44:25.564 INFO:teuthology.orchestra.run.smithi155.stdout:(153/156): NetworkManager-1.49.90-1.el9.x86_64. 3.5 MB/s | 2.3 MB 00:00 2024-09-10T08:44:25.706 INFO:teuthology.orchestra.run.smithi155.stdout:(154/156): NetworkManager-libnm-1.49.90-1.el9.x 3.4 MB/s | 1.8 MB 00:00 2024-09-10T08:44:25.764 INFO:teuthology.orchestra.run.smithi155.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 4.2 MB/s | 1.4 MB 00:00 2024-09-10T08:44:26.273 INFO:teuthology.orchestra.run.smithi155.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 3.4 MB/s | 2.4 MB 00:00 2024-09-10T08:44:26.279 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2024-09-10T08:44:26.279 INFO:teuthology.orchestra.run.smithi155.stdout:Total 16 MB/s | 226 MB 00:13 2024-09-10T08:44:26.995 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-10T08:44:26.995 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-10T08:44:28.316 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2024-09-10T08:44:28.501 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2024-09-10T08:44:28.501 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2024-09-10T08:44:31.052 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2024-09-10T08:44:31.052 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2024-09-10T08:44:33.822 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-10T08:44:33.981 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-10T08:44:34.186 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-10T08:44:34.349 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-10T08:44:34.392 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-10T08:44:34.423 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-10T08:44:34.481 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-10T08:44:34.887 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-10T08:44:34.990 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T08:44:35.139 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T08:44:35.199 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T08:44:35.314 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T08:44:35.347 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 10/164 2024-09-10T08:44:35.569 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-10T08:44:35.636 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-10T08:44:35.687 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T08:44:35.815 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T08:44:35.846 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 14/164 2024-09-10T08:44:35.933 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 14/164 2024-09-10T08:44:35.964 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-10T08:44:36.006 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-10T08:44:36.240 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-10T08:44:36.425 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-10T08:44:36.604 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-10T08:44:36.761 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T08:44:36.839 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T08:44:37.130 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T08:44:37.289 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-10T08:44:37.404 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-10T08:44:37.462 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-10T08:44:37.507 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-10T08:44:37.558 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2024-09-10T08:44:37.593 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-10T08:44:37.678 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-10T08:44:37.702 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-10T08:44:37.715 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-10T08:44:37.770 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-10T08:44:37.808 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-10T08:44:37.841 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-10T08:44:37.934 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-10T08:44:37.951 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-10T08:44:38.004 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-10T08:44:38.046 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-10T08:44:38.069 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-10T08:44:38.092 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-10T08:44:38.113 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-10T08:44:38.145 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-10T08:44:38.192 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-10T08:44:38.211 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-10T08:44:38.232 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x 34/164 2024-09-10T08:44:38.283 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9 35/164 2024-09-10T08:44:38.313 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 36/164 2024-09-10T08:44:38.409 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-10T08:44:38.474 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-10T08:44:38.574 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-10T08:44:38.577 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-10T08:44:38.670 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T08:44:38.772 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-10T08:44:38.815 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T08:44:38.837 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-10T08:44:38.847 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T08:44:38.951 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T08:44:39.023 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 10/164 2024-09-10T08:44:39.236 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-10T08:44:39.299 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-10T08:44:39.326 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T08:44:39.450 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T08:44:39.477 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 14/164 2024-09-10T08:44:39.525 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-10T08:44:39.551 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 14/164 2024-09-10T08:44:39.579 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-10T08:44:39.619 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-10T08:44:39.690 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-10T08:44:39.730 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-10T08:44:39.774 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-10T08:44:39.813 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 46/164 2024-09-10T08:44:39.847 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-10T08:44:39.866 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-10T08:44:40.028 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-10T08:44:40.068 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-10T08:44:40.157 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-10T08:44:40.224 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-10T08:44:40.228 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-10T08:44:40.314 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-10T08:44:40.358 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-10T08:44:40.371 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T08:44:40.394 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-10T08:44:40.454 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-10T08:44:40.479 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T08:44:40.493 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-10T08:44:40.540 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-10T08:44:40.606 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-10T08:44:40.777 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-10T08:44:40.797 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-10T08:44:40.855 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-10T08:44:40.899 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-10T08:44:40.917 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-10T08:44:41.032 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-10T08:44:41.032 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-10T08:44:41.077 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-10T08:44:41.080 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-10T08:44:41.122 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-10T08:44:41.122 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-10T08:44:41.152 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-10T08:44:41.176 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-10T08:44:41.205 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-10T08:44:41.283 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-10T08:44:41.291 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-10T08:44:41.321 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-10T08:44:41.376 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-10T08:44:41.415 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-10T08:44:41.448 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-10T08:44:41.459 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-10T08:44:41.531 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-10T08:44:41.592 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-10T08:44:41.628 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-10T08:44:41.674 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-10T08:44:41.757 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-10T08:44:41.789 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x 34/164 2024-09-10T08:44:41.833 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9 35/164 2024-09-10T08:44:41.855 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-10T08:44:41.861 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 36/164 2024-09-10T08:44:41.893 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-10T08:44:41.936 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-10T08:44:41.968 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-10T08:44:42.018 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-10T08:44:42.023 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-10T08:44:42.058 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-10T08:44:42.114 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-10T08:44:42.119 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-10T08:44:42.161 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-10T08:44:42.197 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-10T08:44:42.239 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-10T08:44:42.270 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-10T08:44:42.273 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-10T08:44:42.351 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-10T08:44:42.375 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-10T08:44:42.430 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-10T08:44:42.474 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-10T08:44:42.605 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-10T08:44:42.672 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-10T08:44:43.011 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-10T08:44:43.501 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-10T08:44:43.538 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-10T08:44:43.581 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-10T08:44:43.628 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 46/164 2024-09-10T08:44:43.639 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-10T08:44:43.680 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-10T08:44:43.714 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-10T08:44:43.747 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-10T08:44:43.861 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-10T08:44:43.871 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-10T08:44:43.915 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-10T08:44:43.940 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-10T08:44:43.983 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-10T08:44:43.994 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-10T08:44:44.068 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-10T08:44:44.107 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-10T08:44:44.112 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-10T08:44:44.135 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-10T08:44:44.158 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-10T08:44:44.186 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-10T08:44:44.226 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-10T08:44:44.271 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-10T08:44:44.322 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-10T08:44:44.406 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-10T08:44:44.446 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-10T08:44:44.494 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-10T08:44:44.546 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-10T08:44:44.562 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-10T08:44:44.589 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-10T08:44:44.709 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-10T08:44:44.747 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-10T08:44:44.797 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-10T08:44:44.827 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-10T08:44:44.852 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-10T08:44:45.007 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-10T08:44:45.178 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-10T08:44:45.213 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-10T08:44:45.242 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-10T08:44:45.280 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-10T08:44:45.325 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-10T08:44:45.365 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-10T08:44:45.402 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-10T08:44:45.437 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-10T08:44:45.470 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-10T08:44:45.494 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-10T08:44:45.513 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-10T08:44:45.546 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-10T08:44:45.667 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-10T08:44:45.671 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-10T08:44:45.722 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-10T08:44:45.758 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-10T08:44:45.879 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-10T08:44:45.946 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-10T08:44:46.839 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-10T08:44:46.909 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-10T08:44:46.940 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-10T08:44:47.054 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-10T08:44:47.171 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-10T08:44:47.171 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-10T08:44:47.263 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-10T08:44:47.304 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-10T08:44:47.324 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-10T08:44:47.426 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-10T08:44:47.463 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-10T08:44:47.520 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-10T08:44:47.535 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-10T08:44:47.576 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-10T08:44:47.673 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-10T08:44:47.887 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-10T08:44:47.923 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 101/164 2024-09-10T08:44:48.062 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 101/164 2024-09-10T08:44:48.096 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 102/164 2024-09-10T08:44:48.164 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-10T08:44:48.471 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-10T08:44:48.625 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-10T08:44:48.719 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-10T08:44:48.760 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 105/164 2024-09-10T08:44:48.850 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 105/164 2024-09-10T08:44:48.878 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 106/164 2024-09-10T08:44:50.197 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-10T08:44:50.282 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-10T08:44:50.318 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-10T08:44:50.351 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-10T08:44:50.692 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-10T08:44:50.738 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 101/164 2024-09-10T08:44:50.851 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 101/164 2024-09-10T08:44:50.886 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 102/164 2024-09-10T08:44:50.934 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-10T08:44:51.448 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-10T08:44:51.491 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 105/164 2024-09-10T08:44:51.592 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 105/164 2024-09-10T08:44:51.596 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T08:44:51.627 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 106/164 2024-09-10T08:44:51.641 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T08:44:52.305 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T08:44:52.379 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 108/164 2024-09-10T08:44:52.516 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 108/164 2024-09-10T08:44:52.516 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T08:44:52.517 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T08:44:52.517 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:44:52.562 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 109/164 2024-09-10T08:44:54.163 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T08:44:54.208 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T08:44:54.843 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 107/164 2024-09-10T08:44:54.887 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 108/164 2024-09-10T08:44:55.016 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 108/164 2024-09-10T08:44:55.016 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-10T08:44:55.016 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-10T08:44:55.017 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-10T08:44:55.063 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 109/164 2024-09-10T08:45:05.955 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 109/164 2024-09-10T08:45:05.955 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /sys 2024-09-10T08:45:05.956 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /proc 2024-09-10T08:45:05.956 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /mnt 2024-09-10T08:45:05.956 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /var/tmp 2024-09-10T08:45:05.956 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /home 2024-09-10T08:45:05.956 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /root 2024-09-10T08:45:05.956 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /tmp 2024-09-10T08:45:05.956 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:45:06.175 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 110/164 2024-09-10T08:45:06.212 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 110/164 2024-09-10T08:45:06.212 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T08:45:06.213 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T08:45:06.213 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:45:07.746 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 109/164 2024-09-10T08:45:07.746 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /sys 2024-09-10T08:45:07.746 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /proc 2024-09-10T08:45:07.746 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /mnt 2024-09-10T08:45:07.746 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /var/tmp 2024-09-10T08:45:07.746 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /home 2024-09-10T08:45:07.746 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /root 2024-09-10T08:45:07.746 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /tmp 2024-09-10T08:45:07.747 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-10T08:45:07.869 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 111/164 2024-09-10T08:45:07.928 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 111/164 2024-09-10T08:45:07.928 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T08:45:07.929 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T08:45:07.929 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T08:45:07.929 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T08:45:07.929 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:45:07.961 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 110/164 2024-09-10T08:45:07.997 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 110/164 2024-09-10T08:45:07.997 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T08:45:07.997 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-10T08:45:07.997 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-10T08:45:08.187 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 112/164 2024-09-10T08:45:08.238 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 112/164 2024-09-10T08:45:08.238 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T08:45:08.238 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T08:45:08.238 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T08:45:08.238 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T08:45:08.238 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:45:08.745 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 113/164 2024-09-10T08:45:08.796 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 113/164 2024-09-10T08:45:08.796 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T08:45:08.796 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T08:45:08.796 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T08:45:08.796 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T08:45:08.796 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:45:08.946 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-10T08:45:09.007 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-10T08:45:09.081 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-10T08:45:09.337 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-10T08:45:09.412 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-10T08:45:09.507 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-10T08:45:09.581 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 111/164 2024-09-10T08:45:09.617 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-10T08:45:09.639 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 111/164 2024-09-10T08:45:09.640 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T08:45:09.640 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-10T08:45:09.640 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T08:45:09.640 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-10T08:45:09.640 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-10T08:45:09.806 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-10T08:45:09.850 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-10T08:45:09.889 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 112/164 2024-09-10T08:45:09.910 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-10T08:45:09.939 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-10T08:45:09.940 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 112/164 2024-09-10T08:45:09.940 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T08:45:09.940 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-10T08:45:09.940 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T08:45:09.940 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-10T08:45:09.940 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-10T08:45:10.421 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 125/164 2024-09-10T08:45:10.423 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 113/164 2024-09-10T08:45:10.474 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 113/164 2024-09-10T08:45:10.474 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T08:45:10.474 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-10T08:45:10.474 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T08:45:10.474 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-10T08:45:10.474 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-10T08:45:10.530 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 125/164 2024-09-10T08:45:10.564 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el 126/164 2024-09-10T08:45:10.607 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-10T08:45:10.643 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.e 127/164 2024-09-10T08:45:10.666 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-10T08:45:10.686 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 128/164 2024-09-10T08:45:10.733 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-10T08:45:10.968 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-10T08:45:11.036 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-10T08:45:11.122 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-10T08:45:11.230 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-10T08:45:11.414 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-10T08:45:11.462 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-10T08:45:11.501 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-10T08:45:11.535 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-10T08:45:11.990 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 128/164 2024-09-10T08:45:12.075 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 125/164 2024-09-10T08:45:12.118 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 125/164 2024-09-10T08:45:12.154 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 129/164 2024-09-10T08:45:12.159 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el 126/164 2024-09-10T08:45:12.227 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.e 127/164 2024-09-10T08:45:12.257 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 128/164 2024-09-10T08:45:13.310 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 129/164 2024-09-10T08:45:13.354 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 130/164 2024-09-10T08:45:13.483 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 128/164 2024-09-10T08:45:13.501 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 130/164 2024-09-10T08:45:13.526 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 129/164 2024-09-10T08:45:13.685 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9 131/164 2024-09-10T08:45:13.714 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 132/164 2024-09-10T08:45:13.767 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 132/164 2024-09-10T08:45:13.767 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T08:45:13.767 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T08:45:13.767 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T08:45:13.767 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T08:45:13.767 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:45:13.849 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 133/164 2024-09-10T08:45:13.876 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 133/164 2024-09-10T08:45:13.986 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 134/164 2024-09-10T08:45:14.057 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 135/164 2024-09-10T08:45:14.620 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 129/164 2024-09-10T08:45:14.667 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 130/164 2024-09-10T08:45:14.806 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 130/164 2024-09-10T08:45:14.990 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9 131/164 2024-09-10T08:45:15.028 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 132/164 2024-09-10T08:45:15.079 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 132/164 2024-09-10T08:45:15.080 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T08:45:15.080 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-10T08:45:15.080 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T08:45:15.080 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-10T08:45:15.080 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-10T08:45:15.124 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-10T08:45:15.137 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 133/164 2024-09-10T08:45:15.163 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 133/164 2024-09-10T08:45:15.201 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 137/164 2024-09-10T08:45:15.253 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 137/164 2024-09-10T08:45:15.254 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T08:45:15.254 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T08:45:15.254 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T08:45:15.254 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T08:45:15.254 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:45:15.270 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 134/164 2024-09-10T08:45:15.332 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 135/164 2024-09-10T08:45:15.410 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-305.g1cf819 138/164 2024-09-10T08:45:15.461 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-305.g1cf819 138/164 2024-09-10T08:45:15.461 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T08:45:15.461 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T08:45:15.461 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:45:15.519 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 139/164 2024-09-10T08:45:15.571 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 139/164 2024-09-10T08:45:15.571 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T08:45:15.571 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-10T08:45:15.571 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T08:45:15.571 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T08:45:15.571 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:45:15.953 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 140/164 2024-09-10T08:45:16.005 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 140/164 2024-09-10T08:45:16.005 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T08:45:16.005 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T08:45:16.005 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T08:45:16.006 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T08:45:16.006 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:45:16.329 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-10T08:45:16.373 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 137/164 2024-09-10T08:45:16.425 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 137/164 2024-09-10T08:45:16.425 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T08:45:16.425 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-10T08:45:16.425 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T08:45:16.425 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-10T08:45:16.425 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-10T08:45:16.474 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-305.g1cf819 138/164 2024-09-10T08:45:16.523 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-305.g1cf819 138/164 2024-09-10T08:45:16.524 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T08:45:16.524 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-10T08:45:16.524 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-10T08:45:16.574 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 139/164 2024-09-10T08:45:16.625 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 139/164 2024-09-10T08:45:16.626 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T08:45:16.626 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-10T08:45:16.626 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T08:45:16.626 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-10T08:45:16.626 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-10T08:45:16.958 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 140/164 2024-09-10T08:45:17.010 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 140/164 2024-09-10T08:45:17.010 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-10T08:45:17.011 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-10T08:45:17.011 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T08:45:17.011 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-10T08:45:17.011 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-10T08:45:21.275 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 141/164 2024-09-10T08:45:21.343 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 142/164 2024-09-10T08:45:21.387 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 143/164 2024-09-10T08:45:21.423 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-10T08:45:21.459 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-10T08:45:21.706 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 146/164 2024-09-10T08:45:21.764 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-10T08:45:21.818 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_6 148/164 2024-09-10T08:45:21.849 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-10T08:45:21.893 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-10T08:45:21.997 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 141/164 2024-09-10T08:45:22.047 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 142/164 2024-09-10T08:45:22.091 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 143/164 2024-09-10T08:45:22.128 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-10T08:45:22.164 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-10T08:45:22.390 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 146/164 2024-09-10T08:45:22.444 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-10T08:45:22.474 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_6 148/164 2024-09-10T08:45:22.505 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-10T08:45:22.549 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-10T08:45:22.719 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T08:45:22.793 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T08:45:22.836 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T08:45:23.557 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T08:45:23.606 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T08:45:23.648 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-10T08:45:24.224 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 152/164 2024-09-10T08:45:24.346 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-10T08:45:24.400 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-10T08:45:24.509 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-10T08:45:24.540 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-10T08:45:24.565 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-10T08:45:24.602 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-10T08:45:24.602 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-10T08:45:24.717 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-10T08:45:24.718 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-10T08:45:24.851 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-10T08:45:24.876 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-10T08:45:24.893 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T08:45:24.893 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T08:45:24.940 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 152/164 2024-09-10T08:45:25.137 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T08:45:25.137 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-10T08:45:25.246 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-10T08:45:25.296 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-10T08:45:25.297 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-10T08:45:25.373 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T08:45:25.408 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-10T08:45:25.448 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-10T08:45:25.473 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-10T08:45:25.510 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-10T08:45:25.510 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-10T08:45:25.575 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T08:45:25.575 INFO:teuthology.orchestra.run.smithi002.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-10T08:45:25.576 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:45:25.618 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-10T08:45:25.618 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-10T08:45:25.735 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-10T08:45:25.759 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-10T08:45:25.775 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T08:45:25.775 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T08:45:26.020 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-10T08:45:26.021 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-10T08:45:26.163 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-10T08:45:26.236 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T08:45:26.464 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T08:45:26.464 INFO:teuthology.orchestra.run.smithi155.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-10T08:45:26.464 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-10T08:45:31.120 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 1/164 2024-09-10T08:45:31.120 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 2/164 2024-09-10T08:45:31.120 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 3/164 2024-09-10T08:45:31.120 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 4/164 2024-09-10T08:45:31.120 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-305.g1cf819 5/164 2024-09-10T08:45:31.120 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 6/164 2024-09-10T08:45:31.120 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 7/164 2024-09-10T08:45:31.121 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T08:45:31.125 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T08:45:31.125 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 10/164 2024-09-10T08:45:31.125 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 11/164 2024-09-10T08:45:31.125 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 12/164 2024-09-10T08:45:31.125 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T08:45:31.126 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 14/164 2024-09-10T08:45:31.126 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_6 15/164 2024-09-10T08:45:31.126 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 16/164 2024-09-10T08:45:31.126 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 17/164 2024-09-10T08:45:31.126 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 18/164 2024-09-10T08:45:31.126 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 19/164 2024-09-10T08:45:31.126 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 20/164 2024-09-10T08:45:31.126 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9 21/164 2024-09-10T08:45:31.126 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x 22/164 2024-09-10T08:45:31.126 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 23/164 2024-09-10T08:45:31.126 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 24/164 2024-09-10T08:45:31.126 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 25/164 2024-09-10T08:45:31.126 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 26/164 2024-09-10T08:45:31.127 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 27/164 2024-09-10T08:45:31.127 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 28/164 2024-09-10T08:45:31.127 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 29/164 2024-09-10T08:45:31.138 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.e 30/164 2024-09-10T08:45:31.139 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 31/164 2024-09-10T08:45:31.139 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 32/164 2024-09-10T08:45:31.139 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 33/164 2024-09-10T08:45:31.139 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9 34/164 2024-09-10T08:45:31.139 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 35/164 2024-09-10T08:45:31.139 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el 36/164 2024-09-10T08:45:31.139 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 37/164 2024-09-10T08:45:31.139 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 38/164 2024-09-10T08:45:31.139 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 39/164 2024-09-10T08:45:31.139 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-10T08:45:31.139 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-10T08:45:31.139 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-10T08:45:31.140 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-10T08:45:31.140 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-10T08:45:31.140 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-10T08:45:31.140 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-10T08:45:31.140 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-10T08:45:31.140 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-10T08:45:31.140 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-10T08:45:31.140 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-10T08:45:31.140 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-10T08:45:31.140 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-10T08:45:31.140 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-10T08:45:31.140 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-10T08:45:31.141 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-10T08:45:31.141 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-10T08:45:31.141 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-10T08:45:31.141 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-10T08:45:31.141 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-10T08:45:31.141 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-10T08:45:31.141 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-10T08:45:31.141 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-10T08:45:31.141 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-10T08:45:31.141 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-10T08:45:31.141 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-10T08:45:31.141 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-10T08:45:31.141 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-10T08:45:31.142 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-10T08:45:31.142 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-10T08:45:31.142 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-10T08:45:31.142 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-10T08:45:31.142 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-10T08:45:31.142 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-10T08:45:31.142 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-10T08:45:31.142 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-10T08:45:31.142 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-10T08:45:31.142 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-10T08:45:31.142 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-10T08:45:31.142 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-10T08:45:31.143 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-10T08:45:31.143 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-10T08:45:31.143 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-10T08:45:31.143 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-10T08:45:31.143 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-10T08:45:31.143 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-10T08:45:31.143 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-10T08:45:31.143 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-10T08:45:31.143 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-10T08:45:31.143 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-10T08:45:31.143 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-10T08:45:31.143 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-10T08:45:31.143 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-10T08:45:31.144 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-10T08:45:31.144 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-10T08:45:31.144 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-10T08:45:31.144 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-10T08:45:31.144 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-10T08:45:31.144 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-10T08:45:31.144 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-10T08:45:31.144 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-10T08:45:31.144 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-10T08:45:31.144 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-10T08:45:31.144 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-10T08:45:31.144 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-10T08:45:31.144 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-10T08:45:31.145 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-10T08:45:31.145 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-10T08:45:31.145 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-10T08:45:31.145 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-10T08:45:31.145 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-10T08:45:31.145 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-10T08:45:31.145 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-10T08:45:31.145 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-10T08:45:31.145 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-10T08:45:31.145 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-10T08:45:31.145 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-10T08:45:31.145 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-10T08:45:31.145 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-10T08:45:31.146 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-10T08:45:31.146 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-10T08:45:31.146 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-10T08:45:31.146 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-10T08:45:31.146 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-10T08:45:31.146 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-10T08:45:31.146 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-10T08:45:31.146 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-10T08:45:31.146 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-10T08:45:31.146 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-10T08:45:31.146 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-10T08:45:31.146 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-10T08:45:31.146 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-10T08:45:31.146 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-10T08:45:31.147 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-10T08:45:31.147 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-10T08:45:31.147 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-10T08:45:31.147 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-10T08:45:31.147 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-10T08:45:31.147 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-10T08:45:31.147 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-10T08:45:31.147 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-10T08:45:31.147 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-10T08:45:31.147 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-10T08:45:31.147 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-10T08:45:31.147 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-10T08:45:31.147 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-10T08:45:31.148 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-10T08:45:31.148 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-10T08:45:31.148 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-10T08:45:31.148 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 149/164 2024-09-10T08:45:31.148 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-10T08:45:31.148 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 151/164 2024-09-10T08:45:31.148 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-10T08:45:31.148 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-10T08:45:31.148 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-10T08:45:31.148 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-10T08:45:31.148 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-10T08:45:31.148 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-10T08:45:31.148 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-10T08:45:31.148 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-10T08:45:31.149 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-10T08:45:31.149 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-10T08:45:31.149 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-10T08:45:31.149 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-10T08:45:32.359 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 1/164 2024-09-10T08:45:32.359 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 2/164 2024-09-10T08:45:32.359 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 3/164 2024-09-10T08:45:32.359 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 4/164 2024-09-10T08:45:32.360 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-305.g1cf819 5/164 2024-09-10T08:45:32.360 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 6/164 2024-09-10T08:45:32.360 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 7/164 2024-09-10T08:45:32.360 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 8/164 2024-09-10T08:45:32.360 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 9/164 2024-09-10T08:45:32.360 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 10/164 2024-09-10T08:45:32.360 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 11/164 2024-09-10T08:45:32.360 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 12/164 2024-09-10T08:45:32.360 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 13/164 2024-09-10T08:45:32.360 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 14/164 2024-09-10T08:45:32.360 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_6 15/164 2024-09-10T08:45:32.360 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 16/164 2024-09-10T08:45:32.361 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 17/164 2024-09-10T08:45:32.361 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 18/164 2024-09-10T08:45:32.361 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_ 19/164 2024-09-10T08:45:32.361 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 20/164 2024-09-10T08:45:32.361 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9 21/164 2024-09-10T08:45:32.361 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x 22/164 2024-09-10T08:45:32.361 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 23/164 2024-09-10T08:45:32.362 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 24/164 2024-09-10T08:45:32.362 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 25/164 2024-09-10T08:45:32.377 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 26/164 2024-09-10T08:45:32.377 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 27/164 2024-09-10T08:45:32.377 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 28/164 2024-09-10T08:45:32.377 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 29/164 2024-09-10T08:45:32.377 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.e 30/164 2024-09-10T08:45:32.377 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noar 31/164 2024-09-10T08:45:32.377 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.no 32/164 2024-09-10T08:45:32.378 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf8 33/164 2024-09-10T08:45:32.378 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9 34/164 2024-09-10T08:45:32.378 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 35/164 2024-09-10T08:45:32.378 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el 36/164 2024-09-10T08:45:32.378 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 37/164 2024-09-10T08:45:32.378 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 38/164 2024-09-10T08:45:32.378 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 39/164 2024-09-10T08:45:32.378 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-10T08:45:32.378 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-10T08:45:32.378 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-10T08:45:32.378 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-10T08:45:32.378 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-10T08:45:32.378 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-10T08:45:32.379 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-10T08:45:32.379 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-10T08:45:32.379 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-10T08:45:32.379 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-10T08:45:32.379 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-10T08:45:32.379 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-10T08:45:32.379 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-10T08:45:32.379 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-10T08:45:32.379 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-10T08:45:32.379 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-10T08:45:32.379 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-10T08:45:32.379 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-10T08:45:32.379 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-10T08:45:32.379 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-10T08:45:32.380 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-10T08:45:32.380 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-10T08:45:32.380 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-10T08:45:32.380 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-10T08:45:32.380 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-10T08:45:32.380 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-10T08:45:32.380 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-10T08:45:32.380 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-10T08:45:32.380 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-10T08:45:32.380 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-10T08:45:32.380 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-10T08:45:32.380 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-10T08:45:32.380 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-10T08:45:32.381 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-10T08:45:32.381 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-10T08:45:32.381 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-10T08:45:32.381 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-10T08:45:32.381 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-10T08:45:32.381 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-10T08:45:32.381 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-10T08:45:32.381 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-10T08:45:32.381 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-10T08:45:32.381 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-10T08:45:32.381 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-10T08:45:32.381 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-10T08:45:32.381 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-10T08:45:32.382 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-10T08:45:32.382 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-10T08:45:32.382 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-10T08:45:32.382 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-10T08:45:32.382 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-10T08:45:32.382 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-10T08:45:32.382 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-10T08:45:32.382 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-10T08:45:32.382 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-10T08:45:32.382 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-10T08:45:32.382 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-10T08:45:32.382 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-10T08:45:32.382 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-10T08:45:32.382 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-10T08:45:32.383 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-10T08:45:32.383 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-10T08:45:32.383 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-10T08:45:32.383 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-10T08:45:32.383 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-10T08:45:32.383 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-10T08:45:32.383 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-10T08:45:32.383 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-10T08:45:32.383 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-10T08:45:32.383 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-10T08:45:32.383 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-10T08:45:32.383 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-10T08:45:32.383 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-10T08:45:32.383 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-10T08:45:32.384 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-10T08:45:32.384 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-10T08:45:32.384 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-10T08:45:32.384 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-10T08:45:32.384 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-10T08:45:32.384 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-10T08:45:32.384 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-10T08:45:32.384 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-10T08:45:32.384 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-10T08:45:32.384 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-10T08:45:32.384 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-10T08:45:32.384 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-10T08:45:32.384 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-10T08:45:32.385 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-10T08:45:32.385 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-10T08:45:32.385 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-10T08:45:32.385 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-10T08:45:32.385 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-10T08:45:32.385 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-10T08:45:32.385 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-10T08:45:32.385 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-10T08:45:32.385 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-10T08:45:32.385 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-10T08:45:32.385 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-10T08:45:32.385 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-10T08:45:32.385 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-10T08:45:32.385 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-10T08:45:32.386 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-10T08:45:32.386 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-10T08:45:32.386 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-10T08:45:32.386 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-10T08:45:32.386 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-10T08:45:32.386 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-10T08:45:32.386 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-10T08:45:32.386 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-10T08:45:32.386 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 149/164 2024-09-10T08:45:32.386 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-10T08:45:32.386 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 151/164 2024-09-10T08:45:32.386 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-10T08:45:32.386 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-10T08:45:32.386 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-10T08:45:32.387 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-10T08:45:32.387 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-10T08:45:32.387 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-10T08:45:32.387 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-10T08:45:32.387 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-10T08:45:32.387 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-10T08:45:32.387 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-10T08:45:32.387 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-10T08:45:32.387 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-10T08:45:33.439 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T08:45:33.439 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:45:33.439 INFO:teuthology.orchestra.run.smithi002.stdout:Upgraded: 2024-09-10T08:45:33.440 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-10T08:45:33.440 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-10T08:45:33.440 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-10T08:45:33.440 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-10T08:45:33.440 INFO:teuthology.orchestra.run.smithi002.stdout: librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:45:33.440 INFO:teuthology.orchestra.run.smithi002.stdout: librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:45:33.440 INFO:teuthology.orchestra.run.smithi002.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-10T08:45:33.440 INFO:teuthology.orchestra.run.smithi002.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-10T08:45:33.441 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-10T08:45:33.441 INFO:teuthology.orchestra.run.smithi002.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T08:45:33.441 INFO:teuthology.orchestra.run.smithi002.stdout: automake-1.16.2-8.el9.noarch 2024-09-10T08:45:33.441 INFO:teuthology.orchestra.run.smithi002.stdout: bison-3.7.4-5.el9.x86_64 2024-09-10T08:45:33.441 INFO:teuthology.orchestra.run.smithi002.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T08:45:33.441 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:45:33.441 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:45:33.441 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:45:33.441 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:45:33.441 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T08:45:33.441 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-immutable-object-cache-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:45:33.442 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:45:33.442 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:45:33.442 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T08:45:33.442 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T08:45:33.442 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T08:45:33.442 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T08:45:33.442 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T08:45:33.442 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:45:33.442 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:45:33.442 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T08:45:33.442 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:45:33.443 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:45:33.443 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:45:33.443 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T08:45:33.443 INFO:teuthology.orchestra.run.smithi002.stdout: cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T08:45:33.443 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:45:33.443 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:45:33.443 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T08:45:33.443 INFO:teuthology.orchestra.run.smithi002.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-10T08:45:33.443 INFO:teuthology.orchestra.run.smithi002.stdout: flex-2.6.4-9.el9.x86_64 2024-09-10T08:45:33.443 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T08:45:33.443 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T08:45:33.443 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T08:45:33.444 INFO:teuthology.orchestra.run.smithi002.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-10T08:45:33.444 INFO:teuthology.orchestra.run.smithi002.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T08:45:33.444 INFO:teuthology.orchestra.run.smithi002.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T08:45:33.444 INFO:teuthology.orchestra.run.smithi002.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-10T08:45:33.444 INFO:teuthology.orchestra.run.smithi002.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T08:45:33.444 INFO:teuthology.orchestra.run.smithi002.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T08:45:33.444 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:45:33.444 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:45:33.444 INFO:teuthology.orchestra.run.smithi002.stdout: libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:45:33.444 INFO:teuthology.orchestra.run.smithi002.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T08:45:33.445 INFO:teuthology.orchestra.run.smithi002.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T08:45:33.445 INFO:teuthology.orchestra.run.smithi002.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T08:45:33.445 INFO:teuthology.orchestra.run.smithi002.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T08:45:33.445 INFO:teuthology.orchestra.run.smithi002.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T08:45:33.445 INFO:teuthology.orchestra.run.smithi002.stdout: librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:45:33.445 INFO:teuthology.orchestra.run.smithi002.stdout: libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:45:33.445 INFO:teuthology.orchestra.run.smithi002.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T08:45:33.445 INFO:teuthology.orchestra.run.smithi002.stdout: librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:45:33.445 INFO:teuthology.orchestra.run.smithi002.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-10T08:45:33.445 INFO:teuthology.orchestra.run.smithi002.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T08:45:33.446 INFO:teuthology.orchestra.run.smithi002.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-10T08:45:33.446 INFO:teuthology.orchestra.run.smithi002.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-10T08:45:33.446 INFO:teuthology.orchestra.run.smithi002.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T08:45:33.446 INFO:teuthology.orchestra.run.smithi002.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T08:45:33.446 INFO:teuthology.orchestra.run.smithi002.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T08:45:33.446 INFO:teuthology.orchestra.run.smithi002.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T08:45:33.446 INFO:teuthology.orchestra.run.smithi002.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T08:45:33.446 INFO:teuthology.orchestra.run.smithi002.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T08:45:33.446 INFO:teuthology.orchestra.run.smithi002.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-10T08:45:33.446 INFO:teuthology.orchestra.run.smithi002.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T08:45:33.446 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-13.16-1.el9.x86_64 2024-09-10T08:45:33.446 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-10T08:45:33.446 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-10T08:45:33.447 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-10T08:45:33.447 INFO:teuthology.orchestra.run.smithi002.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T08:45:33.447 INFO:teuthology.orchestra.run.smithi002.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T08:45:33.447 INFO:teuthology.orchestra.run.smithi002.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T08:45:33.447 INFO:teuthology.orchestra.run.smithi002.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-10T08:45:33.447 INFO:teuthology.orchestra.run.smithi002.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T08:45:33.447 INFO:teuthology.orchestra.run.smithi002.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T08:45:33.447 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T08:45:33.447 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:45:33.447 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:45:33.447 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:45:33.448 INFO:teuthology.orchestra.run.smithi002.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T08:45:33.448 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T08:45:33.448 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T08:45:33.448 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T08:45:33.448 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-10T08:45:33.448 INFO:teuthology.orchestra.run.smithi002.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-10T08:45:33.448 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T08:45:33.448 INFO:teuthology.orchestra.run.smithi002.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T08:45:33.448 INFO:teuthology.orchestra.run.smithi002.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T08:45:33.448 INFO:teuthology.orchestra.run.smithi002.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T08:45:33.449 INFO:teuthology.orchestra.run.smithi002.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T08:45:33.449 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T08:45:33.449 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T08:45:33.449 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T08:45:33.449 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T08:45:33.449 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T08:45:33.449 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T08:45:33.449 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T08:45:33.449 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T08:45:33.449 INFO:teuthology.orchestra.run.smithi002.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T08:45:33.449 INFO:teuthology.orchestra.run.smithi002.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T08:45:33.450 INFO:teuthology.orchestra.run.smithi002.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T08:45:33.450 INFO:teuthology.orchestra.run.smithi002.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T08:45:33.450 INFO:teuthology.orchestra.run.smithi002.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T08:45:33.450 INFO:teuthology.orchestra.run.smithi002.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T08:45:33.450 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T08:45:33.450 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T08:45:33.450 INFO:teuthology.orchestra.run.smithi002.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T08:45:33.450 INFO:teuthology.orchestra.run.smithi002.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T08:45:33.450 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T08:45:33.451 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T08:45:33.451 INFO:teuthology.orchestra.run.smithi002.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T08:45:33.451 INFO:teuthology.orchestra.run.smithi002.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T08:45:33.451 INFO:teuthology.orchestra.run.smithi002.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T08:45:33.451 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T08:45:33.451 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T08:45:33.451 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T08:45:33.451 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T08:45:33.451 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-10T08:45:33.451 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T08:45:33.451 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:45:33.451 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:45:33.452 INFO:teuthology.orchestra.run.smithi002.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T08:45:33.452 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T08:45:33.452 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T08:45:33.452 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:45:33.452 INFO:teuthology.orchestra.run.smithi002.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T08:45:33.452 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T08:45:33.452 INFO:teuthology.orchestra.run.smithi002.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T08:45:33.452 INFO:teuthology.orchestra.run.smithi002.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T08:45:33.452 INFO:teuthology.orchestra.run.smithi002.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T08:45:33.452 INFO:teuthology.orchestra.run.smithi002.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T08:45:33.453 INFO:teuthology.orchestra.run.smithi002.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T08:45:33.453 INFO:teuthology.orchestra.run.smithi002.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-10T08:45:33.453 INFO:teuthology.orchestra.run.smithi002.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T08:45:33.453 INFO:teuthology.orchestra.run.smithi002.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T08:45:33.453 INFO:teuthology.orchestra.run.smithi002.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T08:45:33.453 INFO:teuthology.orchestra.run.smithi002.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T08:45:33.453 INFO:teuthology.orchestra.run.smithi002.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T08:45:33.454 INFO:teuthology.orchestra.run.smithi002.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T08:45:33.454 INFO:teuthology.orchestra.run.smithi002.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T08:45:33.454 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:45:33.454 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:45:33.454 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:45:33.454 INFO:teuthology.orchestra.run.smithi002.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T08:45:33.454 INFO:teuthology.orchestra.run.smithi002.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T08:45:33.455 INFO:teuthology.orchestra.run.smithi002.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T08:45:33.455 INFO:teuthology.orchestra.run.smithi002.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-10T08:45:33.455 INFO:teuthology.orchestra.run.smithi002.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-10T08:45:33.455 INFO:teuthology.orchestra.run.smithi002.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T08:45:33.455 INFO:teuthology.orchestra.run.smithi002.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-10T08:45:33.456 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:45:33.456 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-10T08:45:34.056 DEBUG:teuthology.parallel:result is None 2024-09-10T08:45:34.606 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-10T08:45:34.606 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-10T08:45:34.606 INFO:teuthology.orchestra.run.smithi155.stdout:Upgraded: 2024-09-10T08:45:34.606 INFO:teuthology.orchestra.run.smithi155.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-10T08:45:34.606 INFO:teuthology.orchestra.run.smithi155.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-10T08:45:34.606 INFO:teuthology.orchestra.run.smithi155.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-10T08:45:34.606 INFO:teuthology.orchestra.run.smithi155.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-10T08:45:34.606 INFO:teuthology.orchestra.run.smithi155.stdout: librados2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:45:34.606 INFO:teuthology.orchestra.run.smithi155.stdout: librbd1-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:45:34.606 INFO:teuthology.orchestra.run.smithi155.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-10T08:45:34.606 INFO:teuthology.orchestra.run.smithi155.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-10T08:45:34.607 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2024-09-10T08:45:34.607 INFO:teuthology.orchestra.run.smithi155.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-10T08:45:34.607 INFO:teuthology.orchestra.run.smithi155.stdout: automake-1.16.2-8.el9.noarch 2024-09-10T08:45:34.607 INFO:teuthology.orchestra.run.smithi155.stdout: bison-3.7.4-5.el9.x86_64 2024-09-10T08:45:34.607 INFO:teuthology.orchestra.run.smithi155.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-10T08:45:34.607 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:45:34.607 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-base-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:45:34.607 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:45:34.607 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:45:34.607 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-grafana-dashboards-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T08:45:34.607 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-immutable-object-cache-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:45:34.607 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mds-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:45:34.607 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:45:34.607 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T08:45:34.608 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-dashboard-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T08:45:34.608 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-diskprediction-local-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T08:45:34.608 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-modules-core-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T08:45:34.608 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-rook-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T08:45:34.608 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mon-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:45:34.608 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-osd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:45:34.608 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-prometheus-alerts-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T08:45:34.608 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-radosgw-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:45:34.608 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-selinux-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:45:34.608 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-test-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:45:34.608 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-volume-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T08:45:34.608 INFO:teuthology.orchestra.run.smithi155.stdout: cephadm-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T08:45:34.608 INFO:teuthology.orchestra.run.smithi155.stdout: cephfs-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:45:34.609 INFO:teuthology.orchestra.run.smithi155.stdout: cephfs-shell-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:45:34.609 INFO:teuthology.orchestra.run.smithi155.stdout: cephfs-top-2:19.1.1-305.g1cf819b7.el9.noarch 2024-09-10T08:45:34.609 INFO:teuthology.orchestra.run.smithi155.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-10T08:45:34.609 INFO:teuthology.orchestra.run.smithi155.stdout: flex-2.6.4-9.el9.x86_64 2024-09-10T08:45:34.609 INFO:teuthology.orchestra.run.smithi155.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-10T08:45:34.609 INFO:teuthology.orchestra.run.smithi155.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-10T08:45:34.609 INFO:teuthology.orchestra.run.smithi155.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-10T08:45:34.609 INFO:teuthology.orchestra.run.smithi155.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-10T08:45:34.609 INFO:teuthology.orchestra.run.smithi155.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-10T08:45:34.609 INFO:teuthology.orchestra.run.smithi155.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-10T08:45:34.609 INFO:teuthology.orchestra.run.smithi155.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-10T08:45:34.609 INFO:teuthology.orchestra.run.smithi155.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-10T08:45:34.609 INFO:teuthology.orchestra.run.smithi155.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-10T08:45:34.610 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:45:34.610 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:45:34.610 INFO:teuthology.orchestra.run.smithi155.stdout: libcephsqlite-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:45:34.610 INFO:teuthology.orchestra.run.smithi155.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-10T08:45:34.610 INFO:teuthology.orchestra.run.smithi155.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-10T08:45:34.610 INFO:teuthology.orchestra.run.smithi155.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-10T08:45:34.610 INFO:teuthology.orchestra.run.smithi155.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-10T08:45:34.610 INFO:teuthology.orchestra.run.smithi155.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-10T08:45:34.610 INFO:teuthology.orchestra.run.smithi155.stdout: librados-devel-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:45:34.610 INFO:teuthology.orchestra.run.smithi155.stdout: libradosstriper1-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:45:34.610 INFO:teuthology.orchestra.run.smithi155.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-10T08:45:34.610 INFO:teuthology.orchestra.run.smithi155.stdout: librgw2-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:45:34.611 INFO:teuthology.orchestra.run.smithi155.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-10T08:45:34.611 INFO:teuthology.orchestra.run.smithi155.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-10T08:45:34.611 INFO:teuthology.orchestra.run.smithi155.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-10T08:45:34.611 INFO:teuthology.orchestra.run.smithi155.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-10T08:45:34.611 INFO:teuthology.orchestra.run.smithi155.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-10T08:45:34.611 INFO:teuthology.orchestra.run.smithi155.stdout: lua-5.4.4-4.el9.x86_64 2024-09-10T08:45:34.611 INFO:teuthology.orchestra.run.smithi155.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-10T08:45:34.611 INFO:teuthology.orchestra.run.smithi155.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-10T08:45:34.611 INFO:teuthology.orchestra.run.smithi155.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-10T08:45:34.611 INFO:teuthology.orchestra.run.smithi155.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-10T08:45:34.611 INFO:teuthology.orchestra.run.smithi155.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-10T08:45:34.611 INFO:teuthology.orchestra.run.smithi155.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-10T08:45:34.611 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-13.16-1.el9.x86_64 2024-09-10T08:45:34.611 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-10T08:45:34.612 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-10T08:45:34.612 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-10T08:45:34.612 INFO:teuthology.orchestra.run.smithi155.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-10T08:45:34.612 INFO:teuthology.orchestra.run.smithi155.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-10T08:45:34.612 INFO:teuthology.orchestra.run.smithi155.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-10T08:45:34.612 INFO:teuthology.orchestra.run.smithi155.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-10T08:45:34.612 INFO:teuthology.orchestra.run.smithi155.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-10T08:45:34.612 INFO:teuthology.orchestra.run.smithi155.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-10T08:45:34.612 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-10T08:45:34.612 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-argparse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:45:34.612 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-common-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:45:34.612 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cephfs-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:45:34.612 INFO:teuthology.orchestra.run.smithi155.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-10T08:45:34.613 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-10T08:45:34.613 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-10T08:45:34.613 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-10T08:45:34.613 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-10T08:45:34.613 INFO:teuthology.orchestra.run.smithi155.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-10T08:45:34.613 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-10T08:45:34.613 INFO:teuthology.orchestra.run.smithi155.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-10T08:45:34.613 INFO:teuthology.orchestra.run.smithi155.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-10T08:45:34.613 INFO:teuthology.orchestra.run.smithi155.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-10T08:45:34.613 INFO:teuthology.orchestra.run.smithi155.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-10T08:45:34.613 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-10T08:45:34.613 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-10T08:45:34.613 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-10T08:45:34.613 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-10T08:45:34.614 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-10T08:45:34.614 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-10T08:45:34.614 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-10T08:45:34.614 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-10T08:45:34.614 INFO:teuthology.orchestra.run.smithi155.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-10T08:45:34.614 INFO:teuthology.orchestra.run.smithi155.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-10T08:45:34.614 INFO:teuthology.orchestra.run.smithi155.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-10T08:45:34.614 INFO:teuthology.orchestra.run.smithi155.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-10T08:45:34.614 INFO:teuthology.orchestra.run.smithi155.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-10T08:45:34.614 INFO:teuthology.orchestra.run.smithi155.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-10T08:45:34.614 INFO:teuthology.orchestra.run.smithi155.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-10T08:45:34.614 INFO:teuthology.orchestra.run.smithi155.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-10T08:45:34.614 INFO:teuthology.orchestra.run.smithi155.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-10T08:45:34.615 INFO:teuthology.orchestra.run.smithi155.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-10T08:45:34.615 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-10T08:45:34.615 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ply-3.11-14.el9.noarch 2024-09-10T08:45:34.615 INFO:teuthology.orchestra.run.smithi155.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-10T08:45:34.615 INFO:teuthology.orchestra.run.smithi155.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-10T08:45:34.615 INFO:teuthology.orchestra.run.smithi155.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-10T08:45:34.615 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-10T08:45:34.615 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-10T08:45:34.615 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-10T08:45:34.615 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-10T08:45:34.615 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-10T08:45:34.615 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-10T08:45:34.615 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rados-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:45:34.615 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rbd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:45:34.616 INFO:teuthology.orchestra.run.smithi155.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-10T08:45:34.616 INFO:teuthology.orchestra.run.smithi155.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-10T08:45:34.616 INFO:teuthology.orchestra.run.smithi155.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-10T08:45:34.616 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rgw-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:45:34.616 INFO:teuthology.orchestra.run.smithi155.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-10T08:45:34.616 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-10T08:45:34.616 INFO:teuthology.orchestra.run.smithi155.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-10T08:45:34.616 INFO:teuthology.orchestra.run.smithi155.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-10T08:45:34.616 INFO:teuthology.orchestra.run.smithi155.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-10T08:45:34.616 INFO:teuthology.orchestra.run.smithi155.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-10T08:45:34.616 INFO:teuthology.orchestra.run.smithi155.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-10T08:45:34.616 INFO:teuthology.orchestra.run.smithi155.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-10T08:45:34.616 INFO:teuthology.orchestra.run.smithi155.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-10T08:45:34.620 INFO:teuthology.orchestra.run.smithi155.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-10T08:45:34.621 INFO:teuthology.orchestra.run.smithi155.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-10T08:45:34.621 INFO:teuthology.orchestra.run.smithi155.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-10T08:45:34.621 INFO:teuthology.orchestra.run.smithi155.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-10T08:45:34.621 INFO:teuthology.orchestra.run.smithi155.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-10T08:45:34.621 INFO:teuthology.orchestra.run.smithi155.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-10T08:45:34.621 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-fuse-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:45:34.621 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-mirror-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:45:34.621 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-nbd-2:19.1.1-305.g1cf819b7.el9.x86_64 2024-09-10T08:45:34.621 INFO:teuthology.orchestra.run.smithi155.stdout: re2-1:20211101-20.el9.x86_64 2024-09-10T08:45:34.621 INFO:teuthology.orchestra.run.smithi155.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-10T08:45:34.621 INFO:teuthology.orchestra.run.smithi155.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-10T08:45:34.622 INFO:teuthology.orchestra.run.smithi155.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-10T08:45:34.622 INFO:teuthology.orchestra.run.smithi155.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-10T08:45:34.622 INFO:teuthology.orchestra.run.smithi155.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-10T08:45:34.622 INFO:teuthology.orchestra.run.smithi155.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-10T08:45:34.623 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-10T08:45:34.623 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2024-09-10T08:45:35.327 DEBUG:teuthology.parallel:result is None 2024-09-10T08:45:35.328 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T08:45:35.475 DEBUG:teuthology.orchestra.run.smithi002:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T08:45:35.520 INFO:teuthology.orchestra.run.smithi002.stdout:19.1.1-305.g1cf819b7.el9 2024-09-10T08:45:35.521 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-305.g1cf819b7.el9 2024-09-10T08:45:35.521 INFO:teuthology.task.install:The correct ceph version 19.1.1-305.g1cf819b7 is installed. 2024-09-10T08:45:35.523 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1cf819b7212a6048e92fc78c4eff963344f6d56b 2024-09-10T08:45:35.666 DEBUG:teuthology.orchestra.run.smithi155:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-10T08:45:35.712 INFO:teuthology.orchestra.run.smithi155.stdout:19.1.1-305.g1cf819b7.el9 2024-09-10T08:45:35.713 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-305.g1cf819b7.el9 2024-09-10T08:45:35.713 INFO:teuthology.task.install:The correct ceph version 19.1.1-305.g1cf819b7 is installed. 2024-09-10T08:45:35.715 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-10T08:45:35.716 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T08:45:35.716 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T08:45:35.774 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-10T08:45:35.774 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T08:45:35.834 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-10T08:45:35.835 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T08:45:35.835 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T08:45:35.892 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T08:45:35.988 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-10T08:45:35.988 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T08:45:36.045 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T08:45:36.143 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-10T08:45:36.144 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T08:45:36.144 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T08:45:36.202 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T08:45:36.305 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-10T08:45:36.305 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T08:45:36.361 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T08:45:36.458 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-10T08:45:36.458 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T08:45:36.459 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T08:45:36.518 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T08:45:36.621 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-10T08:45:36.621 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T08:45:36.678 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T08:45:36.777 INFO:teuthology.run_tasks:Running task ceph... 2024-09-10T08:45:36.857 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-10T08:45:36.857 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 777 /var/log/ceph 2024-09-10T08:45:36.861 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 777 /var/log/ceph 2024-09-10T08:45:36.917 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-10T08:45:36.918 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-10T08:45:36.922 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-10T08:45:36.979 INFO:tasks.ceph:Creating extra log directories... 2024-09-10T08:45:36.980 DEBUG:teuthology.orchestra.run.smithi002:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-10T08:45:36.984 DEBUG:teuthology.orchestra.run.smithi155:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-10T08:45:37.048 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-10T08:45:37.048 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-10T08:45:37.048 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-10T08:45:37.048 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T08:45:37.049 DEBUG:teuthology.orchestra.run.smithi002:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-10T08:45:37.084 DEBUG:teuthology.orchestra.run.smithi002:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-10T08:45:37.255 DEBUG:teuthology.orchestra.run.smithi002:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-10T08:45:37.319 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-10T08:45:37.319 DEBUG:teuthology.orchestra.run.smithi155:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-10T08:45:37.356 DEBUG:teuthology.orchestra.run.smithi155:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-10T08:45:37.523 DEBUG:teuthology.orchestra.run.smithi155:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-10T08:45:37.585 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-10T08:45:37.585 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'client snapdir': '.customsnapfuse', 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-10T08:45:37.586 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898932', 'branch': 'wip-rishabh-testing-20240909.165402-squid', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/snap_schedule_snapdir}', 'email': None, 'first_in_suite': False, 'job_id': '7898932', 'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-testing-20240909.165402-squid'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'client snapdir': '.customsnapfuse', 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b'}}, 'kclient': {'snapdirname': '.customsnapkernel', 'syntax': 'v2'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'subvolume_version': 2, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-testing-20240909.165402-squid', 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 9893, 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b', 'sleep_before_teardown': 0, 'subset': '197/1024', 'suite': 'fs', 'suite_branch': 'wip-rishabh-testing-20240909.165402-squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_1cf819b7212a6048e92fc78c4eff963344f6d56b/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi002.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAj6fQQ6Vqh0CpzJ9llx9UfoqS5qSXV8XfheHWuIdabD9P4OlmAlggaW/zrkdsmD5DrMmLYORIxc45JWQ2luOt8=', 'smithi155.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK5RR8vJeyVdzFJDnN/EZVzWPZBgAOwWFT6P1U/lnv43D6wS0ZHR0vnW8XkQ4Flx82w27JhhGQsvmHvjCBPZpoo='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'client snapdir': '.customsnapfuse', 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '1cf819b7212a6048e92fc78c4eff963344f6d56b', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-10_06:58:10', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-10T08:45:37.586 DEBUG:teuthology.orchestra.run.smithi002:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-10T08:45:37.591 DEBUG:teuthology.orchestra.run.smithi155:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-10T08:45:37.626 DEBUG:teuthology.orchestra.run.smithi002:> sudo install -d -m0777 -- /var/run/ceph 2024-09-10T08:45:37.670 DEBUG:teuthology.orchestra.run.smithi155:> sudo install -d -m0777 -- /var/run/ceph 2024-09-10T08:45:37.729 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T08:45:37.729 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T08:45:37.764 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T08:45:37.764 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_1 2024-09-10T08:45:37.840 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T08:45:37.841 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T08:45:37.841 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 6h/6d Inode: 631 Links: 1 2024-09-10T08:45:37.841 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T08:45:37.841 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T08:45:37.841 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-09-10 08:45:25.939407434 +0000 2024-09-10T08:45:37.841 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-09-10 08:43:15.619902757 +0000 2024-09-10T08:45:37.841 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-09-10 08:43:15.619902757 +0000 2024-09-10T08:45:37.841 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-09-10 08:43:15.619902757 +0000 2024-09-10T08:45:37.841 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T08:45:37.934 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-09-10T08:45:37.934 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-09-10T08:45:37.934 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000246709 s, 2.1 MB/s 2024-09-10T08:45:37.936 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T08:45:37.973 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_2 2024-09-10T08:45:38.048 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T08:45:38.048 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T08:45:38.048 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 6h/6d Inode: 651 Links: 1 2024-09-10T08:45:38.048 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T08:45:38.048 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T08:45:38.048 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-09-10 08:45:25.939407434 +0000 2024-09-10T08:45:38.048 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-09-10 08:43:16.079892155 +0000 2024-09-10T08:45:38.049 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-09-10 08:43:16.079892155 +0000 2024-09-10T08:45:38.049 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-09-10 08:43:16.079892155 +0000 2024-09-10T08:45:38.049 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T08:45:38.141 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-09-10T08:45:38.141 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-09-10T08:45:38.141 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000174758 s, 2.9 MB/s 2024-09-10T08:45:38.143 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T08:45:38.179 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_3 2024-09-10T08:45:38.263 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T08:45:38.264 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T08:45:38.264 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 6h/6d Inode: 669 Links: 1 2024-09-10T08:45:38.264 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T08:45:38.264 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T08:45:38.264 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-09-10 08:45:25.940407411 +0000 2024-09-10T08:45:38.264 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-09-10 08:43:16.517882060 +0000 2024-09-10T08:45:38.264 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-09-10 08:43:16.517882060 +0000 2024-09-10T08:45:38.264 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-09-10 08:43:16.517882060 +0000 2024-09-10T08:45:38.264 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T08:45:38.358 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-09-10T08:45:38.358 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-09-10T08:45:38.358 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000171862 s, 3.0 MB/s 2024-09-10T08:45:38.360 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T08:45:38.397 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_4 2024-09-10T08:45:38.472 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T08:45:38.472 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T08:45:38.472 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 6h/6d Inode: 690 Links: 1 2024-09-10T08:45:38.472 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T08:45:38.472 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T08:45:38.472 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-09-10 08:45:25.941407388 +0000 2024-09-10T08:45:38.472 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-09-10 08:43:17.041869984 +0000 2024-09-10T08:45:38.472 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-09-10 08:43:17.041869984 +0000 2024-09-10T08:45:38.473 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-09-10 08:43:17.041869984 +0000 2024-09-10T08:45:38.473 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T08:45:38.565 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-09-10T08:45:38.565 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-09-10T08:45:38.565 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.00017682 s, 2.9 MB/s 2024-09-10T08:45:38.568 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T08:45:38.604 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T08:45:38.605 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-10T08:45:38.605 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T08:45:38.642 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T08:45:38.642 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_1 2024-09-10T08:45:38.721 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T08:45:38.721 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T08:45:38.721 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 6h/6d Inode: 639 Links: 1 2024-09-10T08:45:38.721 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T08:45:38.721 INFO:teuthology.orchestra.run.smithi155.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T08:45:38.721 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2024-09-10 08:45:26.801104456 +0000 2024-09-10T08:45:38.721 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2024-09-10 08:43:14.625285572 +0000 2024-09-10T08:45:38.721 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2024-09-10 08:43:14.625285572 +0000 2024-09-10T08:45:38.721 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: 2024-09-10 08:43:14.625285572 +0000 2024-09-10T08:45:38.722 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T08:45:38.814 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2024-09-10T08:45:38.815 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2024-09-10T08:45:38.815 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000336593 s, 1.5 MB/s 2024-09-10T08:45:38.817 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T08:45:38.854 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_2 2024-09-10T08:45:38.933 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T08:45:38.933 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T08:45:38.934 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 6h/6d Inode: 657 Links: 1 2024-09-10T08:45:38.934 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T08:45:38.934 INFO:teuthology.orchestra.run.smithi155.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T08:45:38.934 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2024-09-10 08:45:26.801104456 +0000 2024-09-10T08:45:38.934 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2024-09-10 08:43:15.099276068 +0000 2024-09-10T08:45:38.934 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2024-09-10 08:43:15.099276068 +0000 2024-09-10T08:45:38.934 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: 2024-09-10 08:43:15.099276068 +0000 2024-09-10T08:45:38.936 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T08:45:39.027 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2024-09-10T08:45:39.027 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2024-09-10T08:45:39.027 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000297376 s, 1.7 MB/s 2024-09-10T08:45:39.029 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T08:45:39.066 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_3 2024-09-10T08:45:39.141 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T08:45:39.141 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T08:45:39.141 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 6h/6d Inode: 678 Links: 1 2024-09-10T08:45:39.141 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T08:45:39.141 INFO:teuthology.orchestra.run.smithi155.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T08:45:39.141 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2024-09-10 08:45:26.802104436 +0000 2024-09-10T08:45:39.141 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2024-09-10 08:43:15.536267306 +0000 2024-09-10T08:45:39.144 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2024-09-10 08:43:15.536267306 +0000 2024-09-10T08:45:39.144 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: 2024-09-10 08:43:15.536267306 +0000 2024-09-10T08:45:39.144 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T08:45:39.234 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2024-09-10T08:45:39.234 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2024-09-10T08:45:39.234 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000311296 s, 1.6 MB/s 2024-09-10T08:45:39.236 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T08:45:39.273 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_4 2024-09-10T08:45:39.349 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T08:45:39.350 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T08:45:39.350 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 6h/6d Inode: 696 Links: 1 2024-09-10T08:45:39.350 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T08:45:39.350 INFO:teuthology.orchestra.run.smithi155.stdout:Context: system_u:object_r:device_t:s0 2024-09-10T08:45:39.350 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2024-09-10 08:45:26.803104416 +0000 2024-09-10T08:45:39.350 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2024-09-10 08:43:16.006257883 +0000 2024-09-10T08:45:39.350 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2024-09-10 08:43:16.006257883 +0000 2024-09-10T08:45:39.350 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: 2024-09-10 08:43:16.006257883 +0000 2024-09-10T08:45:39.351 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T08:45:39.443 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2024-09-10T08:45:39.443 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2024-09-10T08:45:39.443 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000265281 s, 1.9 MB/s 2024-09-10T08:45:39.446 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T08:45:39.482 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T08:45:39.482 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi002.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi155.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-10T08:45:39.482 INFO:tasks.ceph:Generating config... 2024-09-10T08:45:39.483 INFO:tasks.ceph:[client] client mount timeout = 600 2024-09-10T08:45:39.483 INFO:tasks.ceph:[client] client snapdir = .customsnapfuse 2024-09-10T08:45:39.483 INFO:tasks.ceph:[client] debug client = 20 2024-09-10T08:45:39.483 INFO:tasks.ceph:[client] debug ms = 1 2024-09-10T08:45:39.484 INFO:tasks.ceph:[client] pid file = 2024-09-10T08:45:39.484 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-09-10T08:45:39.484 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-09-10T08:45:39.484 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-09-10T08:45:39.484 INFO:tasks.ceph:[mds] debug mds = 20 2024-09-10T08:45:39.484 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-09-10T08:45:39.484 INFO:tasks.ceph:[mds] debug ms = 1 2024-09-10T08:45:39.484 INFO:tasks.ceph:[mds] mds debug frag = True 2024-09-10T08:45:39.484 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-09-10T08:45:39.484 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-09-10T08:45:39.484 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-09-10T08:45:39.484 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-09-10T08:45:39.485 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-09-10T08:45:39.485 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-09-10T08:45:39.485 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-10T08:45:39.485 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-10T08:45:39.485 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-10T08:45:39.485 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-10T08:45:39.485 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-10T08:45:39.485 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-10T08:45:39.485 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-10T08:45:39.485 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-09-10T08:45:39.486 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-09-10T08:45:39.486 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-10T08:45:39.486 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-10T08:45:39.486 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-10T08:45:39.486 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-10T08:45:39.486 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-10T08:45:39.486 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-10T08:45:39.486 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-10T08:45:39.486 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-10T08:45:39.486 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-10T08:45:39.486 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-10T08:45:39.486 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-10T08:45:39.487 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-10T08:45:39.487 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-09-10T08:45:39.487 INFO:tasks.ceph:Setting up mon.a... 2024-09-10T08:45:39.487 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-10T08:45:39.584 INFO:teuthology.orchestra.run.smithi002.stdout:creating /etc/ceph/ceph.keyring 2024-09-10T08:45:39.590 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-10T08:45:39.677 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-10T08:45:39.732 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.2'), ('mon.b', '172.21.15.155'), ('mon.c', '[v2:172.21.15.155:3301,v1:172.21.15.155:6790]')] 2024-09-10T08:45:39.733 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.2,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'client snapdir': '.customsnapfuse', 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-09-10T08:45:39.734 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T08:45:39.734 DEBUG:teuthology.orchestra.run.smithi002:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-10T08:45:39.769 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.2 --add b 172.21.15.155 --addv c '[v2:172.21.15.155:3301,v1:172.21.15.155:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-10T08:45:39.886 INFO:teuthology.orchestra.run.smithi002.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-10T08:45:39.886 INFO:teuthology.orchestra.run.smithi002.stdout:monmaptool: generated fsid f20a15a7-d363-4d44-98cb-4f4f466b52b8 2024-09-10T08:45:39.886 INFO:teuthology.orchestra.run.smithi002.stdout:setting min_mon_release = quincy 2024-09-10T08:45:39.886 INFO:teuthology.orchestra.run.smithi002.stdout:epoch 0 2024-09-10T08:45:39.886 INFO:teuthology.orchestra.run.smithi002.stdout:fsid f20a15a7-d363-4d44-98cb-4f4f466b52b8 2024-09-10T08:45:39.886 INFO:teuthology.orchestra.run.smithi002.stdout:last_changed 2024-09-10T08:45:39.886574+0000 2024-09-10T08:45:39.886 INFO:teuthology.orchestra.run.smithi002.stdout:created 2024-09-10T08:45:39.886574+0000 2024-09-10T08:45:39.886 INFO:teuthology.orchestra.run.smithi002.stdout:min_mon_release 17 (quincy) 2024-09-10T08:45:39.887 INFO:teuthology.orchestra.run.smithi002.stdout:election_strategy: 1 2024-09-10T08:45:39.887 INFO:teuthology.orchestra.run.smithi002.stdout:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-10T08:45:39.887 INFO:teuthology.orchestra.run.smithi002.stdout:1: [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] mon.b 2024-09-10T08:45:39.887 INFO:teuthology.orchestra.run.smithi002.stdout:2: [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] mon.c 2024-09-10T08:45:39.887 INFO:teuthology.orchestra.run.smithi002.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-10T08:45:39.889 DEBUG:teuthology.orchestra.run.smithi002:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-10T08:45:39.923 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID f20a15a7-d363-4d44-98cb-4f4f466b52b8... 2024-09-10T08:45:39.924 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-10T08:45:39.969 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-10T08:45:40.062 INFO:teuthology.orchestra.run.smithi002.stdout:[global] 2024-09-10T08:45:40.063 INFO:teuthology.orchestra.run.smithi002.stdout: chdir = "" 2024-09-10T08:45:40.063 INFO:teuthology.orchestra.run.smithi002.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-10T08:45:40.063 INFO:teuthology.orchestra.run.smithi002.stdout: auth supported = cephx 2024-09-10T08:45:40.063 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:45:40.063 INFO:teuthology.orchestra.run.smithi002.stdout: filestore xattr use omap = true 2024-09-10T08:45:40.063 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:45:40.063 INFO:teuthology.orchestra.run.smithi002.stdout: mon clock drift allowed = 1.000 2024-09-10T08:45:40.063 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:45:40.063 INFO:teuthology.orchestra.run.smithi002.stdout: osd crush chooseleaf type = 0 2024-09-10T08:45:40.063 INFO:teuthology.orchestra.run.smithi002.stdout: auth debug = true 2024-09-10T08:45:40.063 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:45:40.063 INFO:teuthology.orchestra.run.smithi002.stdout: ms die on old message = true 2024-09-10T08:45:40.064 INFO:teuthology.orchestra.run.smithi002.stdout: ms die on bug = true 2024-09-10T08:45:40.064 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:45:40.064 INFO:teuthology.orchestra.run.smithi002.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-10T08:45:40.064 INFO:teuthology.orchestra.run.smithi002.stdout: mon pg warn max object skew = 0 2024-09-10T08:45:40.064 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:45:40.064 INFO:teuthology.orchestra.run.smithi002.stdout: # disable pg_autoscaler by default for new pools 2024-09-10T08:45:40.064 INFO:teuthology.orchestra.run.smithi002.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-10T08:45:40.064 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:45:40.064 INFO:teuthology.orchestra.run.smithi002.stdout: osd pool default size = 2 2024-09-10T08:45:40.064 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:45:40.064 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd allow primary affinity = true 2024-09-10T08:45:40.064 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd allow pg remap = true 2024-09-10T08:45:40.064 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on legacy crush tunables = false 2024-09-10T08:45:40.065 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on crush straw calc version zero = false 2024-09-10T08:45:40.065 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on no sortbitwise = false 2024-09-10T08:45:40.065 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on osd down out interval zero = false 2024-09-10T08:45:40.065 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on too few osds = false 2024-09-10T08:45:40.065 INFO:teuthology.orchestra.run.smithi002.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-10T08:45:40.065 INFO:teuthology.orchestra.run.smithi002.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-10T08:45:40.065 INFO:teuthology.orchestra.run.smithi002.stdout: mon_allow_pool_size_one = true 2024-09-10T08:45:40.065 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:45:40.065 INFO:teuthology.orchestra.run.smithi002.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-10T08:45:40.066 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:45:40.066 INFO:teuthology.orchestra.run.smithi002.stdout: osd default data pool replay window = 5 2024-09-10T08:45:40.066 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:45:40.066 INFO:teuthology.orchestra.run.smithi002.stdout: mon allow pool delete = true 2024-09-10T08:45:40.066 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:45:40.066 INFO:teuthology.orchestra.run.smithi002.stdout: mon cluster log file level = debug 2024-09-10T08:45:40.066 INFO:teuthology.orchestra.run.smithi002.stdout: debug asserts on shutdown = true 2024-09-10T08:45:40.066 INFO:teuthology.orchestra.run.smithi002.stdout: mon health detail to clog = false 2024-09-10T08:45:40.066 INFO:teuthology.orchestra.run.smithi002.stdout: mon host = "172.21.15.2,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]" 2024-09-10T08:45:40.066 INFO:teuthology.orchestra.run.smithi002.stdout: ms die on skipped message = False 2024-09-10T08:45:40.066 INFO:teuthology.orchestra.run.smithi002.stdout: fsid = f20a15a7-d363-4d44-98cb-4f4f466b52b8 2024-09-10T08:45:40.067 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:45:40.067 INFO:teuthology.orchestra.run.smithi002.stdout:[osd] 2024-09-10T08:45:40.067 INFO:teuthology.orchestra.run.smithi002.stdout: osd journal size = 100 2024-09-10T08:45:40.067 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:45:40.067 INFO:teuthology.orchestra.run.smithi002.stdout: osd scrub load threshold = 5.0 2024-09-10T08:45:40.067 INFO:teuthology.orchestra.run.smithi002.stdout: osd scrub max interval = 600 2024-09-10T08:45:40.067 INFO:teuthology.orchestra.run.smithi002.stdout: osd mclock profile = high_recovery_ops 2024-09-10T08:45:40.067 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:45:40.067 INFO:teuthology.orchestra.run.smithi002.stdout: osd recover clone overlap = true 2024-09-10T08:45:40.067 INFO:teuthology.orchestra.run.smithi002.stdout: osd recovery max chunk = 1048576 2024-09-10T08:45:40.067 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:45:40.067 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug shutdown = true 2024-09-10T08:45:40.067 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug op order = true 2024-09-10T08:45:40.068 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug verify stray on activate = true 2024-09-10T08:45:40.068 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug trim objects = true 2024-09-10T08:45:40.068 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:45:40.068 INFO:teuthology.orchestra.run.smithi002.stdout: osd open classes on start = true 2024-09-10T08:45:40.068 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug pg log writeout = true 2024-09-10T08:45:40.068 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:45:40.068 INFO:teuthology.orchestra.run.smithi002.stdout: osd deep scrub update digest min age = 30 2024-09-10T08:45:40.068 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:45:40.068 INFO:teuthology.orchestra.run.smithi002.stdout: osd map max advance = 10 2024-09-10T08:45:40.068 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:45:40.068 INFO:teuthology.orchestra.run.smithi002.stdout: journal zero on create = true 2024-09-10T08:45:40.068 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:45:40.068 INFO:teuthology.orchestra.run.smithi002.stdout: filestore ondisk finisher threads = 3 2024-09-10T08:45:40.068 INFO:teuthology.orchestra.run.smithi002.stdout: filestore apply finisher threads = 3 2024-09-10T08:45:40.069 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:45:40.069 INFO:teuthology.orchestra.run.smithi002.stdout: bdev debug aio = true 2024-09-10T08:45:40.069 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug misdirected ops = true 2024-09-10T08:45:40.069 INFO:teuthology.orchestra.run.smithi002.stdout: bluestore block size = 96636764160 2024-09-10T08:45:40.069 INFO:teuthology.orchestra.run.smithi002.stdout: bluestore fsck on mount = True 2024-09-10T08:45:40.069 INFO:teuthology.orchestra.run.smithi002.stdout: debug bluefs = 20 2024-09-10T08:45:40.069 INFO:teuthology.orchestra.run.smithi002.stdout: debug bluestore = 20 2024-09-10T08:45:40.069 INFO:teuthology.orchestra.run.smithi002.stdout: debug ms = 1 2024-09-10T08:45:40.069 INFO:teuthology.orchestra.run.smithi002.stdout: debug osd = 20 2024-09-10T08:45:40.069 INFO:teuthology.orchestra.run.smithi002.stdout: debug rocksdb = 10 2024-09-10T08:45:40.069 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd backfillfull_ratio = 0.85 2024-09-10T08:45:40.069 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd full ratio = 0.9 2024-09-10T08:45:40.070 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd nearfull ratio = 0.8 2024-09-10T08:45:40.070 INFO:teuthology.orchestra.run.smithi002.stdout: osd failsafe full ratio = 0.95 2024-09-10T08:45:40.070 INFO:teuthology.orchestra.run.smithi002.stdout: osd objectstore = bluestore 2024-09-10T08:45:40.070 INFO:teuthology.orchestra.run.smithi002.stdout: osd op complaint time = 180 2024-09-10T08:45:40.070 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:45:40.070 INFO:teuthology.orchestra.run.smithi002.stdout:[mgr] 2024-09-10T08:45:40.070 INFO:teuthology.orchestra.run.smithi002.stdout: debug ms = 1 2024-09-10T08:45:40.070 INFO:teuthology.orchestra.run.smithi002.stdout: debug mgr = 20 2024-09-10T08:45:40.070 INFO:teuthology.orchestra.run.smithi002.stdout: debug mon = 20 2024-09-10T08:45:40.070 INFO:teuthology.orchestra.run.smithi002.stdout: debug auth = 20 2024-09-10T08:45:40.070 INFO:teuthology.orchestra.run.smithi002.stdout: mon reweight min pgs per osd = 4 2024-09-10T08:45:40.070 INFO:teuthology.orchestra.run.smithi002.stdout: mon reweight min bytes per osd = 10 2024-09-10T08:45:40.070 INFO:teuthology.orchestra.run.smithi002.stdout: mgr/telemetry/nag = false 2024-09-10T08:45:40.071 INFO:teuthology.orchestra.run.smithi002.stdout: debug client = 20 2024-09-10T08:45:40.071 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:45:40.071 INFO:teuthology.orchestra.run.smithi002.stdout:[mon] 2024-09-10T08:45:40.071 INFO:teuthology.orchestra.run.smithi002.stdout: debug ms = 1 2024-09-10T08:45:40.071 INFO:teuthology.orchestra.run.smithi002.stdout: debug mon = 20 2024-09-10T08:45:40.071 INFO:teuthology.orchestra.run.smithi002.stdout: debug paxos = 20 2024-09-10T08:45:40.071 INFO:teuthology.orchestra.run.smithi002.stdout: debug auth = 20 2024-09-10T08:45:40.071 INFO:teuthology.orchestra.run.smithi002.stdout: mon data avail warn = 5 2024-09-10T08:45:40.071 INFO:teuthology.orchestra.run.smithi002.stdout: mon mgr mkfs grace = 240 2024-09-10T08:45:40.071 INFO:teuthology.orchestra.run.smithi002.stdout: mon reweight min pgs per osd = 4 2024-09-10T08:45:40.071 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd reporter subtree level = osd 2024-09-10T08:45:40.071 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd prime pg temp = true 2024-09-10T08:45:40.071 INFO:teuthology.orchestra.run.smithi002.stdout: mon reweight min bytes per osd = 10 2024-09-10T08:45:40.072 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:45:40.072 INFO:teuthology.orchestra.run.smithi002.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-10T08:45:40.072 INFO:teuthology.orchestra.run.smithi002.stdout: auth mon ticket ttl = 660 # 11m 2024-09-10T08:45:40.072 INFO:teuthology.orchestra.run.smithi002.stdout: auth service ticket ttl = 240 # 4m 2024-09-10T08:45:40.072 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:45:40.072 INFO:teuthology.orchestra.run.smithi002.stdout: # don't complain about insecure global_id in the test suite 2024-09-10T08:45:40.072 INFO:teuthology.orchestra.run.smithi002.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-10T08:45:40.072 INFO:teuthology.orchestra.run.smithi002.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-10T08:45:40.072 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:45:40.072 INFO:teuthology.orchestra.run.smithi002.stdout: # 1m isn't quite enough 2024-09-10T08:45:40.072 INFO:teuthology.orchestra.run.smithi002.stdout: mon_down_mkfs_grace = 2m 2024-09-10T08:45:40.072 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:45:40.072 INFO:teuthology.orchestra.run.smithi002.stdout: mon_warn_on_filestore_osds = false 2024-09-10T08:45:40.073 INFO:teuthology.orchestra.run.smithi002.stdout: mon down mkfs grace = 300 2024-09-10T08:45:40.073 INFO:teuthology.orchestra.run.smithi002.stdout: mon op complaint time = 120 2024-09-10T08:45:40.073 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on pool no app = False 2024-09-10T08:45:40.073 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:45:40.073 INFO:teuthology.orchestra.run.smithi002.stdout:[client] 2024-09-10T08:45:40.073 INFO:teuthology.orchestra.run.smithi002.stdout: rgw cache enabled = true 2024-09-10T08:45:40.073 INFO:teuthology.orchestra.run.smithi002.stdout: rgw enable ops log = true 2024-09-10T08:45:40.073 INFO:teuthology.orchestra.run.smithi002.stdout: rgw enable usage log = true 2024-09-10T08:45:40.073 INFO:teuthology.orchestra.run.smithi002.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-10T08:45:40.073 INFO:teuthology.orchestra.run.smithi002.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-10T08:45:40.073 INFO:teuthology.orchestra.run.smithi002.stdout: client mount timeout = 600 2024-09-10T08:45:40.073 INFO:teuthology.orchestra.run.smithi002.stdout: client snapdir = .customsnapfuse 2024-09-10T08:45:40.073 INFO:teuthology.orchestra.run.smithi002.stdout: debug client = 20 2024-09-10T08:45:40.073 INFO:teuthology.orchestra.run.smithi002.stdout: debug ms = 1 2024-09-10T08:45:40.074 INFO:teuthology.orchestra.run.smithi002.stdout: pid file = "" 2024-09-10T08:45:40.074 INFO:teuthology.orchestra.run.smithi002.stdout: rados mon op timeout = 900 2024-09-10T08:45:40.074 INFO:teuthology.orchestra.run.smithi002.stdout: rados osd op timeout = 900 2024-09-10T08:45:40.074 INFO:teuthology.orchestra.run.smithi002.stdout:[mon.a] 2024-09-10T08:45:40.074 INFO:teuthology.orchestra.run.smithi002.stdout:[mon.b] 2024-09-10T08:45:40.074 INFO:teuthology.orchestra.run.smithi002.stdout:[mon.c] 2024-09-10T08:45:40.074 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.a] 2024-09-10T08:45:40.074 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.c] 2024-09-10T08:45:40.074 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.b] 2024-09-10T08:45:40.074 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.d] 2024-09-10T08:45:40.074 INFO:teuthology.orchestra.run.smithi002.stdout:[mds] 2024-09-10T08:45:40.074 INFO:teuthology.orchestra.run.smithi002.stdout: debug mds = 20 2024-09-10T08:45:40.074 INFO:teuthology.orchestra.run.smithi002.stdout: debug mds balancer = 20 2024-09-10T08:45:40.074 INFO:teuthology.orchestra.run.smithi002.stdout: debug ms = 1 2024-09-10T08:45:40.075 INFO:teuthology.orchestra.run.smithi002.stdout: mds debug frag = True 2024-09-10T08:45:40.075 INFO:teuthology.orchestra.run.smithi002.stdout: mds debug scatterstat = True 2024-09-10T08:45:40.075 INFO:teuthology.orchestra.run.smithi002.stdout: mds op complaint time = 180 2024-09-10T08:45:40.075 INFO:teuthology.orchestra.run.smithi002.stdout: mds verify scatter = True 2024-09-10T08:45:40.075 INFO:teuthology.orchestra.run.smithi002.stdout: osd op complaint time = 180 2024-09-10T08:45:40.075 INFO:teuthology.orchestra.run.smithi002.stdout: rados mon op timeout = 900 2024-09-10T08:45:40.075 INFO:teuthology.orchestra.run.smithi002.stdout: rados osd op timeout = 900 2024-09-10T08:45:40.075 INFO:teuthology.orchestra.run.smithi155.stdout:[global] 2024-09-10T08:45:40.075 INFO:teuthology.orchestra.run.smithi155.stdout: chdir = "" 2024-09-10T08:45:40.076 INFO:teuthology.orchestra.run.smithi155.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-10T08:45:40.076 INFO:teuthology.orchestra.run.smithi155.stdout: auth supported = cephx 2024-09-10T08:45:40.076 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-10T08:45:40.076 INFO:teuthology.orchestra.run.smithi155.stdout: filestore xattr use omap = true 2024-09-10T08:45:40.076 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-10T08:45:40.076 INFO:teuthology.orchestra.run.smithi155.stdout: mon clock drift allowed = 1.000 2024-09-10T08:45:40.076 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-10T08:45:40.076 INFO:teuthology.orchestra.run.smithi155.stdout: osd crush chooseleaf type = 0 2024-09-10T08:45:40.076 INFO:teuthology.orchestra.run.smithi155.stdout: auth debug = true 2024-09-10T08:45:40.076 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-10T08:45:40.076 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on old message = true 2024-09-10T08:45:40.076 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on bug = true 2024-09-10T08:45:40.077 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-10T08:45:40.077 INFO:teuthology.orchestra.run.smithi155.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-10T08:45:40.077 INFO:teuthology.orchestra.run.smithi155.stdout: mon pg warn max object skew = 0 2024-09-10T08:45:40.077 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-10T08:45:40.077 INFO:teuthology.orchestra.run.smithi155.stdout: # disable pg_autoscaler by default for new pools 2024-09-10T08:45:40.077 INFO:teuthology.orchestra.run.smithi155.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-10T08:45:40.077 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-10T08:45:40.077 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default size = 2 2024-09-10T08:45:40.077 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-10T08:45:40.077 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow primary affinity = true 2024-09-10T08:45:40.077 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow pg remap = true 2024-09-10T08:45:40.077 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on legacy crush tunables = false 2024-09-10T08:45:40.077 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on crush straw calc version zero = false 2024-09-10T08:45:40.077 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on no sortbitwise = false 2024-09-10T08:45:40.078 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on osd down out interval zero = false 2024-09-10T08:45:40.078 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on too few osds = false 2024-09-10T08:45:40.078 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-10T08:45:40.078 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-10T08:45:40.078 INFO:teuthology.orchestra.run.smithi155.stdout: mon_allow_pool_size_one = true 2024-09-10T08:45:40.078 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-10T08:45:40.078 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-10T08:45:40.078 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-10T08:45:40.078 INFO:teuthology.orchestra.run.smithi155.stdout: osd default data pool replay window = 5 2024-09-10T08:45:40.078 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-10T08:45:40.078 INFO:teuthology.orchestra.run.smithi155.stdout: mon allow pool delete = true 2024-09-10T08:45:40.078 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-10T08:45:40.078 INFO:teuthology.orchestra.run.smithi155.stdout: mon cluster log file level = debug 2024-09-10T08:45:40.079 INFO:teuthology.orchestra.run.smithi155.stdout: debug asserts on shutdown = true 2024-09-10T08:45:40.079 INFO:teuthology.orchestra.run.smithi155.stdout: mon health detail to clog = false 2024-09-10T08:45:40.079 INFO:teuthology.orchestra.run.smithi155.stdout: mon host = "172.21.15.2,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]" 2024-09-10T08:45:40.079 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on skipped message = False 2024-09-10T08:45:40.079 INFO:teuthology.orchestra.run.smithi155.stdout: fsid = f20a15a7-d363-4d44-98cb-4f4f466b52b8 2024-09-10T08:45:40.079 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-10T08:45:40.079 INFO:teuthology.orchestra.run.smithi155.stdout:[osd] 2024-09-10T08:45:40.079 INFO:teuthology.orchestra.run.smithi155.stdout: osd journal size = 100 2024-09-10T08:45:40.079 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-10T08:45:40.079 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub load threshold = 5.0 2024-09-10T08:45:40.079 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub max interval = 600 2024-09-10T08:45:40.079 INFO:teuthology.orchestra.run.smithi155.stdout: osd mclock profile = high_recovery_ops 2024-09-10T08:45:40.079 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-10T08:45:40.080 INFO:teuthology.orchestra.run.smithi155.stdout: osd recover clone overlap = true 2024-09-10T08:45:40.080 INFO:teuthology.orchestra.run.smithi155.stdout: osd recovery max chunk = 1048576 2024-09-10T08:45:40.080 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-10T08:45:40.080 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug shutdown = true 2024-09-10T08:45:40.080 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug op order = true 2024-09-10T08:45:40.080 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug verify stray on activate = true 2024-09-10T08:45:40.080 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug trim objects = true 2024-09-10T08:45:40.080 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-10T08:45:40.080 INFO:teuthology.orchestra.run.smithi155.stdout: osd open classes on start = true 2024-09-10T08:45:40.080 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug pg log writeout = true 2024-09-10T08:45:40.080 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-10T08:45:40.080 INFO:teuthology.orchestra.run.smithi155.stdout: osd deep scrub update digest min age = 30 2024-09-10T08:45:40.080 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-10T08:45:40.081 INFO:teuthology.orchestra.run.smithi155.stdout: osd map max advance = 10 2024-09-10T08:45:40.081 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-10T08:45:40.081 INFO:teuthology.orchestra.run.smithi155.stdout: journal zero on create = true 2024-09-10T08:45:40.081 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-10T08:45:40.081 INFO:teuthology.orchestra.run.smithi155.stdout: filestore ondisk finisher threads = 3 2024-09-10T08:45:40.081 INFO:teuthology.orchestra.run.smithi155.stdout: filestore apply finisher threads = 3 2024-09-10T08:45:40.081 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-10T08:45:40.081 INFO:teuthology.orchestra.run.smithi155.stdout: bdev debug aio = true 2024-09-10T08:45:40.081 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug misdirected ops = true 2024-09-10T08:45:40.081 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore block size = 96636764160 2024-09-10T08:45:40.081 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore fsck on mount = True 2024-09-10T08:45:40.081 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluefs = 20 2024-09-10T08:45:40.081 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluestore = 20 2024-09-10T08:45:40.081 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-09-10T08:45:40.082 INFO:teuthology.orchestra.run.smithi155.stdout: debug osd = 20 2024-09-10T08:45:40.082 INFO:teuthology.orchestra.run.smithi155.stdout: debug rocksdb = 10 2024-09-10T08:45:40.082 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd backfillfull_ratio = 0.85 2024-09-10T08:45:40.082 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd full ratio = 0.9 2024-09-10T08:45:40.082 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd nearfull ratio = 0.8 2024-09-10T08:45:40.082 INFO:teuthology.orchestra.run.smithi155.stdout: osd failsafe full ratio = 0.95 2024-09-10T08:45:40.082 INFO:teuthology.orchestra.run.smithi155.stdout: osd objectstore = bluestore 2024-09-10T08:45:40.082 INFO:teuthology.orchestra.run.smithi155.stdout: osd op complaint time = 180 2024-09-10T08:45:40.082 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-10T08:45:40.082 INFO:teuthology.orchestra.run.smithi155.stdout:[mgr] 2024-09-10T08:45:40.082 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-09-10T08:45:40.082 INFO:teuthology.orchestra.run.smithi155.stdout: debug mgr = 20 2024-09-10T08:45:40.082 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2024-09-10T08:45:40.083 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2024-09-10T08:45:40.083 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2024-09-10T08:45:40.083 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2024-09-10T08:45:40.083 INFO:teuthology.orchestra.run.smithi155.stdout: mgr/telemetry/nag = false 2024-09-10T08:45:40.083 INFO:teuthology.orchestra.run.smithi155.stdout: debug client = 20 2024-09-10T08:45:40.083 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-10T08:45:40.083 INFO:teuthology.orchestra.run.smithi155.stdout:[mon] 2024-09-10T08:45:40.083 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-09-10T08:45:40.083 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2024-09-10T08:45:40.083 INFO:teuthology.orchestra.run.smithi155.stdout: debug paxos = 20 2024-09-10T08:45:40.083 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2024-09-10T08:45:40.083 INFO:teuthology.orchestra.run.smithi155.stdout: mon data avail warn = 5 2024-09-10T08:45:40.083 INFO:teuthology.orchestra.run.smithi155.stdout: mon mgr mkfs grace = 240 2024-09-10T08:45:40.084 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2024-09-10T08:45:40.084 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd reporter subtree level = osd 2024-09-10T08:45:40.084 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd prime pg temp = true 2024-09-10T08:45:40.084 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2024-09-10T08:45:40.084 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-10T08:45:40.084 INFO:teuthology.orchestra.run.smithi155.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-10T08:45:40.084 INFO:teuthology.orchestra.run.smithi155.stdout: auth mon ticket ttl = 660 # 11m 2024-09-10T08:45:40.084 INFO:teuthology.orchestra.run.smithi155.stdout: auth service ticket ttl = 240 # 4m 2024-09-10T08:45:40.084 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-10T08:45:40.084 INFO:teuthology.orchestra.run.smithi155.stdout: # don't complain about insecure global_id in the test suite 2024-09-10T08:45:40.084 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-10T08:45:40.084 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-10T08:45:40.085 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-10T08:45:40.085 INFO:teuthology.orchestra.run.smithi155.stdout: # 1m isn't quite enough 2024-09-10T08:45:40.085 INFO:teuthology.orchestra.run.smithi155.stdout: mon_down_mkfs_grace = 2m 2024-09-10T08:45:40.085 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-10T08:45:40.085 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_filestore_osds = false 2024-09-10T08:45:40.085 INFO:teuthology.orchestra.run.smithi155.stdout: mon down mkfs grace = 300 2024-09-10T08:45:40.085 INFO:teuthology.orchestra.run.smithi155.stdout: mon op complaint time = 120 2024-09-10T08:45:40.085 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on pool no app = False 2024-09-10T08:45:40.085 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-10T08:45:40.085 INFO:teuthology.orchestra.run.smithi155.stdout:[client] 2024-09-10T08:45:40.085 INFO:teuthology.orchestra.run.smithi155.stdout: rgw cache enabled = true 2024-09-10T08:45:40.085 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable ops log = true 2024-09-10T08:45:40.085 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable usage log = true 2024-09-10T08:45:40.085 INFO:teuthology.orchestra.run.smithi155.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-10T08:45:40.086 INFO:teuthology.orchestra.run.smithi155.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-10T08:45:40.086 INFO:teuthology.orchestra.run.smithi155.stdout: client mount timeout = 600 2024-09-10T08:45:40.086 INFO:teuthology.orchestra.run.smithi155.stdout: client snapdir = .customsnapfuse 2024-09-10T08:45:40.086 INFO:teuthology.orchestra.run.smithi155.stdout: debug client = 20 2024-09-10T08:45:40.086 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-09-10T08:45:40.086 INFO:teuthology.orchestra.run.smithi155.stdout: pid file = "" 2024-09-10T08:45:40.086 INFO:teuthology.orchestra.run.smithi155.stdout: rados mon op timeout = 900 2024-09-10T08:45:40.086 INFO:teuthology.orchestra.run.smithi155.stdout: rados osd op timeout = 900 2024-09-10T08:45:40.086 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.a] 2024-09-10T08:45:40.086 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.b] 2024-09-10T08:45:40.086 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.c] 2024-09-10T08:45:40.086 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.a] 2024-09-10T08:45:40.086 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.c] 2024-09-10T08:45:40.087 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.b] 2024-09-10T08:45:40.087 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.d] 2024-09-10T08:45:40.087 INFO:teuthology.orchestra.run.smithi155.stdout:[mds] 2024-09-10T08:45:40.087 INFO:teuthology.orchestra.run.smithi155.stdout: debug mds = 20 2024-09-10T08:45:40.087 INFO:teuthology.orchestra.run.smithi155.stdout: debug mds balancer = 20 2024-09-10T08:45:40.087 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2024-09-10T08:45:40.087 INFO:teuthology.orchestra.run.smithi155.stdout: mds debug frag = True 2024-09-10T08:45:40.087 INFO:teuthology.orchestra.run.smithi155.stdout: mds debug scatterstat = True 2024-09-10T08:45:40.087 INFO:teuthology.orchestra.run.smithi155.stdout: mds op complaint time = 180 2024-09-10T08:45:40.087 INFO:teuthology.orchestra.run.smithi155.stdout: mds verify scatter = True 2024-09-10T08:45:40.087 INFO:teuthology.orchestra.run.smithi155.stdout: osd op complaint time = 180 2024-09-10T08:45:40.087 INFO:teuthology.orchestra.run.smithi155.stdout: rados mon op timeout = 900 2024-09-10T08:45:40.087 INFO:teuthology.orchestra.run.smithi155.stdout: rados osd op timeout = 900 2024-09-10T08:45:40.094 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-10T08:45:40.094 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-10T08:45:40.192 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-10T08:45:40.193 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T08:45:40.193 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-10T08:45:40.228 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T08:45:40.228 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-10T08:45:40.302 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi002.front.sepia.ceph.com 2024-09-10T08:45:40.302 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T08:45:40.303 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-10T08:45:40.303 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-10T08:45:40.421 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T08:45:40.421 DEBUG:teuthology.orchestra.run.smithi002:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-10T08:45:40.495 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi155.front.sepia.ceph.com 2024-09-10T08:45:40.496 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-10T08:45:40.496 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-10T08:45:40.496 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-10T08:45:40.576 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-10T08:45:40.576 DEBUG:teuthology.orchestra.run.smithi155:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-10T08:45:40.651 INFO:tasks.ceph:Setting up mon nodes... 2024-09-10T08:45:40.651 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-10T08:45:40.652 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-10T08:45:40.756 INFO:teuthology.orchestra.run.smithi002.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-10T08:45:40.762 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-10T08:45:40.892 INFO:teuthology.orchestra.run.smithi155.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-10T08:45:40.901 INFO:tasks.ceph:Setting up mds nodes... 2024-09-10T08:45:40.901 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-10T08:45:41.005 INFO:teuthology.orchestra.run.smithi002.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-10T08:45:41.010 DEBUG:teuthology.orchestra.run.smithi002:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-10T08:45:41.066 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-10T08:45:41.169 INFO:teuthology.orchestra.run.smithi002.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-10T08:45:41.174 DEBUG:teuthology.orchestra.run.smithi002:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-10T08:45:41.229 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-10T08:45:41.336 INFO:teuthology.orchestra.run.smithi155.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-10T08:45:41.341 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-10T08:45:41.400 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-10T08:45:41.506 INFO:teuthology.orchestra.run.smithi155.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-10T08:45:41.511 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-10T08:45:41.569 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-10T08:45:41.570 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-10T08:45:41.653 INFO:teuthology.orchestra.run.smithi002.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-10T08:45:41.680 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-09-10T08:45:41.761 INFO:teuthology.orchestra.run.smithi002.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-09-10T08:45:41.788 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-10T08:45:41.874 INFO:teuthology.orchestra.run.smithi155.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-10T08:45:41.903 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-09-10T08:45:41.985 INFO:teuthology.orchestra.run.smithi155.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-09-10T08:45:42.012 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-10T08:45:42.012 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi002.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi155.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-10T08:45:42.012 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-10T08:45:42.068 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T08:45:42.068 INFO:tasks.ceph:role: osd.0 2024-09-10T08:45:42.068 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi002.front.sepia.ceph.com 2024-09-10T08:45:42.069 DEBUG:teuthology.orchestra.run.smithi002:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-10T08:45:42.123 INFO:teuthology.orchestra.run.smithi002.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T08:45:42.123 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T08:45:42.123 INFO:teuthology.orchestra.run.smithi002.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T08:45:42.123 INFO:teuthology.orchestra.run.smithi002.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T08:45:42.124 INFO:teuthology.orchestra.run.smithi002.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T08:45:42.124 INFO:teuthology.orchestra.run.smithi002.stdout: = sunit=0 swidth=0 blks 2024-09-10T08:45:42.124 INFO:teuthology.orchestra.run.smithi002.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T08:45:42.124 INFO:teuthology.orchestra.run.smithi002.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T08:45:42.124 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T08:45:42.124 INFO:teuthology.orchestra.run.smithi002.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T08:45:42.157 INFO:teuthology.orchestra.run.smithi002.stdout:Discarding blocks...Done. 2024-09-10T08:45:42.160 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi002.front.sepia.ceph.com -o noatime 2024-09-10T08:45:42.160 DEBUG:teuthology.orchestra.run.smithi002:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-10T08:45:42.240 DEBUG:teuthology.orchestra.run.smithi002:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-10T08:45:42.303 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-10T08:45:42.360 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T08:45:42.360 INFO:tasks.ceph:role: osd.1 2024-09-10T08:45:42.360 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi002.front.sepia.ceph.com 2024-09-10T08:45:42.361 DEBUG:teuthology.orchestra.run.smithi002:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-10T08:45:42.417 INFO:teuthology.orchestra.run.smithi002.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T08:45:42.417 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T08:45:42.417 INFO:teuthology.orchestra.run.smithi002.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T08:45:42.417 INFO:teuthology.orchestra.run.smithi002.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T08:45:42.417 INFO:teuthology.orchestra.run.smithi002.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T08:45:42.417 INFO:teuthology.orchestra.run.smithi002.stdout: = sunit=0 swidth=0 blks 2024-09-10T08:45:42.417 INFO:teuthology.orchestra.run.smithi002.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T08:45:42.417 INFO:teuthology.orchestra.run.smithi002.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T08:45:42.417 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T08:45:42.418 INFO:teuthology.orchestra.run.smithi002.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T08:45:42.449 INFO:teuthology.orchestra.run.smithi002.stdout:Discarding blocks...Done. 2024-09-10T08:45:42.453 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi002.front.sepia.ceph.com -o noatime 2024-09-10T08:45:42.453 DEBUG:teuthology.orchestra.run.smithi002:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-10T08:45:42.533 DEBUG:teuthology.orchestra.run.smithi002:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-10T08:45:42.595 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-10T08:45:42.651 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T08:45:42.651 INFO:tasks.ceph:role: osd.2 2024-09-10T08:45:42.651 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi002.front.sepia.ceph.com 2024-09-10T08:45:42.651 DEBUG:teuthology.orchestra.run.smithi002:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-10T08:45:42.706 INFO:teuthology.orchestra.run.smithi002.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T08:45:42.706 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T08:45:42.707 INFO:teuthology.orchestra.run.smithi002.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T08:45:42.707 INFO:teuthology.orchestra.run.smithi002.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T08:45:42.707 INFO:teuthology.orchestra.run.smithi002.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T08:45:42.707 INFO:teuthology.orchestra.run.smithi002.stdout: = sunit=0 swidth=0 blks 2024-09-10T08:45:42.707 INFO:teuthology.orchestra.run.smithi002.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T08:45:42.707 INFO:teuthology.orchestra.run.smithi002.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T08:45:42.707 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T08:45:42.707 INFO:teuthology.orchestra.run.smithi002.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T08:45:42.739 INFO:teuthology.orchestra.run.smithi002.stdout:Discarding blocks...Done. 2024-09-10T08:45:42.743 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi002.front.sepia.ceph.com -o noatime 2024-09-10T08:45:42.743 DEBUG:teuthology.orchestra.run.smithi002:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-10T08:45:42.824 DEBUG:teuthology.orchestra.run.smithi002:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-10T08:45:42.886 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-10T08:45:42.941 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T08:45:42.941 INFO:tasks.ceph:role: osd.3 2024-09-10T08:45:42.941 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi002.front.sepia.ceph.com 2024-09-10T08:45:42.941 DEBUG:teuthology.orchestra.run.smithi002:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-10T08:45:42.996 INFO:teuthology.orchestra.run.smithi002.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T08:45:42.997 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T08:45:42.997 INFO:teuthology.orchestra.run.smithi002.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T08:45:42.997 INFO:teuthology.orchestra.run.smithi002.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T08:45:42.997 INFO:teuthology.orchestra.run.smithi002.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T08:45:42.997 INFO:teuthology.orchestra.run.smithi002.stdout: = sunit=0 swidth=0 blks 2024-09-10T08:45:42.997 INFO:teuthology.orchestra.run.smithi002.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T08:45:42.997 INFO:teuthology.orchestra.run.smithi002.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T08:45:42.997 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T08:45:42.997 INFO:teuthology.orchestra.run.smithi002.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T08:45:43.030 INFO:teuthology.orchestra.run.smithi002.stdout:Discarding blocks...Done. 2024-09-10T08:45:43.035 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi002.front.sepia.ceph.com -o noatime 2024-09-10T08:45:43.035 DEBUG:teuthology.orchestra.run.smithi002:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-10T08:45:43.114 DEBUG:teuthology.orchestra.run.smithi002:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-10T08:45:43.175 DEBUG:teuthology.orchestra.run.smithi002:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T08:45:43.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:45:43.313+0000 7ff622eef640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-10T08:45:43.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:45:43.314+0000 7ff622eef640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-10T08:45:43.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:45:43.314+0000 7ff622eef640 -1 bdev(0x564b51d49800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-10T08:45:43.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:45:43.314+0000 7ff622eef640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-10T08:45:46.598 DEBUG:teuthology.orchestra.run.smithi002:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-10T08:45:46.660 DEBUG:teuthology.orchestra.run.smithi002:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T08:45:46.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:45:46.752+0000 7fcf18a44640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-10T08:45:46.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:45:46.752+0000 7fcf18a44640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-10T08:45:46.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:45:46.753+0000 7fcf18a44640 -1 bdev(0x55687c653800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-10T08:45:46.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:45:46.753+0000 7fcf18a44640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-10T08:45:49.771 DEBUG:teuthology.orchestra.run.smithi002:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-10T08:45:49.833 DEBUG:teuthology.orchestra.run.smithi002:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T08:45:49.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:45:49.926+0000 7fd6ae20d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-10T08:45:49.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:45:49.926+0000 7fd6ae20d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-10T08:45:49.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:45:49.926+0000 7fd6ae20d640 -1 bdev(0x564622e23800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-10T08:45:49.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:45:49.927+0000 7fd6ae20d640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-10T08:45:52.935 DEBUG:teuthology.orchestra.run.smithi002:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-10T08:45:52.995 DEBUG:teuthology.orchestra.run.smithi002:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T08:45:53.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:45:53.088+0000 7fc7f69d9640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-10T08:45:53.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:45:53.088+0000 7fc7f69d9640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-10T08:45:53.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:45:53.088+0000 7fc7f69d9640 -1 bdev(0x559054eab800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-10T08:45:53.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:45:53.089+0000 7fc7f69d9640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-10T08:45:56.106 DEBUG:teuthology.orchestra.run.smithi002:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-10T08:45:56.166 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-10T08:45:56.229 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T08:45:56.229 INFO:tasks.ceph:role: osd.4 2024-09-10T08:45:56.229 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi155.front.sepia.ceph.com 2024-09-10T08:45:56.229 DEBUG:teuthology.orchestra.run.smithi155:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-10T08:45:56.294 INFO:teuthology.orchestra.run.smithi155.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T08:45:56.294 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T08:45:56.294 INFO:teuthology.orchestra.run.smithi155.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T08:45:56.294 INFO:teuthology.orchestra.run.smithi155.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T08:45:56.295 INFO:teuthology.orchestra.run.smithi155.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T08:45:56.295 INFO:teuthology.orchestra.run.smithi155.stdout: = sunit=0 swidth=0 blks 2024-09-10T08:45:56.295 INFO:teuthology.orchestra.run.smithi155.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T08:45:56.295 INFO:teuthology.orchestra.run.smithi155.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T08:45:56.295 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T08:45:56.295 INFO:teuthology.orchestra.run.smithi155.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T08:45:56.710 INFO:teuthology.orchestra.run.smithi155.stdout:Discarding blocks...Done. 2024-09-10T08:45:56.714 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi155.front.sepia.ceph.com -o noatime 2024-09-10T08:45:56.714 DEBUG:teuthology.orchestra.run.smithi155:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-10T08:45:56.852 DEBUG:teuthology.orchestra.run.smithi155:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-10T08:45:56.920 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-10T08:45:56.977 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T08:45:56.977 INFO:tasks.ceph:role: osd.5 2024-09-10T08:45:56.977 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi155.front.sepia.ceph.com 2024-09-10T08:45:56.977 DEBUG:teuthology.orchestra.run.smithi155:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-10T08:45:57.041 INFO:teuthology.orchestra.run.smithi155.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T08:45:57.041 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T08:45:57.041 INFO:teuthology.orchestra.run.smithi155.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T08:45:57.041 INFO:teuthology.orchestra.run.smithi155.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T08:45:57.041 INFO:teuthology.orchestra.run.smithi155.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T08:45:57.041 INFO:teuthology.orchestra.run.smithi155.stdout: = sunit=0 swidth=0 blks 2024-09-10T08:45:57.041 INFO:teuthology.orchestra.run.smithi155.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T08:45:57.041 INFO:teuthology.orchestra.run.smithi155.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T08:45:57.041 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T08:45:57.042 INFO:teuthology.orchestra.run.smithi155.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T08:45:57.397 INFO:teuthology.orchestra.run.smithi155.stdout:Discarding blocks...Done. 2024-09-10T08:45:57.401 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi155.front.sepia.ceph.com -o noatime 2024-09-10T08:45:57.401 DEBUG:teuthology.orchestra.run.smithi155:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-10T08:45:57.487 DEBUG:teuthology.orchestra.run.smithi155:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-10T08:45:57.549 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-10T08:45:57.606 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T08:45:57.606 INFO:tasks.ceph:role: osd.6 2024-09-10T08:45:57.606 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi155.front.sepia.ceph.com 2024-09-10T08:45:57.606 DEBUG:teuthology.orchestra.run.smithi155:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-10T08:45:57.671 INFO:teuthology.orchestra.run.smithi155.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T08:45:57.671 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T08:45:57.671 INFO:teuthology.orchestra.run.smithi155.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T08:45:57.671 INFO:teuthology.orchestra.run.smithi155.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T08:45:57.671 INFO:teuthology.orchestra.run.smithi155.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T08:45:57.671 INFO:teuthology.orchestra.run.smithi155.stdout: = sunit=0 swidth=0 blks 2024-09-10T08:45:57.671 INFO:teuthology.orchestra.run.smithi155.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T08:45:57.672 INFO:teuthology.orchestra.run.smithi155.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T08:45:57.672 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T08:45:57.672 INFO:teuthology.orchestra.run.smithi155.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T08:45:58.052 INFO:teuthology.orchestra.run.smithi155.stdout:Discarding blocks...Done. 2024-09-10T08:45:58.056 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi155.front.sepia.ceph.com -o noatime 2024-09-10T08:45:58.056 DEBUG:teuthology.orchestra.run.smithi155:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-10T08:45:58.160 DEBUG:teuthology.orchestra.run.smithi155:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-10T08:45:58.226 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-10T08:45:58.282 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T08:45:58.282 INFO:tasks.ceph:role: osd.7 2024-09-10T08:45:58.282 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi155.front.sepia.ceph.com 2024-09-10T08:45:58.282 DEBUG:teuthology.orchestra.run.smithi155:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-10T08:45:58.347 INFO:teuthology.orchestra.run.smithi155.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T08:45:58.347 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T08:45:58.348 INFO:teuthology.orchestra.run.smithi155.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T08:45:58.348 INFO:teuthology.orchestra.run.smithi155.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-10T08:45:58.348 INFO:teuthology.orchestra.run.smithi155.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T08:45:58.348 INFO:teuthology.orchestra.run.smithi155.stdout: = sunit=0 swidth=0 blks 2024-09-10T08:45:58.348 INFO:teuthology.orchestra.run.smithi155.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T08:45:58.349 INFO:teuthology.orchestra.run.smithi155.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-10T08:45:58.349 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T08:45:58.349 INFO:teuthology.orchestra.run.smithi155.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T08:45:58.762 INFO:teuthology.orchestra.run.smithi155.stdout:Discarding blocks...Done. 2024-09-10T08:45:58.768 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi155.front.sepia.ceph.com -o noatime 2024-09-10T08:45:58.768 DEBUG:teuthology.orchestra.run.smithi155:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-10T08:45:58.907 DEBUG:teuthology.orchestra.run.smithi155:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-10T08:45:58.971 DEBUG:teuthology.orchestra.run.smithi155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T08:45:59.079 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:45:59.079+0000 7f928e61a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-10T08:45:59.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:45:59.080+0000 7f928e61a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-10T08:45:59.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:45:59.080+0000 7f928e61a640 -1 bdev(0x563ec623b800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-10T08:45:59.080 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:45:59.080+0000 7f928e61a640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-10T08:46:02.125 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-10T08:46:02.182 DEBUG:teuthology.orchestra.run.smithi155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T08:46:02.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:02.272+0000 7f30ac031640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-10T08:46:02.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:02.273+0000 7f30ac031640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-10T08:46:02.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:02.273+0000 7f30ac031640 -1 bdev(0x55d91cfcd800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-10T08:46:02.273 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:02.273+0000 7f30ac031640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-10T08:46:05.312 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-10T08:46:05.369 DEBUG:teuthology.orchestra.run.smithi155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T08:46:05.459 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:05.459+0000 7f7cdf40c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-10T08:46:05.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:05.460+0000 7f7cdf40c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-10T08:46:05.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:05.460+0000 7f7cdf40c640 -1 bdev(0x555b73541800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-10T08:46:05.460 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:05.460+0000 7f7cdf40c640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-10T08:46:07.588 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:46:07.593 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:46:08.722 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-10T08:46:08.779 DEBUG:teuthology.orchestra.run.smithi155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T08:46:08.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:08.869+0000 7f5540bdd640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-10T08:46:08.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:08.870+0000 7f5540bdd640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-10T08:46:08.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:08.870+0000 7f5540bdd640 -1 bdev(0x5606e4d1f800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-10T08:46:08.870 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:08.870+0000 7f5540bdd640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-10T08:46:11.875 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-10T08:46:11.933 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-10T08:46:11.933 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T08:46:11.933 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-10T08:46:11.997 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T08:46:11.997 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-10T08:46:12.095 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T08:46:12.095 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-10T08:46:12.191 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T08:46:12.191 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-10T08:46:12.286 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T08:46:12.286 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-10T08:46:12.381 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T08:46:12.381 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-10T08:46:12.476 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T08:46:12.476 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-10T08:46:12.572 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-10T08:46:12.572 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-10T08:46:12.635 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-10T08:46:12.635 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-10T08:46:12.733 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-10T08:46:12.734 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-10T08:46:12.830 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-10T08:46:12.830 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-10T08:46:12.925 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-10T08:46:12.926 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-10T08:46:13.021 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-10T08:46:13.021 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-10T08:46:13.116 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-10T08:46:13.116 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-10T08:46:13.211 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T08:46:13.211 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-10T08:46:13.251 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T08:46:13.251 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-09-10T08:46:13.329 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-10T08:46:13.329 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-10T08:46:13.364 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-10T08:46:13.364 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-09-10T08:46:13.440 INFO:tasks.ceph:Adding keys to all mons... 2024-09-10T08:46:13.440 DEBUG:teuthology.orchestra.run.smithi002:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-10T08:46:13.444 DEBUG:teuthology.orchestra.run.smithi155:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-10T08:46:13.496 INFO:teuthology.orchestra.run.smithi002.stdout:[mgr.y] 2024-09-10T08:46:13.496 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQA0B+BmwlgbLRAAkqvP1xOF2u1HvHJJ83akSQ== 2024-09-10T08:46:13.496 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.a] 2024-09-10T08:46:13.496 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQA1B+BmEVRhABAA8jfjpX9lvikdox7CR8zSCg== 2024-09-10T08:46:13.496 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.c] 2024-09-10T08:46:13.496 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQA1B+BmS64iChAAFZZOEpnV/8hKcMm8FsyqaQ== 2024-09-10T08:46:13.496 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.0] 2024-09-10T08:46:13.496 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQA3B+Bmiim9EhAA+HiARCGbkniPIJ8MhzOjpA== 2024-09-10T08:46:13.496 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.1] 2024-09-10T08:46:13.497 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQA6B+BmDx73LBAAoKZSnY1Qaqolkj9Yzq1cAg== 2024-09-10T08:46:13.497 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.2] 2024-09-10T08:46:13.497 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQA9B+BmBVpTNxAAnPBoBFkC/MSP/GAXZFcbuw== 2024-09-10T08:46:13.497 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.3] 2024-09-10T08:46:13.497 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQBBB+Bmt6tfBRAAXTfRz7dGEqtzOnFwr7WX6g== 2024-09-10T08:46:13.497 INFO:teuthology.orchestra.run.smithi002.stdout:[mgr.x] 2024-09-10T08:46:13.497 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQA0B+BmYLRANRAAy4BZ/nE9vytgN98l8ltTqA== 2024-09-10T08:46:13.497 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.b] 2024-09-10T08:46:13.497 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQA1B+BmsZkXFBAAG3SVjh3zdn5K3GMN3FXkbQ== 2024-09-10T08:46:13.497 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.d] 2024-09-10T08:46:13.497 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQA1B+Bm7bkzHhAAkPguX9SLuN+yCHnua4ZRnA== 2024-09-10T08:46:13.497 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.4] 2024-09-10T08:46:13.498 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQBHB+BmDJrLBBAAykb4iQOnFAxc3UoWpKsl5Q== 2024-09-10T08:46:13.498 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.5] 2024-09-10T08:46:13.498 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQBKB+BmOM9QEBAAeqFkW1v4h1IJOQw/pLYYbw== 2024-09-10T08:46:13.498 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.6] 2024-09-10T08:46:13.498 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQBNB+Bm6PhuGxAACnqiol+6kzbqqYRdOAD3vw== 2024-09-10T08:46:13.498 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.7] 2024-09-10T08:46:13.498 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQBQB+BmOj/lMxAA5l5RGbrqLbPLTHslAT8fuA== 2024-09-10T08:46:13.498 INFO:teuthology.orchestra.run.smithi002.stdout:[client.0] 2024-09-10T08:46:13.498 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQA1B+Bmtsv1JhAAUIdP6HQM/8FYI9fUbtrLmw== 2024-09-10T08:46:13.498 INFO:teuthology.orchestra.run.smithi002.stdout:[client.2] 2024-09-10T08:46:13.498 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQA1B+Bm1I9rLRAAbflFrTJ2wgprqehY/bhyOg== 2024-09-10T08:46:13.498 INFO:teuthology.orchestra.run.smithi002.stdout:[client.1] 2024-09-10T08:46:13.498 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQA1B+Bmna4pNBAAukbWPsLviCm0X4GnOfJ03g== 2024-09-10T08:46:13.499 INFO:teuthology.orchestra.run.smithi002.stdout:[client.3] 2024-09-10T08:46:13.499 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQA1B+BmXP/DOhAAi4c5yj2RVc9D23jd1ti7iw== 2024-09-10T08:46:13.533 INFO:teuthology.orchestra.run.smithi155.stdout:[mgr.y] 2024-09-10T08:46:13.533 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQA0B+BmwlgbLRAAkqvP1xOF2u1HvHJJ83akSQ== 2024-09-10T08:46:13.533 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.a] 2024-09-10T08:46:13.533 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQA1B+BmEVRhABAA8jfjpX9lvikdox7CR8zSCg== 2024-09-10T08:46:13.533 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.c] 2024-09-10T08:46:13.533 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQA1B+BmS64iChAAFZZOEpnV/8hKcMm8FsyqaQ== 2024-09-10T08:46:13.533 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.0] 2024-09-10T08:46:13.533 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQA3B+Bmiim9EhAA+HiARCGbkniPIJ8MhzOjpA== 2024-09-10T08:46:13.533 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.1] 2024-09-10T08:46:13.534 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQA6B+BmDx73LBAAoKZSnY1Qaqolkj9Yzq1cAg== 2024-09-10T08:46:13.534 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.2] 2024-09-10T08:46:13.534 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQA9B+BmBVpTNxAAnPBoBFkC/MSP/GAXZFcbuw== 2024-09-10T08:46:13.534 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.3] 2024-09-10T08:46:13.534 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBBB+Bmt6tfBRAAXTfRz7dGEqtzOnFwr7WX6g== 2024-09-10T08:46:13.534 INFO:teuthology.orchestra.run.smithi155.stdout:[mgr.x] 2024-09-10T08:46:13.534 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQA0B+BmYLRANRAAy4BZ/nE9vytgN98l8ltTqA== 2024-09-10T08:46:13.534 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.b] 2024-09-10T08:46:13.534 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQA1B+BmsZkXFBAAG3SVjh3zdn5K3GMN3FXkbQ== 2024-09-10T08:46:13.534 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.d] 2024-09-10T08:46:13.534 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQA1B+Bm7bkzHhAAkPguX9SLuN+yCHnua4ZRnA== 2024-09-10T08:46:13.534 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.4] 2024-09-10T08:46:13.535 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBHB+BmDJrLBBAAykb4iQOnFAxc3UoWpKsl5Q== 2024-09-10T08:46:13.535 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.5] 2024-09-10T08:46:13.535 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBKB+BmOM9QEBAAeqFkW1v4h1IJOQw/pLYYbw== 2024-09-10T08:46:13.535 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.6] 2024-09-10T08:46:13.535 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBNB+Bm6PhuGxAACnqiol+6kzbqqYRdOAD3vw== 2024-09-10T08:46:13.535 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.7] 2024-09-10T08:46:13.535 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBQB+BmOj/lMxAA5l5RGbrqLbPLTHslAT8fuA== 2024-09-10T08:46:13.535 INFO:teuthology.orchestra.run.smithi155.stdout:[client.0] 2024-09-10T08:46:13.535 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQA1B+Bmtsv1JhAAUIdP6HQM/8FYI9fUbtrLmw== 2024-09-10T08:46:13.535 INFO:teuthology.orchestra.run.smithi155.stdout:[client.2] 2024-09-10T08:46:13.535 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQA1B+Bm1I9rLRAAbflFrTJ2wgprqehY/bhyOg== 2024-09-10T08:46:13.535 INFO:teuthology.orchestra.run.smithi155.stdout:[client.1] 2024-09-10T08:46:13.535 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQA1B+Bmna4pNBAAukbWPsLviCm0X4GnOfJ03g== 2024-09-10T08:46:13.536 INFO:teuthology.orchestra.run.smithi155.stdout:[client.3] 2024-09-10T08:46:13.536 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQA1B+BmXP/DOhAAi4c5yj2RVc9D23jd1ti7iw== 2024-09-10T08:46:13.537 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-10T08:46:13.544 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-10T08:46:13.671 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T08:46:13.675 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T08:46:13.771 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T08:46:13.775 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T08:46:13.872 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T08:46:13.876 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T08:46:13.970 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T08:46:13.974 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T08:46:14.068 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T08:46:14.072 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T08:46:14.165 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T08:46:14.169 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T08:46:14.262 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-10T08:46:14.266 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-10T08:46:14.360 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T08:46:14.364 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T08:46:14.461 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T08:46:14.465 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-10T08:46:14.562 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T08:46:14.566 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T08:46:14.662 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T08:46:14.674 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T08:46:14.772 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T08:46:14.777 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T08:46:14.870 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T08:46:14.875 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T08:46:14.968 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T08:46:14.972 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T08:46:15.068 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T08:46:15.073 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T08:46:15.170 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T08:46:15.173 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T08:46:15.270 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T08:46:15.274 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T08:46:15.370 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-10T08:46:15.371 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-10T08:46:15.427 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-10T08:46:15.535 DEBUG:teuthology.orchestra.run.smithi002:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-10T08:46:15.591 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-10T08:46:15.647 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-10T08:46:15.755 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-10T08:46:15.810 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-10T08:46:15.866 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-10T08:46:15.972 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-10T08:46:16.028 DEBUG:teuthology.orchestra.run.smithi002:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-10T08:46:16.032 DEBUG:teuthology.orchestra.run.smithi155:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-10T08:46:16.066 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-10T08:46:16.067 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-10T08:46:16.067 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-10T08:46:16.109 INFO:tasks.ceph.mon.a:Started 2024-09-10T08:46:16.109 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-10T08:46:16.110 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-10T08:46:16.113 INFO:tasks.ceph.mon.b:Started 2024-09-10T08:46:16.114 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-10T08:46:16.114 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-10T08:46:16.117 INFO:tasks.ceph.mon.c:Started 2024-09-10T08:46:16.117 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-10T08:46:16.117 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-10T08:46:16.118 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-10T08:46:16.121 INFO:tasks.ceph.mgr.y:Started 2024-09-10T08:46:16.121 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-10T08:46:16.121 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-10T08:46:16.125 INFO:tasks.ceph.mgr.x:Started 2024-09-10T08:46:16.125 INFO:tasks.ceph:Setting crush tunables to default 2024-09-10T08:46:16.125 DEBUG:teuthology.orchestra.run.smithi002:> sudo ceph --cluster ceph osd crush tunables default 2024-09-10T08:46:16.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:16.280+0000 7f277bc00640 1 Processor -- start 2024-09-10T08:46:16.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:16.280+0000 7f277bc00640 1 -- start start 2024-09-10T08:46:16.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:16.281+0000 7f277bc00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27740d2d30 0x7f27740cf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:16.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:16.281+0000 7f277bc00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27740cfba0 con 0x7f2774161ca0 2024-09-10T08:46:16.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:16.281+0000 7f277bc00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27740cfe50 con 0x7f27740cf6f0 2024-09-10T08:46:16.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:16.281+0000 7f277bc00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f27740d34a0 con 0x7f27740d2d30 2024-09-10T08:46:16.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:16.282+0000 7f2779200640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f2774161ca0 0x7f27740d2620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:54288/0 (socket says 172.21.15.2:54288) 2024-09-10T08:46:16.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:16.282+0000 7f2779200640 1 -- 172.21.15.2:0/1256148864 learned_addr learned my addr 172.21.15.2:0/1256148864 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:46:16.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:16.282+0000 7f2773e00640 1 --2- 172.21.15.2:0/1256148864 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27740d2d30 0x7f27740cf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:16.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:16.282+0000 7f2773e00640 1 -- 172.21.15.2:0/1256148864 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27740d2d30 msgr2=0x7f27740cf1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-10T08:46:16.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:16.282+0000 7f2773e00640 1 -- 172.21.15.2:0/1256148864 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27740d2d30 msgr2=0x7f27740cf1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:46:16.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:16.282+0000 7f2773e00640 1 --2- 172.21.15.2:0/1256148864 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27740d2d30 0x7f27740cf1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:46:16.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:16.282+0000 7f2773e00640 1 --2- 172.21.15.2:0/1256148864 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27740d2d30 0x7f27740cf1b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:46:16.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:16.483+0000 7f2773e00640 1 --2- 172.21.15.2:0/1256148864 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27740d2d30 0x7f27740cf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:16.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:16.483+0000 7f2773e00640 1 -- 172.21.15.2:0/1256148864 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27740d2d30 msgr2=0x7f27740cf1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-10T08:46:16.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:16.483+0000 7f2773e00640 1 -- 172.21.15.2:0/1256148864 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27740d2d30 msgr2=0x7f27740cf1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:46:16.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:16.483+0000 7f2773e00640 1 --2- 172.21.15.2:0/1256148864 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27740d2d30 0x7f27740cf1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:46:16.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:16.483+0000 7f2773e00640 1 --2- 172.21.15.2:0/1256148864 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27740d2d30 0x7f27740cf1b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:46:16.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:16.884+0000 7f2773e00640 1 --2- 172.21.15.2:0/1256148864 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27740d2d30 0x7f27740cf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:16.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:16.884+0000 7f2773e00640 1 -- 172.21.15.2:0/1256148864 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27740d2d30 msgr2=0x7f27740cf1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-10T08:46:16.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:16.884+0000 7f2773e00640 1 -- 172.21.15.2:0/1256148864 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27740d2d30 msgr2=0x7f27740cf1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:46:16.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:16.884+0000 7f2773e00640 1 --2- 172.21.15.2:0/1256148864 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27740d2d30 0x7f27740cf1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:46:16.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:16.884+0000 7f2773e00640 1 --2- 172.21.15.2:0/1256148864 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27740d2d30 0x7f27740cf1b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T08:46:17.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:17.686+0000 7f2773e00640 1 --2- 172.21.15.2:0/1256148864 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27740d2d30 0x7f27740cf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:17.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:17.686+0000 7f2773e00640 1 -- 172.21.15.2:0/1256148864 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27740d2d30 msgr2=0x7f27740cf1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-10T08:46:17.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:17.686+0000 7f2773e00640 1 -- 172.21.15.2:0/1256148864 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27740d2d30 msgr2=0x7f27740cf1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:46:17.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:17.686+0000 7f2773e00640 1 --2- 172.21.15.2:0/1256148864 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27740d2d30 0x7f27740cf1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:46:17.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:17.686+0000 7f2773e00640 1 --2- 172.21.15.2:0/1256148864 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27740d2d30 0x7f27740cf1b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T08:46:19.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:19.282+0000 7f2772000640 1 -- 172.21.15.2:0/1256148864 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27740d2d30 msgr2=0x7f27740cf1b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:46:19.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:19.282+0000 7f2772000640 1 --2- 172.21.15.2:0/1256148864 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27740d2d30 0x7f27740cf1b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:19.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:19.282+0000 7f2772000640 1 -- 172.21.15.2:0/1256148864 >> v1:172.21.15.155:6789/0 conn(0x7f27740cf6f0 legacy=0x7f277406d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:19.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:19.282+0000 7f2772000640 1 -- 172.21.15.2:0/1256148864 >> v1:172.21.15.2:6789/0 conn(0x7f2774161ca0 legacy=0x7f27740d2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:19.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:19.282+0000 7f2772000640 1 --2- 172.21.15.2:0/1256148864 >> v2:172.21.15.2:3300/0 conn(0x7f27540036f0 0x7f2754005b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:19.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:19.282+0000 7f2772000640 1 --2- 172.21.15.2:0/1256148864 >> v2:172.21.15.155:3300/0 conn(0x7f27540061c0 0x7f2754008680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:19.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:19.282+0000 7f2772000640 1 -- 172.21.15.2:0/1256148864 --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f2754008d10 con 0x7f27540036f0 2024-09-10T08:46:19.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:19.282+0000 7f2772000640 1 -- 172.21.15.2:0/1256148864 --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f2754008ec0 con 0x7f27540061c0 2024-09-10T08:46:19.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:19.282+0000 7f2779200640 1 --2- 172.21.15.2:0/1256148864 >> v2:172.21.15.2:3300/0 conn(0x7f27540036f0 0x7f2754005b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:19.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:19.282+0000 7f2773e00640 1 --2- 172.21.15.2:0/1256148864 >> v2:172.21.15.155:3300/0 conn(0x7f27540061c0 0x7f2754008680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:19.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:19.282+0000 7f2773e00640 1 -- 172.21.15.2:0/1256148864 >> v2:172.21.15.155:3300/0 conn(0x7f27540061c0 msgr2=0x7f2754008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:46:19.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:19.282+0000 7f2773e00640 1 -- 172.21.15.2:0/1256148864 >> v2:172.21.15.155:3300/0 conn(0x7f27540061c0 msgr2=0x7f2754008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:46:19.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:19.282+0000 7f2773e00640 1 --2- 172.21.15.2:0/1256148864 >> v2:172.21.15.155:3300/0 conn(0x7f27540061c0 0x7f2754008680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:46:19.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:19.282+0000 7f2779200640 1 -- 172.21.15.2:0/1256148864 >> v2:172.21.15.2:3300/0 conn(0x7f27540036f0 msgr2=0x7f2754005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:46:19.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:19.283+0000 7f2779200640 1 -- 172.21.15.2:0/1256148864 >> v2:172.21.15.2:3300/0 conn(0x7f27540036f0 msgr2=0x7f2754005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:46:19.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:19.283+0000 7f2779200640 1 --2- 172.21.15.2:0/1256148864 >> v2:172.21.15.2:3300/0 conn(0x7f27540036f0 0x7f2754005b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:46:19.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:19.283+0000 7f2773e00640 1 --2- 172.21.15.2:0/1256148864 >> v2:172.21.15.155:3300/0 conn(0x7f27540061c0 0x7f2754008680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:46:19.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:19.283+0000 7f2779200640 1 --2- 172.21.15.2:0/1256148864 >> v2:172.21.15.2:3300/0 conn(0x7f27540036f0 0x7f2754005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:46:19.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:19.484+0000 7f2779200640 1 --2- 172.21.15.2:0/1256148864 >> v2:172.21.15.2:3300/0 conn(0x7f27540036f0 0x7f2754005b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:19.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:19.484+0000 7f2773e00640 1 --2- 172.21.15.2:0/1256148864 >> v2:172.21.15.155:3300/0 conn(0x7f27540061c0 0x7f2754008680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:19.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:19.484+0000 7f2779200640 1 -- 172.21.15.2:0/1256148864 >> v2:172.21.15.2:3300/0 conn(0x7f27540036f0 msgr2=0x7f2754005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:46:19.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:19.484+0000 7f2779200640 1 -- 172.21.15.2:0/1256148864 >> v2:172.21.15.2:3300/0 conn(0x7f27540036f0 msgr2=0x7f2754005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:46:19.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:19.484+0000 7f2779200640 1 --2- 172.21.15.2:0/1256148864 >> v2:172.21.15.2:3300/0 conn(0x7f27540036f0 0x7f2754005b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:46:19.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:19.484+0000 7f2779200640 1 --2- 172.21.15.2:0/1256148864 >> v2:172.21.15.2:3300/0 conn(0x7f27540036f0 0x7f2754005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:46:19.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:19.484+0000 7f2773e00640 1 -- 172.21.15.2:0/1256148864 >> v2:172.21.15.155:3300/0 conn(0x7f27540061c0 msgr2=0x7f2754008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:46:19.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:19.484+0000 7f2773e00640 1 -- 172.21.15.2:0/1256148864 >> v2:172.21.15.155:3300/0 conn(0x7f27540061c0 msgr2=0x7f2754008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:46:19.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:19.484+0000 7f2773e00640 1 --2- 172.21.15.2:0/1256148864 >> v2:172.21.15.155:3300/0 conn(0x7f27540061c0 0x7f2754008680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:46:19.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:19.484+0000 7f2773e00640 1 --2- 172.21.15.2:0/1256148864 >> v2:172.21.15.155:3300/0 conn(0x7f27540061c0 0x7f2754008680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:46:19.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:19.885+0000 7f2779200640 1 --2- 172.21.15.2:0/1256148864 >> v2:172.21.15.2:3300/0 conn(0x7f27540036f0 0x7f2754005b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:19.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:19.885+0000 7f2773e00640 1 --2- 172.21.15.2:0/1256148864 >> v2:172.21.15.155:3300/0 conn(0x7f27540061c0 0x7f2754008680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:19.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:19.885+0000 7f2779200640 1 -- 172.21.15.2:0/1256148864 >> v2:172.21.15.2:3300/0 conn(0x7f27540036f0 msgr2=0x7f2754005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:46:19.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:19.885+0000 7f2779200640 1 -- 172.21.15.2:0/1256148864 >> v2:172.21.15.2:3300/0 conn(0x7f27540036f0 msgr2=0x7f2754005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:46:19.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:19.885+0000 7f2779200640 1 --2- 172.21.15.2:0/1256148864 >> v2:172.21.15.2:3300/0 conn(0x7f27540036f0 0x7f2754005b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:46:19.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:19.885+0000 7f2779200640 1 --2- 172.21.15.2:0/1256148864 >> v2:172.21.15.2:3300/0 conn(0x7f27540036f0 0x7f2754005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T08:46:19.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:19.886+0000 7f2773e00640 1 -- 172.21.15.2:0/1256148864 >> v2:172.21.15.155:3300/0 conn(0x7f27540061c0 msgr2=0x7f2754008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:46:19.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:19.886+0000 7f2773e00640 1 -- 172.21.15.2:0/1256148864 >> v2:172.21.15.155:3300/0 conn(0x7f27540061c0 msgr2=0x7f2754008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:46:19.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:19.886+0000 7f2773e00640 1 --2- 172.21.15.2:0/1256148864 >> v2:172.21.15.155:3300/0 conn(0x7f27540061c0 0x7f2754008680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:46:19.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:19.886+0000 7f2773e00640 1 --2- 172.21.15.2:0/1256148864 >> v2:172.21.15.155:3300/0 conn(0x7f27540061c0 0x7f2754008680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T08:46:20.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:20.687+0000 7f2779200640 1 --2- 172.21.15.2:0/1256148864 >> v2:172.21.15.2:3300/0 conn(0x7f27540036f0 0x7f2754005b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:20.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:20.687+0000 7f2779200640 1 -- 172.21.15.2:0/1256148864 >> v2:172.21.15.2:3300/0 conn(0x7f27540036f0 msgr2=0x7f2754005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:46:20.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:20.687+0000 7f2779200640 1 -- 172.21.15.2:0/1256148864 >> v2:172.21.15.2:3300/0 conn(0x7f27540036f0 msgr2=0x7f2754005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:46:20.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:20.687+0000 7f2779200640 1 --2- 172.21.15.2:0/1256148864 >> v2:172.21.15.2:3300/0 conn(0x7f27540036f0 0x7f2754005b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:46:20.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:20.687+0000 7f2773e00640 1 --2- 172.21.15.2:0/1256148864 >> v2:172.21.15.155:3300/0 conn(0x7f27540061c0 0x7f2754008680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:20.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:20.687+0000 7f2779200640 1 --2- 172.21.15.2:0/1256148864 >> v2:172.21.15.2:3300/0 conn(0x7f27540036f0 0x7f2754005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T08:46:20.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:20.687+0000 7f2773e00640 1 -- 172.21.15.2:0/1256148864 >> v2:172.21.15.155:3300/0 conn(0x7f27540061c0 msgr2=0x7f2754008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:46:20.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:20.687+0000 7f2773e00640 1 -- 172.21.15.2:0/1256148864 >> v2:172.21.15.155:3300/0 conn(0x7f27540061c0 msgr2=0x7f2754008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:46:20.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:20.687+0000 7f2773e00640 1 --2- 172.21.15.2:0/1256148864 >> v2:172.21.15.155:3300/0 conn(0x7f27540061c0 0x7f2754008680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:46:20.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:20.687+0000 7f2773e00640 1 --2- 172.21.15.2:0/1256148864 >> v2:172.21.15.155:3300/0 conn(0x7f27540061c0 0x7f2754008680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T08:46:22.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:22.283+0000 7f2772000640 1 -- 172.21.15.2:0/1256148864 >> v2:172.21.15.155:3300/0 conn(0x7f27540061c0 msgr2=0x7f2754008680 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:46:22.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:22.283+0000 7f2772000640 1 --2- 172.21.15.2:0/1256148864 >> v2:172.21.15.155:3300/0 conn(0x7f27540061c0 0x7f2754008680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:22.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:22.283+0000 7f2772000640 1 -- 172.21.15.2:0/1256148864 >> v2:172.21.15.2:3300/0 conn(0x7f27540036f0 msgr2=0x7f2754005b70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:46:22.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:22.283+0000 7f2772000640 1 --2- 172.21.15.2:0/1256148864 >> v2:172.21.15.2:3300/0 conn(0x7f27540036f0 0x7f2754005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:22.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:22.283+0000 7f2779c00640 1 -- 172.21.15.2:0/1256148864 reap_dead start 2024-09-10T08:46:22.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:22.283+0000 7f2772000640 1 --2- 172.21.15.2:0/1256148864 >> v2:172.21.15.155:3300/0 conn(0x7f27540061c0 0x7f2754008680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:22.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:22.283+0000 7f2772000640 1 -- 172.21.15.2:0/1256148864 --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27740d0130 con 0x7f2774161ca0 2024-09-10T08:46:22.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:22.283+0000 7f2772000640 1 -- 172.21.15.2:0/1256148864 --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2754003b60 con 0x7f27740cf6f0 2024-09-10T08:46:22.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:22.283+0000 7f2772000640 1 -- 172.21.15.2:0/1256148864 --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f2754008d10 con 0x7f27540061c0 2024-09-10T08:46:22.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:22.283+0000 7f2779c00640 1 --2- 172.21.15.2:0/1256148864 >> v2:172.21.15.155:3300/0 conn(0x7f27540061c0 0x7f2754008680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:22.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:22.283+0000 7f2779c00640 1 -- 172.21.15.2:0/1256148864 >> v2:172.21.15.155:3300/0 conn(0x7f27540061c0 msgr2=0x7f2754008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-10T08:46:22.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:22.283+0000 7f2779c00640 1 -- 172.21.15.2:0/1256148864 >> v2:172.21.15.155:3300/0 conn(0x7f27540061c0 msgr2=0x7f2754008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:46:22.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:22.283+0000 7f2779c00640 1 --2- 172.21.15.2:0/1256148864 >> v2:172.21.15.155:3300/0 conn(0x7f27540061c0 0x7f2754008680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:46:22.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:22.283+0000 7f2779c00640 1 --2- 172.21.15.2:0/1256148864 >> v2:172.21.15.155:3300/0 conn(0x7f27540061c0 0x7f2754008680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:46:22.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:22.484+0000 7f2779c00640 1 --2- 172.21.15.2:0/1256148864 >> v2:172.21.15.155:3300/0 conn(0x7f27540061c0 0x7f2754008680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:22.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:22.484+0000 7f2779c00640 1 -- 172.21.15.2:0/1256148864 >> v2:172.21.15.155:3300/0 conn(0x7f27540061c0 msgr2=0x7f2754008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-10T08:46:22.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:22.484+0000 7f2779c00640 1 -- 172.21.15.2:0/1256148864 >> v2:172.21.15.155:3300/0 conn(0x7f27540061c0 msgr2=0x7f2754008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:46:22.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:22.484+0000 7f2779c00640 1 --2- 172.21.15.2:0/1256148864 >> v2:172.21.15.155:3300/0 conn(0x7f27540061c0 0x7f2754008680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:46:22.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:22.484+0000 7f2779c00640 1 --2- 172.21.15.2:0/1256148864 >> v2:172.21.15.155:3300/0 conn(0x7f27540061c0 0x7f2754008680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:46:22.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:22.885+0000 7f2779c00640 1 --2- 172.21.15.2:0/1256148864 >> v2:172.21.15.155:3300/0 conn(0x7f27540061c0 0x7f2754008680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:22.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:22.885+0000 7f2779c00640 1 -- 172.21.15.2:0/1256148864 >> v2:172.21.15.155:3300/0 conn(0x7f27540061c0 msgr2=0x7f2754008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-10T08:46:22.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:22.885+0000 7f2779c00640 1 -- 172.21.15.2:0/1256148864 >> v2:172.21.15.155:3300/0 conn(0x7f27540061c0 msgr2=0x7f2754008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:46:22.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:22.885+0000 7f2779c00640 1 --2- 172.21.15.2:0/1256148864 >> v2:172.21.15.155:3300/0 conn(0x7f27540061c0 0x7f2754008680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:46:22.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:22.885+0000 7f2779c00640 1 --2- 172.21.15.2:0/1256148864 >> v2:172.21.15.155:3300/0 conn(0x7f27540061c0 0x7f2754008680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T08:46:23.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:23.687+0000 7f2779c00640 1 --2- 172.21.15.2:0/1256148864 >> v2:172.21.15.155:3300/0 conn(0x7f27540061c0 0x7f2754008680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:23.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:23.687+0000 7f2779c00640 1 -- 172.21.15.2:0/1256148864 >> v2:172.21.15.155:3300/0 conn(0x7f27540061c0 msgr2=0x7f2754008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-10T08:46:23.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:23.687+0000 7f2779c00640 1 -- 172.21.15.2:0/1256148864 >> v2:172.21.15.155:3300/0 conn(0x7f27540061c0 msgr2=0x7f2754008680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:46:23.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:23.687+0000 7f2779c00640 1 --2- 172.21.15.2:0/1256148864 >> v2:172.21.15.155:3300/0 conn(0x7f27540061c0 0x7f2754008680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:46:23.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:23.687+0000 7f2779c00640 1 --2- 172.21.15.2:0/1256148864 >> v2:172.21.15.155:3300/0 conn(0x7f27540061c0 0x7f2754008680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T08:46:25.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:25.283+0000 7f2772000640 1 -- 172.21.15.2:0/1256148864 >> v2:172.21.15.155:3300/0 conn(0x7f27540061c0 msgr2=0x7f2754008680 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T08:46:25.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:25.283+0000 7f2772000640 1 --2- 172.21.15.2:0/1256148864 >> v2:172.21.15.155:3300/0 conn(0x7f27540061c0 0x7f2754008680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:25.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:25.283+0000 7f2772000640 1 -- 172.21.15.2:0/1256148864 >> v1:172.21.15.155:6789/0 conn(0x7f27740cf6f0 legacy=0x7f275400b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:25.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:25.283+0000 7f2772000640 1 -- 172.21.15.2:0/1256148864 >> v1:172.21.15.2:6789/0 conn(0x7f2774161ca0 legacy=0x7f275400ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:25.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:25.283+0000 7f2772000640 1 --2- 172.21.15.2:0/1256148864 >> v2:172.21.15.2:3300/0 conn(0x7f2754003e70 0x7f27540042b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:25.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:25.283+0000 7f2772000640 1 --2- 172.21.15.2:0/1256148864 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27540102a0 0x7f2754010750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:25.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:25.283+0000 7f2772000640 1 -- 172.21.15.2:0/1256148864 --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f2754008d10 con 0x7f2754003e70 2024-09-10T08:46:25.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:25.283+0000 7f2772000640 1 -- 172.21.15.2:0/1256148864 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2754008ec0 con 0x7f27540102a0 2024-09-10T08:46:25.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:25.283+0000 7f2779200640 1 --2- 172.21.15.2:0/1256148864 >> v2:172.21.15.2:3300/0 conn(0x7f2754003e70 0x7f27540042b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:25.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:25.283+0000 7f2773e00640 1 --2- 172.21.15.2:0/1256148864 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27540102a0 0x7f2754010750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:25.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:25.283+0000 7f2779200640 1 -- 172.21.15.2:0/1256148864 >> v2:172.21.15.2:3300/0 conn(0x7f2754003e70 msgr2=0x7f27540042b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:46:25.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:25.283+0000 7f2779200640 1 -- 172.21.15.2:0/1256148864 >> v2:172.21.15.2:3300/0 conn(0x7f2754003e70 msgr2=0x7f27540042b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:46:25.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:25.283+0000 7f2779200640 1 --2- 172.21.15.2:0/1256148864 >> v2:172.21.15.2:3300/0 conn(0x7f2754003e70 0x7f27540042b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:46:25.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:25.283+0000 7f2779200640 1 --2- 172.21.15.2:0/1256148864 >> v2:172.21.15.2:3300/0 conn(0x7f2754003e70 0x7f27540042b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:46:25.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:25.283+0000 7f2773e00640 1 -- 172.21.15.2:0/1256148864 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27540102a0 msgr2=0x7f2754010750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:46:25.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:25.283+0000 7f2773e00640 1 -- 172.21.15.2:0/1256148864 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27540102a0 msgr2=0x7f2754010750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:46:25.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:25.283+0000 7f2773e00640 1 --2- 172.21.15.2:0/1256148864 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27540102a0 0x7f2754010750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:46:25.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:25.283+0000 7f2773e00640 1 --2- 172.21.15.2:0/1256148864 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27540102a0 0x7f2754010750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:46:25.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:25.484+0000 7f2779200640 1 --2- 172.21.15.2:0/1256148864 >> v2:172.21.15.2:3300/0 conn(0x7f2754003e70 0x7f27540042b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:25.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:25.484+0000 7f2773e00640 1 --2- 172.21.15.2:0/1256148864 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27540102a0 0x7f2754010750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:25.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:25.484+0000 7f2779200640 1 -- 172.21.15.2:0/1256148864 >> v2:172.21.15.2:3300/0 conn(0x7f2754003e70 msgr2=0x7f27540042b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:46:25.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:25.484+0000 7f2779200640 1 -- 172.21.15.2:0/1256148864 >> v2:172.21.15.2:3300/0 conn(0x7f2754003e70 msgr2=0x7f27540042b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:46:25.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:25.484+0000 7f2779200640 1 --2- 172.21.15.2:0/1256148864 >> v2:172.21.15.2:3300/0 conn(0x7f2754003e70 0x7f27540042b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:46:25.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:25.484+0000 7f2779200640 1 --2- 172.21.15.2:0/1256148864 >> v2:172.21.15.2:3300/0 conn(0x7f2754003e70 0x7f27540042b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:46:25.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:25.484+0000 7f2773e00640 1 -- 172.21.15.2:0/1256148864 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27540102a0 msgr2=0x7f2754010750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:46:25.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:25.484+0000 7f2773e00640 1 -- 172.21.15.2:0/1256148864 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27540102a0 msgr2=0x7f2754010750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:46:25.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:25.484+0000 7f2773e00640 1 --2- 172.21.15.2:0/1256148864 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27540102a0 0x7f2754010750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:46:25.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:25.484+0000 7f2773e00640 1 --2- 172.21.15.2:0/1256148864 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27540102a0 0x7f2754010750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:46:25.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:25.885+0000 7f2779200640 1 --2- 172.21.15.2:0/1256148864 >> v2:172.21.15.2:3300/0 conn(0x7f2754003e70 0x7f27540042b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:25.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:25.885+0000 7f2779200640 1 -- 172.21.15.2:0/1256148864 >> v2:172.21.15.2:3300/0 conn(0x7f2754003e70 msgr2=0x7f27540042b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-10T08:46:25.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:25.885+0000 7f2779200640 1 -- 172.21.15.2:0/1256148864 >> v2:172.21.15.2:3300/0 conn(0x7f2754003e70 msgr2=0x7f27540042b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:46:25.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:25.885+0000 7f2779200640 1 --2- 172.21.15.2:0/1256148864 >> v2:172.21.15.2:3300/0 conn(0x7f2754003e70 0x7f27540042b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:46:25.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:25.885+0000 7f2773e00640 1 --2- 172.21.15.2:0/1256148864 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27540102a0 0x7f2754010750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:25.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:25.885+0000 7f2779200640 1 --2- 172.21.15.2:0/1256148864 >> v2:172.21.15.2:3300/0 conn(0x7f2754003e70 0x7f27540042b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T08:46:25.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:25.885+0000 7f2773e00640 1 -- 172.21.15.2:0/1256148864 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27540102a0 msgr2=0x7f2754010750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-10T08:46:25.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:25.885+0000 7f2773e00640 1 -- 172.21.15.2:0/1256148864 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27540102a0 msgr2=0x7f2754010750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-10T08:46:25.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:25.885+0000 7f2773e00640 1 --2- 172.21.15.2:0/1256148864 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27540102a0 0x7f2754010750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-10T08:46:25.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:25.886+0000 7f2773e00640 1 --2- 172.21.15.2:0/1256148864 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27540102a0 0x7f2754010750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T08:46:26.662 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:46:26.662+0000 7f4648928040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-10T08:46:26.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:26.687+0000 7f2779200640 1 --2- 172.21.15.2:0/1256148864 >> v2:172.21.15.2:3300/0 conn(0x7f2754003e70 0x7f27540042b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:26.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:26.687+0000 7f2773e00640 1 --2- 172.21.15.2:0/1256148864 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27540102a0 0x7f2754010750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:26.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:26.687+0000 7f2779200640 1 -- 172.21.15.2:0/1256148864 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27540102a0 msgr2=0x7f2754010750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:46:26.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:26.687+0000 7f2779200640 1 --2- 172.21.15.2:0/1256148864 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27540102a0 0x7f2754010750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:26.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:26.687+0000 7f2779200640 1 -- 172.21.15.2:0/1256148864 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2754004d90 con 0x7f2754003e70 2024-09-10T08:46:26.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:26.689+0000 7f2779200640 1 --2- 172.21.15.2:0/1256148864 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2754003e70 0x7f27540042b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2768007d20 tx=0x7f276802bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d58c53a8897aad1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:26.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:26.689+0000 7f2773400640 1 -- 172.21.15.2:0/1256148864 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2768032070 con 0x7f2754003e70 2024-09-10T08:46:26.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:26.689+0000 7f2773400640 1 -- 172.21.15.2:0/1256148864 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f276802c580 con 0x7f2754003e70 2024-09-10T08:46:26.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:26.689+0000 7f2773400640 1 -- 172.21.15.2:0/1256148864 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f276802c950 con 0x7f2754003e70 2024-09-10T08:46:26.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:26.690+0000 7f277bc00640 1 -- 172.21.15.2:0/1256148864 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2754003e70 msgr2=0x7f27540042b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:26.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:26.690+0000 7f277bc00640 1 --2- 172.21.15.2:0/1256148864 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2754003e70 0x7f27540042b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2768007d20 tx=0x7f276802bc80 comp rx=0 tx=0).stop 2024-09-10T08:46:26.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:26.690+0000 7f2779c00640 1 -- 172.21.15.2:0/1256148864 reap_dead start 2024-09-10T08:46:26.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:26.691+0000 7f277bc00640 1 -- 172.21.15.2:0/1256148864 shutdown_connections 2024-09-10T08:46:26.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:26.691+0000 7f277bc00640 1 --2- 172.21.15.2:0/1256148864 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2754003e70 0x7f27540042b0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:26.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:26.691+0000 7f277bc00640 1 -- 172.21.15.2:0/1256148864 >> 172.21.15.2:0/1256148864 conn(0x7f277408bfd0 msgr2=0x7f27740d45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:46:26.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:26.691+0000 7f277bc00640 1 -- 172.21.15.2:0/1256148864 shutdown_connections 2024-09-10T08:46:26.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:26.691+0000 7f277bc00640 1 -- 172.21.15.2:0/1256148864 wait complete. 2024-09-10T08:46:26.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:26.694+0000 7f277bc00640 1 Processor -- start 2024-09-10T08:46:26.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:26.694+0000 7f277bc00640 1 -- start start 2024-09-10T08:46:26.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:26.696+0000 7f277bc00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2754003e70 0x7f277414ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:26.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:26.696+0000 7f277bc00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27740c80d0 0x7f27740c8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:26.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:26.696+0000 7f277bc00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27740cc730 0x7f27740ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:26.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:26.696+0000 7f277bc00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f277406d040 con 0x7f2754003e70 2024-09-10T08:46:26.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:26.696+0000 7f277bc00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f277406cdf0 con 0x7f27740cc730 2024-09-10T08:46:26.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:26.696+0000 7f277bc00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f27740cf1b0 con 0x7f27740c80d0 2024-09-10T08:46:26.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:26.696+0000 7f2779c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27740cc730 0x7f27740ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:26.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:26.697+0000 7f2779c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27740cc730 0x7f27740ccbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.2:33364/0 (socket says 172.21.15.2:33364) 2024-09-10T08:46:26.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:26.697+0000 7f2779c00640 1 -- 172.21.15.2:0/707850056 learned_addr learned my addr 172.21.15.2:0/707850056 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:46:26.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:26.697+0000 7f2779200640 1 --2- 172.21.15.2:0/707850056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2754003e70 0x7f277414ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:26.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:26.697+0000 7f2773e00640 1 --2- 172.21.15.2:0/707850056 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27740c80d0 0x7f27740c8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:26.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:26.697+0000 7f2779c00640 1 -- 172.21.15.2:0/707850056 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27740c80d0 msgr2=0x7f27740c8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:26.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:26.697+0000 7f2779c00640 1 --2- 172.21.15.2:0/707850056 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27740c80d0 0x7f27740c8550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:26.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:26.697+0000 7f2779c00640 1 -- 172.21.15.2:0/707850056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2754003e70 msgr2=0x7f277414ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:26.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:26.697+0000 7f2779c00640 1 --2- 172.21.15.2:0/707850056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2754003e70 0x7f277414ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:26.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:26.697+0000 7f2779c00640 1 -- 172.21.15.2:0/707850056 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27740cd480 con 0x7f27740cc730 2024-09-10T08:46:26.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:26.697+0000 7f2773e00640 1 --2- 172.21.15.2:0/707850056 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27740c80d0 0x7f27740c8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:46:26.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:26.697+0000 7f2779c00640 1 --2- 172.21.15.2:0/707850056 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27740cc730 0x7f27740ccbb0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f27740b3fd0 tx=0x7f276c001aa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:26.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:26.698+0000 7f2770c00640 1 -- 172.21.15.2:0/707850056 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f276c015680 con 0x7f27740cc730 2024-09-10T08:46:26.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:26.698+0000 7f2770c00640 1 -- 172.21.15.2:0/707850056 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f276c01b070 con 0x7f27740cc730 2024-09-10T08:46:26.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:26.698+0000 7f2770c00640 1 -- 172.21.15.2:0/707850056 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f276c015a80 con 0x7f27740cc730 2024-09-10T08:46:26.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:26.698+0000 7f277bc00640 1 -- 172.21.15.2:0/707850056 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27740cd760 con 0x7f27740cc730 2024-09-10T08:46:26.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:26.698+0000 7f277bc00640 1 -- 172.21.15.2:0/707850056 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27740cdd20 con 0x7f27740cc730 2024-09-10T08:46:26.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:26.698+0000 7f2770c00640 1 -- 172.21.15.2:0/707850056 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f276c013070 con 0x7f27740cc730 2024-09-10T08:46:26.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:26.698+0000 7f2770c00640 1 -- 172.21.15.2:0/707850056 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f276c020df0 con 0x7f27740cc730 2024-09-10T08:46:26.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:26.699+0000 7f277bc00640 1 -- 172.21.15.2:0/707850056 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27740d2620 con 0x7f27740cc730 2024-09-10T08:46:26.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:26.703+0000 7f2770c00640 1 -- 172.21.15.2:0/707850056 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f276c015c20 con 0x7f27740cc730 2024-09-10T08:46:26.713 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:46:26.712+0000 7f4648928040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-10T08:46:26.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:26.771+0000 7f277bc00640 1 -- 172.21.15.2:0/707850056 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f277406e9c0 con 0x7f27740cc730 2024-09-10T08:46:26.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:26.780+0000 7f2770c00640 1 -- 172.21.15.2:0/707850056 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f276c015e00 con 0x7f27740cc730 2024-09-10T08:46:26.781 INFO:teuthology.orchestra.run.smithi002.stderr:adjusted tunables profile to default 2024-09-10T08:46:26.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:26.782+0000 7f277bc00640 1 -- 172.21.15.2:0/707850056 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27740cc730 msgr2=0x7f27740ccbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:26.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:26.782+0000 7f277bc00640 1 --2- 172.21.15.2:0/707850056 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27740cc730 0x7f27740ccbb0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f27740b3fd0 tx=0x7f276c001aa0 comp rx=0 tx=0).stop 2024-09-10T08:46:26.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:26.782+0000 7f277bc00640 1 -- 172.21.15.2:0/707850056 shutdown_connections 2024-09-10T08:46:26.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:26.782+0000 7f277bc00640 1 --2- 172.21.15.2:0/707850056 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27740cc730 0x7f27740ccbb0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:26.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:26.782+0000 7f277bc00640 1 --2- 172.21.15.2:0/707850056 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27740c80d0 0x7f27740c8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:26.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:26.782+0000 7f277bc00640 1 --2- 172.21.15.2:0/707850056 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2754003e70 0x7f277414ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:26.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:26.782+0000 7f277bc00640 1 -- 172.21.15.2:0/707850056 >> 172.21.15.2:0/707850056 conn(0x7f277408bfd0 msgr2=0x7f27740b5320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:46:26.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:26.782+0000 7f277bc00640 1 -- 172.21.15.2:0/707850056 shutdown_connections 2024-09-10T08:46:26.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:26.782+0000 7f277bc00640 1 -- 172.21.15.2:0/707850056 wait complete. 2024-09-10T08:46:26.798 INFO:tasks.ceph:check_enable_crimson: False 2024-09-10T08:46:26.798 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-10T08:46:26.798 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T08:46:26.798 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-10T08:46:26.806 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:46:26.806+0000 7f0af2728040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-10T08:46:26.856 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T08:46:26.857 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-10T08:46:26.859 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:46:26.859+0000 7f0af2728040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-10T08:46:26.886 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:46:26.886+0000 7f4648928040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-10T08:46:26.914 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T08:46:26.914 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-10T08:46:26.945 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:46:26.945+0000 7f4648928040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-10T08:46:27.010 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T08:46:27.010 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-10T08:46:27.037 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:46:27.037+0000 7f0af2728040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-10T08:46:27.093 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-10T08:46:27.093 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-10T08:46:27.101 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:46:27.101+0000 7f0af2728040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-10T08:46:27.145 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:46:27.145+0000 7f4648928040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-10T08:46:27.150 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-10T08:46:27.150 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-10T08:46:27.245 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-10T08:46:27.246 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-10T08:46:27.277 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:46:27.277+0000 7f4648928040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-10T08:46:27.291 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:46:27.291+0000 7f0af2728040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-10T08:46:27.332 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-10T08:46:27.332 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-10T08:46:27.426 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:46:27.425+0000 7f0af2728040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-10T08:46:27.428 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new c90be333-506b-46d1-b00a-10d089a84776 0 2024-09-10T08:46:27.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.618+0000 7f247fe00640 1 Processor -- start 2024-09-10T08:46:27.619 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.619+0000 7f247fe00640 1 -- start start 2024-09-10T08:46:27.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.620+0000 7f247fe00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24800d1510 0x7f24800cf040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:27.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.620+0000 7f247fe00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f24800b59e0 0x7f24800cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:27.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.620+0000 7f247fe00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24800d0550 con 0x7f2480161cb0 2024-09-10T08:46:27.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.620+0000 7f247fe00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f24800d3090 con 0x7f24800b59e0 2024-09-10T08:46:27.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.620+0000 7f247fe00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f24800d2760 con 0x7f24800d1510 2024-09-10T08:46:27.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.620+0000 7f247e000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24800d1510 0x7f24800cf040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:27.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.620+0000 7f247e000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24800d1510 0x7f24800cf040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:54734/0 (socket says 172.21.15.155:54734) 2024-09-10T08:46:27.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.620+0000 7f247e000640 1 -- 172.21.15.155:0/2356384945 learned_addr learned my addr 172.21.15.155:0/2356384945 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-09-10T08:46:27.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.620+0000 7f247e000640 1 -- 172.21.15.155:0/2356384945 >> v2:172.21.15.155:3300/0 conn(0x7f24800b59e0 msgr2=0x7f24800cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:46:27.621 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.620+0000 7f247e000640 1 --2- 172.21.15.155:0/2356384945 >> v2:172.21.15.155:3300/0 conn(0x7f24800b59e0 0x7f24800cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:27.622 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.621+0000 7f247e000640 1 -- 172.21.15.155:0/2356384945 >> v1:172.21.15.2:6789/0 conn(0x7f2480161cb0 legacy=0x7f24800d0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:27.622 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.621+0000 7f247e000640 1 -- 172.21.15.155:0/2356384945 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24800d2a40 con 0x7f24800d1510 2024-09-10T08:46:27.622 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.622+0000 7f247e000640 1 --2- 172.21.15.155:0/2356384945 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24800d1510 0x7f24800cf040 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f246c009870 tx=0x7f246c02a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4bf667360c0bcc20 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:27.622 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.622+0000 7f247d600640 1 -- 172.21.15.155:0/2356384945 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f246c037070 con 0x7f24800d1510 2024-09-10T08:46:27.622 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.622+0000 7f247d600640 1 -- 172.21.15.155:0/2356384945 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f246c032440 con 0x7f24800d1510 2024-09-10T08:46:27.622 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.622+0000 7f247d600640 1 -- 172.21.15.155:0/2356384945 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f246c032810 con 0x7f24800d1510 2024-09-10T08:46:27.623 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.622+0000 7f247fe00640 1 -- 172.21.15.155:0/2356384945 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24800d1510 msgr2=0x7f24800cf040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:27.623 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.622+0000 7f247fe00640 1 --2- 172.21.15.155:0/2356384945 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24800d1510 0x7f24800cf040 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f246c009870 tx=0x7f246c02a250 comp rx=0 tx=0).stop 2024-09-10T08:46:27.623 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.623+0000 7f247fe00640 1 -- 172.21.15.155:0/2356384945 shutdown_connections 2024-09-10T08:46:27.623 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.623+0000 7f247fe00640 1 --2- 172.21.15.155:0/2356384945 >> v2:172.21.15.155:3300/0 conn(0x7f24800b59e0 0x7f24800cf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:27.623 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.623+0000 7f247fe00640 1 --2- 172.21.15.155:0/2356384945 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24800d1510 0x7f24800cf040 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:27.624 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.623+0000 7f247fe00640 1 -- 172.21.15.155:0/2356384945 >> 172.21.15.155:0/2356384945 conn(0x7f248009d700 msgr2=0x7f24800d4430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:46:27.624 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.623+0000 7f247fe00640 1 -- 172.21.15.155:0/2356384945 shutdown_connections 2024-09-10T08:46:27.624 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.623+0000 7f247fe00640 1 -- 172.21.15.155:0/2356384945 wait complete. 2024-09-10T08:46:27.624 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.624+0000 7f247fe00640 1 Processor -- start 2024-09-10T08:46:27.624 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.624+0000 7f247fe00640 1 -- start start 2024-09-10T08:46:27.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.625+0000 7f247fe00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24800b59e0 0x7f24800b9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:27.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.625+0000 7f247fe00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24800d1510 0x7f24800cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:27.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.625+0000 7f247fe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2480161cb0 0x7f248015df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:27.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.625+0000 7f247fe00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f24800b4d40 con 0x7f2480161cb0 2024-09-10T08:46:27.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.625+0000 7f247fe00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f24800b4bc0 con 0x7f24800b59e0 2024-09-10T08:46:27.627 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.625+0000 7f247fe00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2480162090 con 0x7f24800d1510 2024-09-10T08:46:27.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.625+0000 7f247ea00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24800b59e0 0x7f24800b9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:27.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.625+0000 7f247e000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24800d1510 0x7f24800cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:27.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.626+0000 7f247ea00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24800b59e0 0x7f24800b9710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54170/0 (socket says 172.21.15.155:54170) 2024-09-10T08:46:27.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.626+0000 7f247ea00640 1 -- 172.21.15.155:0/1154075051 learned_addr learned my addr 172.21.15.155:0/1154075051 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-09-10T08:46:27.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.626+0000 7f247f400640 1 --2- 172.21.15.155:0/1154075051 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2480161cb0 0x7f248015df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:27.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.626+0000 7f247ea00640 1 -- 172.21.15.155:0/1154075051 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24800d1510 msgr2=0x7f24800cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:27.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.626+0000 7f247ea00640 1 --2- 172.21.15.155:0/1154075051 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24800d1510 0x7f24800cdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:27.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.626+0000 7f247ea00640 1 -- 172.21.15.155:0/1154075051 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2480161cb0 msgr2=0x7f248015df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:27.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.626+0000 7f247ea00640 1 --2- 172.21.15.155:0/1154075051 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2480161cb0 0x7f248015df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:27.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.626+0000 7f247ea00640 1 -- 172.21.15.155:0/1154075051 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24800b8670 con 0x7f24800b59e0 2024-09-10T08:46:27.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.626+0000 7f247e000640 1 --2- 172.21.15.155:0/1154075051 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24800d1510 0x7f24800cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:46:27.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.626+0000 7f247f400640 1 --2- 172.21.15.155:0/1154075051 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2480161cb0 0x7f248015df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:46:27.628 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.626+0000 7f247ea00640 1 --2- 172.21.15.155:0/1154075051 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24800b59e0 0x7f24800b9710 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f247000c3f0 tx=0x7f247000c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:27.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.626+0000 7f2476a00640 1 -- 172.21.15.155:0/1154075051 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24700052d0 con 0x7f24800b59e0 2024-09-10T08:46:27.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.627+0000 7f2476a00640 1 -- 172.21.15.155:0/1154075051 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2470005490 con 0x7f24800b59e0 2024-09-10T08:46:27.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.627+0000 7f2476a00640 1 -- 172.21.15.155:0/1154075051 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2470007260 con 0x7f24800b59e0 2024-09-10T08:46:27.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.627+0000 7f247fe00640 1 -- 172.21.15.155:0/1154075051 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24800b8950 con 0x7f24800b59e0 2024-09-10T08:46:27.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.627+0000 7f247fe00640 1 -- 172.21.15.155:0/1154075051 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24800b8f10 con 0x7f24800b59e0 2024-09-10T08:46:27.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.627+0000 7f2476a00640 1 -- 172.21.15.155:0/1154075051 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2470007400 con 0x7f24800b59e0 2024-09-10T08:46:27.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.627+0000 7f2476a00640 1 -- 172.21.15.155:0/1154075051 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f2470003ad0 con 0x7f24800b59e0 2024-09-10T08:46:27.629 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.628+0000 7f247fe00640 1 -- 172.21.15.155:0/1154075051 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24800b3080 con 0x7f24800b59e0 2024-09-10T08:46:27.630 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.630+0000 7f2476a00640 1 -- 172.21.15.155:0/1154075051 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f24700035f0 con 0x7f24800b59e0 2024-09-10T08:46:27.663 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:46:27.663+0000 7f4648928040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-10T08:46:27.725 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.724+0000 7f247fe00640 1 -- 172.21.15.155:0/1154075051 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c90be333-506b-46d1-b00a-10d089a84776", "id": 0} v 0) -- 0x7f24800d3720 con 0x7f24800b59e0 2024-09-10T08:46:27.729 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.729+0000 7f2476a00640 1 -- 172.21.15.155:0/1154075051 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c90be333-506b-46d1-b00a-10d089a84776", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f2470003cd0 con 0x7f24800b59e0 2024-09-10T08:46:27.729 INFO:teuthology.orchestra.run.smithi155.stdout:0 2024-09-10T08:46:27.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.730+0000 7f247fe00640 1 -- 172.21.15.155:0/1154075051 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24800b59e0 msgr2=0x7f24800b9710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:27.730 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.730+0000 7f247fe00640 1 --2- 172.21.15.155:0/1154075051 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24800b59e0 0x7f24800b9710 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f247000c3f0 tx=0x7f247000c8b0 comp rx=0 tx=0).stop 2024-09-10T08:46:27.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.730+0000 7f247fe00640 1 -- 172.21.15.155:0/1154075051 shutdown_connections 2024-09-10T08:46:27.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.730+0000 7f247fe00640 1 --2- 172.21.15.155:0/1154075051 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2480161cb0 0x7f248015df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:27.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.730+0000 7f247fe00640 1 --2- 172.21.15.155:0/1154075051 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24800d1510 0x7f24800cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:27.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.730+0000 7f247fe00640 1 --2- 172.21.15.155:0/1154075051 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24800b59e0 0x7f24800b9710 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:27.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.730+0000 7f247fe00640 1 -- 172.21.15.155:0/1154075051 >> 172.21.15.155:0/1154075051 conn(0x7f248009d700 msgr2=0x7f24800b3f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:46:27.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.730+0000 7f247fe00640 1 -- 172.21.15.155:0/1154075051 shutdown_connections 2024-09-10T08:46:27.731 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.730+0000 7f247fe00640 1 -- 172.21.15.155:0/1154075051 wait complete. 2024-09-10T08:46:27.740 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:46:27.740+0000 7f4648928040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-10T08:46:27.746 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new 3f8bdde8-6cd3-4112-8939-a876191c7368 1 2024-09-10T08:46:27.810 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:46:27.809+0000 7f0af2728040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-10T08:46:27.873 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:46:27.872+0000 7f0af2728040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-10T08:46:27.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.894+0000 7efe9b200640 1 Processor -- start 2024-09-10T08:46:27.895 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.895+0000 7efe9b200640 1 -- start start 2024-09-10T08:46:27.896 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.896+0000 7efe9b200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe9c0d2630 0x7efe9c0cf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:27.896 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.896+0000 7efe9b200640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7efe9c0cf7f0 0x7efe9c0cfd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:27.896 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.896+0000 7efe9b200640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe9c15d4e0 con 0x7efe9c0d0900 2024-09-10T08:46:27.896 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.896+0000 7efe9b200640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7efe9c0ce7d0 con 0x7efe9c0cf7f0 2024-09-10T08:46:27.897 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.896+0000 7efe9b200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7efe9c0ceab0 con 0x7efe9c0d2630 2024-09-10T08:46:27.897 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.896+0000 7efe9a800640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7efe9c0cf7f0 0x7efe9c0cfd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:27.897 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.896+0000 7efe99e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe9c0d2630 0x7efe9c0cf2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:27.897 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.896+0000 7efe9a800640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7efe9c0cf7f0 0x7efe9c0cfd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54180/0 (socket says 172.21.15.155:54180) 2024-09-10T08:46:27.897 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.896+0000 7efe9a800640 1 -- 172.21.15.155:0/3075643056 learned_addr learned my addr 172.21.15.155:0/3075643056 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-09-10T08:46:27.897 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.896+0000 7efe9a800640 1 -- 172.21.15.155:0/3075643056 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe9c0d2630 msgr2=0x7efe9c0cf2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:46:27.898 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.896+0000 7efe9a800640 1 --2- 172.21.15.155:0/3075643056 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe9c0d2630 0x7efe9c0cf2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:27.898 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.896+0000 7efe9a800640 1 -- 172.21.15.155:0/3075643056 >> v1:172.21.15.2:6789/0 conn(0x7efe9c0d0900 legacy=0x7efe9c0d1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:27.898 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.897+0000 7efe9a800640 1 -- 172.21.15.155:0/3075643056 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe9c0ced90 con 0x7efe9c0cf7f0 2024-09-10T08:46:27.898 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.897+0000 7efe99e00640 1 --2- 172.21.15.155:0/3075643056 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe9c0d2630 0x7efe9c0cf2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:46:27.898 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.897+0000 7efe9a800640 1 --2- 172.21.15.155:0/3075643056 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe9c0cf7f0 0x7efe9c0cfd60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7efe94009e50 tx=0x7efe9402a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=235ac433aaa3b8f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:27.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.898+0000 7efe98a00640 1 -- 172.21.15.155:0/3075643056 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe94036070 con 0x7efe9c0cf7f0 2024-09-10T08:46:27.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.898+0000 7efe98a00640 1 -- 172.21.15.155:0/3075643056 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe94031600 con 0x7efe9c0cf7f0 2024-09-10T08:46:27.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.898+0000 7efe98a00640 1 -- 172.21.15.155:0/3075643056 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe940319d0 con 0x7efe9c0cf7f0 2024-09-10T08:46:27.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.898+0000 7efe9b200640 1 -- 172.21.15.155:0/3075643056 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe9c0cf7f0 msgr2=0x7efe9c0cfd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:27.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.898+0000 7efe9b200640 1 --2- 172.21.15.155:0/3075643056 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe9c0cf7f0 0x7efe9c0cfd60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7efe94009e50 tx=0x7efe9402a680 comp rx=0 tx=0).stop 2024-09-10T08:46:27.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.899+0000 7efe9b200640 1 -- 172.21.15.155:0/3075643056 shutdown_connections 2024-09-10T08:46:27.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.899+0000 7efe9b200640 1 --2- 172.21.15.155:0/3075643056 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe9c0cf7f0 0x7efe9c0cfd60 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:27.899 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.899+0000 7efe9b200640 1 --2- 172.21.15.155:0/3075643056 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe9c0d2630 0x7efe9c0cf2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:27.900 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.899+0000 7efe9b200640 1 -- 172.21.15.155:0/3075643056 >> 172.21.15.155:0/3075643056 conn(0x7efe9c06ffb0 msgr2=0x7efe9c070390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:46:27.900 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.899+0000 7efe9b200640 1 -- 172.21.15.155:0/3075643056 shutdown_connections 2024-09-10T08:46:27.900 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.899+0000 7efe9b200640 1 -- 172.21.15.155:0/3075643056 wait complete. 2024-09-10T08:46:27.900 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.900+0000 7efe9b200640 1 Processor -- start 2024-09-10T08:46:27.901 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.900+0000 7efe9b200640 1 -- start start 2024-09-10T08:46:27.902 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.901+0000 7efe9b200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe9c0cf7f0 0x7efe9c0b7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:27.902 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.901+0000 7efe9b200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe9c0d0900 0x7efe9c0cbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:27.902 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.901+0000 7efe9b200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe9c0d2630 0x7efe9c1536d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:27.902 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.901+0000 7efe9b200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7efe9c15d120 con 0x7efe9c0d0900 2024-09-10T08:46:27.902 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.901+0000 7efe9b200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7efe9c0ce480 con 0x7efe9c0d2630 2024-09-10T08:46:27.902 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.901+0000 7efe9b200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7efe9c15d2a0 con 0x7efe9c0cf7f0 2024-09-10T08:46:27.902 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.902+0000 7efe99e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe9c0cf7f0 0x7efe9c0b7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:27.902 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.902+0000 7efe9a800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe9c0d2630 0x7efe9c1536d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:27.903 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.902+0000 7efe99400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe9c0d0900 0x7efe9c0cbbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:27.903 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.902+0000 7efe9a800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe9c0d2630 0x7efe9c1536d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54184/0 (socket says 172.21.15.155:54184) 2024-09-10T08:46:27.903 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.902+0000 7efe99e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe9c0cf7f0 0x7efe9c0b7aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:54748/0 (socket says 172.21.15.155:54748) 2024-09-10T08:46:27.903 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.902+0000 7efe9a800640 1 -- 172.21.15.155:0/2616779178 learned_addr learned my addr 172.21.15.155:0/2616779178 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-09-10T08:46:27.904 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.902+0000 7efe9a800640 1 -- 172.21.15.155:0/2616779178 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe9c0cf7f0 msgr2=0x7efe9c0b7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:27.904 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.902+0000 7efe9a800640 1 --2- 172.21.15.155:0/2616779178 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe9c0cf7f0 0x7efe9c0b7aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:27.904 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.902+0000 7efe9a800640 1 -- 172.21.15.155:0/2616779178 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe9c0d0900 msgr2=0x7efe9c0cbbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:27.904 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.902+0000 7efe9a800640 1 --2- 172.21.15.155:0/2616779178 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe9c0d0900 0x7efe9c0cbbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:27.904 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.902+0000 7efe9a800640 1 -- 172.21.15.155:0/2616779178 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe9c0ca350 con 0x7efe9c0d2630 2024-09-10T08:46:27.905 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.902+0000 7efe99e00640 1 --2- 172.21.15.155:0/2616779178 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe9c0cf7f0 0x7efe9c0b7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:46:27.905 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.902+0000 7efe99400640 1 --2- 172.21.15.155:0/2616779178 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe9c0d0900 0x7efe9c0cbbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:46:27.905 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.902+0000 7efe9a800640 1 --2- 172.21.15.155:0/2616779178 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe9c0d2630 0x7efe9c1536d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7efe94009e50 tx=0x7efe94004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:27.905 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.903+0000 7efe92000640 1 -- 172.21.15.155:0/2616779178 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe94041020 con 0x7efe9c0d2630 2024-09-10T08:46:27.905 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.903+0000 7efe92000640 1 -- 172.21.15.155:0/2616779178 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe940077a0 con 0x7efe9c0d2630 2024-09-10T08:46:27.905 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.903+0000 7efe92000640 1 -- 172.21.15.155:0/2616779178 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe94036040 con 0x7efe9c0d2630 2024-09-10T08:46:27.905 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.903+0000 7efe9b200640 1 -- 172.21.15.155:0/2616779178 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe9c0ca630 con 0x7efe9c0d2630 2024-09-10T08:46:27.905 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.903+0000 7efe9b200640 1 -- 172.21.15.155:0/2616779178 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe9c0cabf0 con 0x7efe9c0d2630 2024-09-10T08:46:27.905 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.903+0000 7efe92000640 1 -- 172.21.15.155:0/2616779178 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7efe94044020 con 0x7efe9c0d2630 2024-09-10T08:46:27.905 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.903+0000 7efe92000640 1 -- 172.21.15.155:0/2616779178 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7efe9403c790 con 0x7efe9c0d2630 2024-09-10T08:46:27.905 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.904+0000 7efe9b200640 1 -- 172.21.15.155:0/2616779178 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe9c0cc7e0 con 0x7efe9c0d2630 2024-09-10T08:46:27.906 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.906+0000 7efe92000640 1 -- 172.21.15.155:0/2616779178 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7efe9404b030 con 0x7efe9c0d2630 2024-09-10T08:46:27.922 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:46:27.922+0000 7f4648928040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-10T08:46:27.978 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.978+0000 7efe9b200640 1 -- 172.21.15.155:0/2616779178 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3f8bdde8-6cd3-4112-8939-a876191c7368", "id": 1} v 0) -- 0x7efe9c15ae70 con 0x7efe9c0d2630 2024-09-10T08:46:27.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.982+0000 7efe92000640 1 -- 172.21.15.155:0/2616779178 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3f8bdde8-6cd3-4112-8939-a876191c7368", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7efe94007b90 con 0x7efe9c0d2630 2024-09-10T08:46:27.982 INFO:teuthology.orchestra.run.smithi155.stdout:1 2024-09-10T08:46:27.983 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.983+0000 7efe9b200640 1 -- 172.21.15.155:0/2616779178 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe9c0d2630 msgr2=0x7efe9c1536d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:27.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.983+0000 7efe9b200640 1 --2- 172.21.15.155:0/2616779178 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe9c0d2630 0x7efe9c1536d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7efe94009e50 tx=0x7efe94004a40 comp rx=0 tx=0).stop 2024-09-10T08:46:27.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.983+0000 7efe9b200640 1 -- 172.21.15.155:0/2616779178 shutdown_connections 2024-09-10T08:46:27.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.983+0000 7efe9b200640 1 --2- 172.21.15.155:0/2616779178 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe9c0d2630 0x7efe9c1536d0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:27.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.983+0000 7efe9b200640 1 --2- 172.21.15.155:0/2616779178 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efe9c0d0900 0x7efe9c0cbbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:27.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.983+0000 7efe9b200640 1 --2- 172.21.15.155:0/2616779178 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe9c0cf7f0 0x7efe9c0b7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:27.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.983+0000 7efe9b200640 1 -- 172.21.15.155:0/2616779178 >> 172.21.15.155:0/2616779178 conn(0x7efe9c06ffb0 msgr2=0x7efe9c15fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:46:27.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.983+0000 7efe9b200640 1 -- 172.21.15.155:0/2616779178 shutdown_connections 2024-09-10T08:46:27.984 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:27.983+0000 7efe9b200640 1 -- 172.21.15.155:0/2616779178 wait complete. 2024-09-10T08:46:27.998 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new 3835f5ab-ed3a-4f46-ae6c-f0edf21708d7 2 2024-09-10T08:46:28.051 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:46:28.050+0000 7f0af2728040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-10T08:46:28.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.146+0000 7f42f9600640 1 Processor -- start 2024-09-10T08:46:28.147 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.146+0000 7f42f9600640 1 -- start start 2024-09-10T08:46:28.148 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.147+0000 7f42f9600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42f4161ca0 0x7f42f40d2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:28.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.147+0000 7f42f9600640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f42f40d2b60 0x7f42f40cf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:28.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.147+0000 7f42f9600640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f42f40cf6f0 0x7f42f40d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:28.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.147+0000 7f42f9600640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f42f40d34a0 con 0x7f42f40d2b60 2024-09-10T08:46:28.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.147+0000 7f42f9600640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f42f406cdf0 con 0x7f42f40cf6f0 2024-09-10T08:46:28.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.147+0000 7f42f9600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f42f40d2fa0 con 0x7f42f4161ca0 2024-09-10T08:46:28.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.148+0000 7f42f2a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42f4161ca0 0x7f42f40d2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:28.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.148+0000 7f42f3400640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f42f40cf6f0 0x7f42f40d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:28.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.148+0000 7f42ebe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f42f40d2b60 0x7f42f40cf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:28.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.148+0000 7f42f2a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42f4161ca0 0x7f42f40d2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:54756/0 (socket says 172.21.15.155:54756) 2024-09-10T08:46:28.149 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.148+0000 7f42f2a00640 1 -- 172.21.15.155:0/188464530 learned_addr learned my addr 172.21.15.155:0/188464530 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-09-10T08:46:28.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.148+0000 7f42f2a00640 1 -- 172.21.15.155:0/188464530 >> v2:172.21.15.155:3300/0 conn(0x7f42f40cf6f0 msgr2=0x7f42f40d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:46:28.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.148+0000 7f42f2a00640 1 --2- 172.21.15.155:0/188464530 >> v2:172.21.15.155:3300/0 conn(0x7f42f40cf6f0 0x7f42f40d0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:28.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.148+0000 7f42f2a00640 1 -- 172.21.15.155:0/188464530 >> v2:172.21.15.2:3300/0 conn(0x7f42f40d2b60 msgr2=0x7f42f40cf1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:46:28.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.148+0000 7f42f2a00640 1 --2- 172.21.15.155:0/188464530 >> v2:172.21.15.2:3300/0 conn(0x7f42f40d2b60 0x7f42f40cf1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:28.150 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.148+0000 7f42f2a00640 1 -- 172.21.15.155:0/188464530 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42f40cfba0 con 0x7f42f4161ca0 2024-09-10T08:46:28.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.149+0000 7f42f2a00640 1 --2- 172.21.15.155:0/188464530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42f4161ca0 0x7f42f40d2620 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f42f40ceb80 tx=0x7f42e402a140 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b745094f4dbe7e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:28.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.149+0000 7f42f2000640 1 -- 172.21.15.155:0/188464530 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e4037070 con 0x7f42f4161ca0 2024-09-10T08:46:28.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.150+0000 7f42f2000640 1 -- 172.21.15.155:0/188464530 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42e4032440 con 0x7f42f4161ca0 2024-09-10T08:46:28.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.150+0000 7f42f2000640 1 -- 172.21.15.155:0/188464530 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e4032810 con 0x7f42f4161ca0 2024-09-10T08:46:28.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.150+0000 7f42f9600640 1 -- 172.21.15.155:0/188464530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42f4161ca0 msgr2=0x7f42f40d2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:28.151 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.150+0000 7f42f9600640 1 --2- 172.21.15.155:0/188464530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42f4161ca0 0x7f42f40d2620 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f42f40ceb80 tx=0x7f42e402a140 comp rx=0 tx=0).stop 2024-09-10T08:46:28.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.150+0000 7f42f9600640 1 -- 172.21.15.155:0/188464530 shutdown_connections 2024-09-10T08:46:28.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.150+0000 7f42f9600640 1 --2- 172.21.15.155:0/188464530 >> v2:172.21.15.155:3300/0 conn(0x7f42f40cf6f0 0x7f42f40d0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:28.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.150+0000 7f42f9600640 1 --2- 172.21.15.155:0/188464530 >> v2:172.21.15.2:3300/0 conn(0x7f42f40d2b60 0x7f42f40cf1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:28.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.150+0000 7f42f9600640 1 --2- 172.21.15.155:0/188464530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42f4161ca0 0x7f42f40d2620 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:28.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.150+0000 7f42f9600640 1 -- 172.21.15.155:0/188464530 >> 172.21.15.155:0/188464530 conn(0x7f42f408bfd0 msgr2=0x7f42f40d45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:46:28.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.150+0000 7f42f9600640 1 -- 172.21.15.155:0/188464530 shutdown_connections 2024-09-10T08:46:28.152 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.150+0000 7f42f9600640 1 -- 172.21.15.155:0/188464530 wait complete. 2024-09-10T08:46:28.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.152+0000 7f42f9600640 1 Processor -- start 2024-09-10T08:46:28.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.152+0000 7f42f9600640 1 -- start start 2024-09-10T08:46:28.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.153+0000 7f42f9600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42f40cf6f0 0x7f42f414b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:28.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.153+0000 7f42f9600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42f40d2b60 0x7f42f415d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:28.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.153+0000 7f42f9600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f42f4161ca0 0x7f42f415dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:28.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.153+0000 7f42f9600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f42f40d0410 con 0x7f42f40d2b60 2024-09-10T08:46:28.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.153+0000 7f42f9600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f42f40d0130 con 0x7f42f4161ca0 2024-09-10T08:46:28.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.153+0000 7f42f9600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f42f406d040 con 0x7f42f40cf6f0 2024-09-10T08:46:28.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.153+0000 7f42f2a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42f40cf6f0 0x7f42f414b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:28.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.153+0000 7f42f2a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42f40cf6f0 0x7f42f414b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:54768/0 (socket says 172.21.15.155:54768) 2024-09-10T08:46:28.155 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.153+0000 7f42f3400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f42f4161ca0 0x7f42f415dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:28.156 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.153+0000 7f42f2a00640 1 -- 172.21.15.155:0/2389156325 learned_addr learned my addr 172.21.15.155:0/2389156325 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-09-10T08:46:28.156 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.153+0000 7f42ebe00640 1 --2- 172.21.15.155:0/2389156325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42f40d2b60 0x7f42f415d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:28.156 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.154+0000 7f42f2a00640 1 -- 172.21.15.155:0/2389156325 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f42f4161ca0 msgr2=0x7f42f415dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:28.156 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.154+0000 7f42f2a00640 1 --2- 172.21.15.155:0/2389156325 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f42f4161ca0 0x7f42f415dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:28.156 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.154+0000 7f42f2a00640 1 -- 172.21.15.155:0/2389156325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42f40d2b60 msgr2=0x7f42f415d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:28.156 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.154+0000 7f42f2a00640 1 --2- 172.21.15.155:0/2389156325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42f40d2b60 0x7f42f415d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:28.156 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.154+0000 7f42f2a00640 1 -- 172.21.15.155:0/2389156325 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42f414ecc0 con 0x7f42f40cf6f0 2024-09-10T08:46:28.156 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.154+0000 7f42ebe00640 1 --2- 172.21.15.155:0/2389156325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42f40d2b60 0x7f42f415d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:46:28.156 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.154+0000 7f42f2a00640 1 --2- 172.21.15.155:0/2389156325 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42f40cf6f0 0x7f42f414b560 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f42e402a180 tx=0x7f42e40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:28.156 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.154+0000 7f42eaa00640 1 -- 172.21.15.155:0/2389156325 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e4041020 con 0x7f42f40cf6f0 2024-09-10T08:46:28.156 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.154+0000 7f42eaa00640 1 -- 172.21.15.155:0/2389156325 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42e403d620 con 0x7f42f40cf6f0 2024-09-10T08:46:28.157 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.154+0000 7f42f9600640 1 -- 172.21.15.155:0/2389156325 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42f415e3a0 con 0x7f42f40cf6f0 2024-09-10T08:46:28.157 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.154+0000 7f42eaa00640 1 -- 172.21.15.155:0/2389156325 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e4037040 con 0x7f42f40cf6f0 2024-09-10T08:46:28.157 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.154+0000 7f42f9600640 1 -- 172.21.15.155:0/2389156325 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f42f415e960 con 0x7f42f40cf6f0 2024-09-10T08:46:28.157 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.155+0000 7f42eaa00640 1 -- 172.21.15.155:0/2389156325 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f42e4044020 con 0x7f42f40cf6f0 2024-09-10T08:46:28.157 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.155+0000 7f42eaa00640 1 -- 172.21.15.155:0/2389156325 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f42e403dda0 con 0x7f42f40cf6f0 2024-09-10T08:46:28.157 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.155+0000 7f42f9600640 1 -- 172.21.15.155:0/2389156325 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42f40cf1b0 con 0x7f42f40cf6f0 2024-09-10T08:46:28.158 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.158+0000 7f42eaa00640 1 -- 172.21.15.155:0/2389156325 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f42e404b030 con 0x7f42f40cf6f0 2024-09-10T08:46:28.231 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.230+0000 7f42f9600640 1 -- 172.21.15.155:0/2389156325 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd new", "uuid": "3835f5ab-ed3a-4f46-ae6c-f0edf21708d7", "id": 2} v 0) -- 0x7f42f40b1260 con 0x7f42f40cf6f0 2024-09-10T08:46:28.235 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.235+0000 7f42eaa00640 1 -- 172.21.15.155:0/2389156325 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3835f5ab-ed3a-4f46-ae6c-f0edf21708d7", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f42e4046b80 con 0x7f42f40cf6f0 2024-09-10T08:46:28.235 INFO:teuthology.orchestra.run.smithi155.stdout:2 2024-09-10T08:46:28.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.235+0000 7f42f9600640 1 -- 172.21.15.155:0/2389156325 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42f40cf6f0 msgr2=0x7f42f414b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:28.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.235+0000 7f42f9600640 1 --2- 172.21.15.155:0/2389156325 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42f40cf6f0 0x7f42f414b560 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f42e402a180 tx=0x7f42e40046c0 comp rx=0 tx=0).stop 2024-09-10T08:46:28.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.236+0000 7f42f9600640 1 -- 172.21.15.155:0/2389156325 shutdown_connections 2024-09-10T08:46:28.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.236+0000 7f42f9600640 1 --2- 172.21.15.155:0/2389156325 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f42f4161ca0 0x7f42f415dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:28.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.236+0000 7f42f9600640 1 --2- 172.21.15.155:0/2389156325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42f40d2b60 0x7f42f415d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:28.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.236+0000 7f42f9600640 1 --2- 172.21.15.155:0/2389156325 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42f40cf6f0 0x7f42f414b560 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:28.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.236+0000 7f42f9600640 1 -- 172.21.15.155:0/2389156325 >> 172.21.15.155:0/2389156325 conn(0x7f42f408bfd0 msgr2=0x7f42f40d0780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:46:28.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.236+0000 7f42f9600640 1 -- 172.21.15.155:0/2389156325 shutdown_connections 2024-09-10T08:46:28.237 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.236+0000 7f42f9600640 1 -- 172.21.15.155:0/2389156325 wait complete. 2024-09-10T08:46:28.250 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new add6ad27-b411-4a82-9622-b0c1c1782cf1 3 2024-09-10T08:46:28.401 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.400+0000 7f6665800640 1 Processor -- start 2024-09-10T08:46:28.401 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.400+0000 7f6665800640 1 -- start start 2024-09-10T08:46:28.402 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.401+0000 7f6665800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f666015b4c0 0x7f66600cf6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:28.402 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.401+0000 7f6665800640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f666006f770 0x7f66600ae150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:28.402 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.401+0000 7f6665800640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66600ad390 con 0x7f66600af590 2024-09-10T08:46:28.402 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.401+0000 7f6665800640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f66600d1130 con 0x7f666006f770 2024-09-10T08:46:28.402 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.401+0000 7f6665800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f66600ad140 con 0x7f666015b4c0 2024-09-10T08:46:28.402 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.402+0000 7f665ea00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f666015b4c0 0x7f66600cf6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:28.403 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.402+0000 7f665f400640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f666006f770 0x7f66600ae150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:28.403 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.402+0000 7f665ea00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f666015b4c0 0x7f66600cf6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:54770/0 (socket says 172.21.15.155:54770) 2024-09-10T08:46:28.403 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.402+0000 7f665f400640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f666006f770 0x7f66600ae150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54208/0 (socket says 172.21.15.155:54208) 2024-09-10T08:46:28.403 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.402+0000 7f665ea00640 1 -- 172.21.15.155:0/2309331376 learned_addr learned my addr 172.21.15.155:0/2309331376 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-09-10T08:46:28.404 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.402+0000 7f665f400640 1 -- 172.21.15.155:0/2309331376 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f666015b4c0 msgr2=0x7f66600cf6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:46:28.404 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.402+0000 7f665f400640 1 --2- 172.21.15.155:0/2309331376 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f666015b4c0 0x7f66600cf6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:28.404 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.402+0000 7f665f400640 1 -- 172.21.15.155:0/2309331376 >> v1:172.21.15.155:6789/0 conn(0x7f66600af590 legacy=0x7f666006f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:28.404 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.402+0000 7f665f400640 1 -- 172.21.15.155:0/2309331376 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66600ad670 con 0x7f666006f770 2024-09-10T08:46:28.404 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.402+0000 7f665ea00640 1 --2- 172.21.15.155:0/2309331376 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f666015b4c0 0x7f66600cf6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:46:28.404 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.403+0000 7f665f400640 1 --2- 172.21.15.155:0/2309331376 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f666006f770 0x7f66600ae150 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6658009d90 tx=0x7f665802c7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41cc21c07a488d3c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:28.404 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.404+0000 7f665e000640 1 -- 172.21.15.155:0/2309331376 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6658007740 con 0x7f666006f770 2024-09-10T08:46:28.404 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.404+0000 7f665e000640 1 -- 172.21.15.155:0/2309331376 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66580078e0 con 0x7f666006f770 2024-09-10T08:46:28.404 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.404+0000 7f665e000640 1 -- 172.21.15.155:0/2309331376 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6658007cb0 con 0x7f666006f770 2024-09-10T08:46:28.405 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.404+0000 7f6665800640 1 -- 172.21.15.155:0/2309331376 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f666006f770 msgr2=0x7f66600ae150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:28.406 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.404+0000 7f6665800640 1 --2- 172.21.15.155:0/2309331376 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f666006f770 0x7f66600ae150 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6658009d90 tx=0x7f665802c7e0 comp rx=0 tx=0).stop 2024-09-10T08:46:28.406 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.404+0000 7f6665800640 1 -- 172.21.15.155:0/2309331376 shutdown_connections 2024-09-10T08:46:28.406 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.404+0000 7f6665800640 1 --2- 172.21.15.155:0/2309331376 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f666006f770 0x7f66600ae150 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:28.406 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.404+0000 7f6665800640 1 --2- 172.21.15.155:0/2309331376 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f666015b4c0 0x7f66600cf6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:28.406 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.404+0000 7f6665800640 1 -- 172.21.15.155:0/2309331376 >> 172.21.15.155:0/2309331376 conn(0x7f66600d02c0 msgr2=0x7f66600d06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:46:28.406 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.404+0000 7f6665800640 1 -- 172.21.15.155:0/2309331376 shutdown_connections 2024-09-10T08:46:28.406 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.404+0000 7f6665800640 1 -- 172.21.15.155:0/2309331376 wait complete. 2024-09-10T08:46:28.406 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.406+0000 7f6665800640 1 Processor -- start 2024-09-10T08:46:28.407 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.406+0000 7f6665800640 1 -- start start 2024-09-10T08:46:28.409 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.407+0000 7f6665800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f666006f770 0x7f6660151340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:28.409 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.407+0000 7f6665800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66600af590 0x7f666014f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:28.409 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.407+0000 7f6665800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f666015b4c0 0x7f6660151bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:28.409 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.407+0000 7f6665800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f66600adc30 con 0x7f666015b4c0 2024-09-10T08:46:28.409 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.407+0000 7f6665800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f66600af9d0 con 0x7f666006f770 2024-09-10T08:46:28.409 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.407+0000 7f6665800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6660071ef0 con 0x7f66600af590 2024-09-10T08:46:28.409 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.407+0000 7f665ea00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f666006f770 0x7f6660151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:28.409 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.407+0000 7f665ea00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f666006f770 0x7f6660151340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54216/0 (socket says 172.21.15.155:54216) 2024-09-10T08:46:28.409 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.407+0000 7f665ea00640 1 -- 172.21.15.155:0/1946412137 learned_addr learned my addr 172.21.15.155:0/1946412137 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-09-10T08:46:28.409 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.407+0000 7f6657e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66600af590 0x7f666014f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:28.410 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.407+0000 7f665f400640 1 --2- 172.21.15.155:0/1946412137 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f666015b4c0 0x7f6660151bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:28.410 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.407+0000 7f665ea00640 1 -- 172.21.15.155:0/1946412137 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66600af590 msgr2=0x7f666014f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:28.410 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.407+0000 7f665ea00640 1 --2- 172.21.15.155:0/1946412137 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66600af590 0x7f666014f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:28.410 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.408+0000 7f665ea00640 1 -- 172.21.15.155:0/1946412137 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f666015b4c0 msgr2=0x7f6660151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:28.410 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.408+0000 7f665ea00640 1 --2- 172.21.15.155:0/1946412137 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f666015b4c0 0x7f6660151bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:28.410 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.408+0000 7f665ea00640 1 -- 172.21.15.155:0/1946412137 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66601502a0 con 0x7f666006f770 2024-09-10T08:46:28.410 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.408+0000 7f665f400640 1 --2- 172.21.15.155:0/1946412137 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f666015b4c0 0x7f6660151bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:46:28.410 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.408+0000 7f665ea00640 1 --2- 172.21.15.155:0/1946412137 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f666006f770 0x7f6660151340 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f665000e9b0 tx=0x7f665000ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:28.410 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.408+0000 7f6656a00640 1 -- 172.21.15.155:0/1946412137 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6650017070 con 0x7f666006f770 2024-09-10T08:46:28.410 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.408+0000 7f6656a00640 1 -- 172.21.15.155:0/1946412137 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f665000c9a0 con 0x7f666006f770 2024-09-10T08:46:28.410 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.408+0000 7f6656a00640 1 -- 172.21.15.155:0/1946412137 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f665000cd50 con 0x7f666006f770 2024-09-10T08:46:28.410 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.408+0000 7f6665800640 1 -- 172.21.15.155:0/1946412137 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6660150580 con 0x7f666006f770 2024-09-10T08:46:28.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.408+0000 7f6665800640 1 -- 172.21.15.155:0/1946412137 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6660150b40 con 0x7f666006f770 2024-09-10T08:46:28.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.408+0000 7f6656a00640 1 -- 172.21.15.155:0/1946412137 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f665001a070 con 0x7f666006f770 2024-09-10T08:46:28.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.409+0000 7f6656a00640 1 -- 172.21.15.155:0/1946412137 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f6650013900 con 0x7f666006f770 2024-09-10T08:46:28.411 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.409+0000 7f6665800640 1 -- 172.21.15.155:0/1946412137 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f666015b8a0 con 0x7f666006f770 2024-09-10T08:46:28.412 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.412+0000 7f6656a00640 1 -- 172.21.15.155:0/1946412137 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f6650013470 con 0x7f666006f770 2024-09-10T08:46:28.484 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.484+0000 7f6665800640 1 -- 172.21.15.155:0/1946412137 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd new", "uuid": "add6ad27-b411-4a82-9622-b0c1c1782cf1", "id": 3} v 0) -- 0x7f666006e890 con 0x7f666006f770 2024-09-10T08:46:28.489 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.487+0000 7f6656a00640 1 -- 172.21.15.155:0/1946412137 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "add6ad27-b411-4a82-9622-b0c1c1782cf1", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f6650013650 con 0x7f666006f770 2024-09-10T08:46:28.489 INFO:teuthology.orchestra.run.smithi155.stdout:3 2024-09-10T08:46:28.490 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.489+0000 7f6665800640 1 -- 172.21.15.155:0/1946412137 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f666006f770 msgr2=0x7f6660151340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:28.490 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.489+0000 7f6665800640 1 --2- 172.21.15.155:0/1946412137 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f666006f770 0x7f6660151340 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f665000e9b0 tx=0x7f665000ee70 comp rx=0 tx=0).stop 2024-09-10T08:46:28.490 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.489+0000 7f6665800640 1 -- 172.21.15.155:0/1946412137 shutdown_connections 2024-09-10T08:46:28.490 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.489+0000 7f6665800640 1 --2- 172.21.15.155:0/1946412137 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f666015b4c0 0x7f6660151bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:28.490 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.489+0000 7f6665800640 1 --2- 172.21.15.155:0/1946412137 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f66600af590 0x7f666014f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:28.490 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.489+0000 7f6665800640 1 --2- 172.21.15.155:0/1946412137 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f666006f770 0x7f6660151340 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:28.490 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.489+0000 7f6665800640 1 -- 172.21.15.155:0/1946412137 >> 172.21.15.155:0/1946412137 conn(0x7f66600d02c0 msgr2=0x7f666015a600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:46:28.490 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.489+0000 7f6665800640 1 -- 172.21.15.155:0/1946412137 shutdown_connections 2024-09-10T08:46:28.490 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.489+0000 7f6665800640 1 -- 172.21.15.155:0/1946412137 wait complete. 2024-09-10T08:46:28.505 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new c7b642f4-8bd2-4262-9a82-ee1061cfab7b 4 2024-09-10T08:46:28.656 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.655+0000 7fce9a200640 1 Processor -- start 2024-09-10T08:46:28.656 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.656+0000 7fce9a200640 1 -- start start 2024-09-10T08:46:28.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.657+0000 7fce9a200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fce94161ca0 0x7fce940d2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:28.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.657+0000 7fce9a200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce940d2b60 0x7fce940cf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:28.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.657+0000 7fce9a200640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce940cfb80 con 0x7fce940cf6f0 2024-09-10T08:46:28.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.657+0000 7fce9a200640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fce940d34a0 con 0x7fce94161ca0 2024-09-10T08:46:28.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.657+0000 7fce9a200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fce9406cdf0 con 0x7fce940d2b60 2024-09-10T08:46:28.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.657+0000 7fce92a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce940d2b60 0x7fce940cf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:28.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.657+0000 7fce93e00640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fce940cf6f0 0x7fce940d0d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:40266/0 (socket says 172.21.15.155:40266) 2024-09-10T08:46:28.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.657+0000 7fce93e00640 1 -- 172.21.15.155:0/2790540736 learned_addr learned my addr 172.21.15.155:0/2790540736 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-09-10T08:46:28.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.657+0000 7fce93400640 1 --2- 172.21.15.155:0/2790540736 >> v2:172.21.15.2:3300/0 conn(0x7fce94161ca0 0x7fce940d2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:28.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.657+0000 7fce92a00640 1 -- 172.21.15.155:0/2790540736 >> v2:172.21.15.2:3300/0 conn(0x7fce94161ca0 msgr2=0x7fce940d2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:46:28.658 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.657+0000 7fce92a00640 1 --2- 172.21.15.155:0/2790540736 >> v2:172.21.15.2:3300/0 conn(0x7fce94161ca0 0x7fce940d2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:28.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.657+0000 7fce92a00640 1 -- 172.21.15.155:0/2790540736 >> v1:172.21.15.155:6789/0 conn(0x7fce940cf6f0 legacy=0x7fce940d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:28.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.658+0000 7fce92a00640 1 -- 172.21.15.155:0/2790540736 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce940cfe50 con 0x7fce940d2b60 2024-09-10T08:46:28.659 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.657+0000 7fce92000640 1 -- 172.21.15.155:0/2790540736 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2685464398 0 0) 0x7fce940cfb80 con 0x7fce940cf6f0 2024-09-10T08:46:28.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.658+0000 7fce92a00640 1 --2- 172.21.15.155:0/2790540736 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce940d2b60 0x7fce940cf1b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fce800097a0 tx=0x7fce8002a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2a9a54854a15972 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:28.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.659+0000 7fce92000640 1 -- 172.21.15.155:0/2790540736 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce80037070 con 0x7fce940d2b60 2024-09-10T08:46:28.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.659+0000 7fce92000640 1 -- 172.21.15.155:0/2790540736 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce8002ae50 con 0x7fce940d2b60 2024-09-10T08:46:28.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.659+0000 7fce92000640 1 -- 172.21.15.155:0/2790540736 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce80032660 con 0x7fce940d2b60 2024-09-10T08:46:28.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.659+0000 7fce9a200640 1 -- 172.21.15.155:0/2790540736 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce940d2b60 msgr2=0x7fce940cf1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:28.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.659+0000 7fce9a200640 1 --2- 172.21.15.155:0/2790540736 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce940d2b60 0x7fce940cf1b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fce800097a0 tx=0x7fce8002a100 comp rx=0 tx=0).stop 2024-09-10T08:46:28.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.659+0000 7fce9a200640 1 -- 172.21.15.155:0/2790540736 shutdown_connections 2024-09-10T08:46:28.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.659+0000 7fce9a200640 1 --2- 172.21.15.155:0/2790540736 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce940d2b60 0x7fce940cf1b0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:28.660 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.659+0000 7fce9a200640 1 --2- 172.21.15.155:0/2790540736 >> v2:172.21.15.2:3300/0 conn(0x7fce94161ca0 0x7fce940d2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:28.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.659+0000 7fce9a200640 1 -- 172.21.15.155:0/2790540736 >> 172.21.15.155:0/2790540736 conn(0x7fce9408bfd0 msgr2=0x7fce940d45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:46:28.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.659+0000 7fce9a200640 1 -- 172.21.15.155:0/2790540736 shutdown_connections 2024-09-10T08:46:28.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.660+0000 7fce9a200640 1 -- 172.21.15.155:0/2790540736 wait complete. 2024-09-10T08:46:28.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.661+0000 7fce9a200640 1 Processor -- start 2024-09-10T08:46:28.661 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.661+0000 7fce9a200640 1 -- start start 2024-09-10T08:46:28.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.662+0000 7fce9a200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce940cf6f0 0x7fce9414e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:28.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.662+0000 7fce9a200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce940d2b60 0x7fce941f81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:28.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.662+0000 7fce9a200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce94161ca0 0x7fce940d0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:28.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.662+0000 7fce9a200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fce940d0410 con 0x7fce940d2b60 2024-09-10T08:46:28.663 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.662+0000 7fce9a200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fce940d2fa0 con 0x7fce940cf6f0 2024-09-10T08:46:28.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.662+0000 7fce9a200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fce9406d040 con 0x7fce94161ca0 2024-09-10T08:46:28.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.662+0000 7fce93400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce940cf6f0 0x7fce9414e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:28.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.662+0000 7fce93e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce94161ca0 0x7fce940d0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:28.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.662+0000 7fce93400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce940cf6f0 0x7fce9414e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:54230/0 (socket says 172.21.15.155:54230) 2024-09-10T08:46:28.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.662+0000 7fce93400640 1 -- 172.21.15.155:0/741248328 learned_addr learned my addr 172.21.15.155:0/741248328 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-09-10T08:46:28.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.662+0000 7fce92a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce940d2b60 0x7fce941f81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:28.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.663+0000 7fce93e00640 1 -- 172.21.15.155:0/741248328 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce940cf6f0 msgr2=0x7fce9414e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:28.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.663+0000 7fce93e00640 1 --2- 172.21.15.155:0/741248328 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce940cf6f0 0x7fce9414e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:28.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.663+0000 7fce93e00640 1 -- 172.21.15.155:0/741248328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce940d2b60 msgr2=0x7fce941f81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:28.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.663+0000 7fce93e00640 1 --2- 172.21.15.155:0/741248328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce940d2b60 0x7fce941f81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:28.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.663+0000 7fce93e00640 1 -- 172.21.15.155:0/741248328 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce941f8720 con 0x7fce94161ca0 2024-09-10T08:46:28.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.663+0000 7fce92a00640 1 --2- 172.21.15.155:0/741248328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce940d2b60 0x7fce941f81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:46:28.664 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.663+0000 7fce93e00640 1 --2- 172.21.15.155:0/741248328 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce94161ca0 0x7fce940d0f40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fce8c00c780 tx=0x7fce8c00cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:28.665 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.663+0000 7fce8b400640 1 -- 172.21.15.155:0/741248328 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce8c018070 con 0x7fce94161ca0 2024-09-10T08:46:28.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.663+0000 7fce8b400640 1 -- 172.21.15.155:0/741248328 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce8c004d60 con 0x7fce94161ca0 2024-09-10T08:46:28.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.663+0000 7fce9a200640 1 -- 172.21.15.155:0/741248328 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce940b85c0 con 0x7fce94161ca0 2024-09-10T08:46:28.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.663+0000 7fce8b400640 1 -- 172.21.15.155:0/741248328 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce8c00a880 con 0x7fce94161ca0 2024-09-10T08:46:28.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.664+0000 7fce9a200640 1 -- 172.21.15.155:0/741248328 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fce940b8b80 con 0x7fce94161ca0 2024-09-10T08:46:28.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.664+0000 7fce8b400640 1 -- 172.21.15.155:0/741248328 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fce8c01b070 con 0x7fce94161ca0 2024-09-10T08:46:28.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.664+0000 7fce8b400640 1 -- 172.21.15.155:0/741248328 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fce8c0070d0 con 0x7fce94161ca0 2024-09-10T08:46:28.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.665+0000 7fce9a200640 1 -- 172.21.15.155:0/741248328 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce940c7ee0 con 0x7fce94161ca0 2024-09-10T08:46:28.667 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.667+0000 7fce8b400640 1 -- 172.21.15.155:0/741248328 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fce941f8720 con 0x7fce94161ca0 2024-09-10T08:46:28.739 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.739+0000 7fce9a200640 1 -- 172.21.15.155:0/741248328 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c7b642f4-8bd2-4262-9a82-ee1061cfab7b", "id": 4} v 0) -- 0x7fce940cf1b0 con 0x7fce94161ca0 2024-09-10T08:46:28.743 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.743+0000 7fce8b400640 1 -- 172.21.15.155:0/741248328 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c7b642f4-8bd2-4262-9a82-ee1061cfab7b", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fce8c007710 con 0x7fce94161ca0 2024-09-10T08:46:28.743 INFO:teuthology.orchestra.run.smithi155.stdout:4 2024-09-10T08:46:28.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.744+0000 7fce9a200640 1 -- 172.21.15.155:0/741248328 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce94161ca0 msgr2=0x7fce940d0f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:28.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.744+0000 7fce9a200640 1 --2- 172.21.15.155:0/741248328 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce94161ca0 0x7fce940d0f40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fce8c00c780 tx=0x7fce8c00cc40 comp rx=0 tx=0).stop 2024-09-10T08:46:28.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.744+0000 7fce9a200640 1 -- 172.21.15.155:0/741248328 shutdown_connections 2024-09-10T08:46:28.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.744+0000 7fce9a200640 1 --2- 172.21.15.155:0/741248328 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce94161ca0 0x7fce940d0f40 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:28.744 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.744+0000 7fce9a200640 1 --2- 172.21.15.155:0/741248328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce940d2b60 0x7fce941f81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:28.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.744+0000 7fce9a200640 1 --2- 172.21.15.155:0/741248328 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce940cf6f0 0x7fce9414e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:28.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.744+0000 7fce9a200640 1 -- 172.21.15.155:0/741248328 >> 172.21.15.155:0/741248328 conn(0x7fce9408bfd0 msgr2=0x7fce9406d560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:46:28.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.744+0000 7fce9a200640 1 -- 172.21.15.155:0/741248328 shutdown_connections 2024-09-10T08:46:28.745 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.744+0000 7fce9a200640 1 -- 172.21.15.155:0/741248328 wait complete. 2024-09-10T08:46:28.759 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new fb53289a-419f-46d8-9e3a-384ac529dc57 5 2024-09-10T08:46:28.909 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.908+0000 7f04a2e00640 1 Processor -- start 2024-09-10T08:46:28.909 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.908+0000 7f04a2e00640 1 -- start start 2024-09-10T08:46:28.910 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.909+0000 7f04a2e00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f049c161ca0 0x7f049c0d2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:28.910 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.909+0000 7f04a2e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f049c0d2b60 0x7f049c0cf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:28.910 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.909+0000 7f04a2e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f049c0cf6f0 0x7f049c0d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:28.911 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.909+0000 7f04a2e00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f049c0d34a0 con 0x7f049c0cf6f0 2024-09-10T08:46:28.911 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.909+0000 7f04a2e00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f049c06cdf0 con 0x7f049c161ca0 2024-09-10T08:46:28.911 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.909+0000 7f04a2e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f049c0d2fa0 con 0x7f049c0d2b60 2024-09-10T08:46:28.911 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.910+0000 7f049b400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f049c0d2b60 0x7f049c0cf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:28.911 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.910+0000 7f049be00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f049c161ca0 0x7f049c0d2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:28.911 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.910+0000 7f049b400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f049c0d2b60 0x7f049c0cf1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:37160/0 (socket says 172.21.15.155:37160) 2024-09-10T08:46:28.911 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.910+0000 7f049b400640 1 -- 172.21.15.155:0/1026599603 learned_addr learned my addr 172.21.15.155:0/1026599603 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-09-10T08:46:28.911 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.910+0000 7f04a0e00640 1 --2- 172.21.15.155:0/1026599603 >> v2:172.21.15.2:3300/0 conn(0x7f049c0cf6f0 0x7f049c0d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:28.911 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.910+0000 7f049b400640 1 -- 172.21.15.155:0/1026599603 >> v2:172.21.15.155:3300/0 conn(0x7f049c161ca0 msgr2=0x7f049c0d2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:46:28.911 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.910+0000 7f049b400640 1 --2- 172.21.15.155:0/1026599603 >> v2:172.21.15.155:3300/0 conn(0x7f049c161ca0 0x7f049c0d2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:28.911 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.910+0000 7f049b400640 1 -- 172.21.15.155:0/1026599603 >> v2:172.21.15.2:3300/0 conn(0x7f049c0cf6f0 msgr2=0x7f049c0d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:46:28.911 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.910+0000 7f049b400640 1 --2- 172.21.15.155:0/1026599603 >> v2:172.21.15.2:3300/0 conn(0x7f049c0cf6f0 0x7f049c0d0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:28.912 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.910+0000 7f049b400640 1 -- 172.21.15.155:0/1026599603 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f049c0cfb80 con 0x7f049c0d2b60 2024-09-10T08:46:28.913 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.911+0000 7f049b400640 1 --2- 172.21.15.155:0/1026599603 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f049c0d2b60 0x7f049c0cf1b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f049c08d410 tx=0x7f048802a140 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71f0c02921ee43f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:28.913 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.911+0000 7f049aa00640 1 -- 172.21.15.155:0/1026599603 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0488037070 con 0x7f049c0d2b60 2024-09-10T08:46:28.913 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.911+0000 7f049aa00640 1 -- 172.21.15.155:0/1026599603 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0488032440 con 0x7f049c0d2b60 2024-09-10T08:46:28.913 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.911+0000 7f049aa00640 1 -- 172.21.15.155:0/1026599603 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0488032810 con 0x7f049c0d2b60 2024-09-10T08:46:28.913 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.912+0000 7f04a2e00640 1 -- 172.21.15.155:0/1026599603 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f049c0d2b60 msgr2=0x7f049c0cf1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:28.913 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.912+0000 7f04a2e00640 1 --2- 172.21.15.155:0/1026599603 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f049c0d2b60 0x7f049c0cf1b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f049c08d410 tx=0x7f048802a140 comp rx=0 tx=0).stop 2024-09-10T08:46:28.913 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.912+0000 7f04a2e00640 1 -- 172.21.15.155:0/1026599603 shutdown_connections 2024-09-10T08:46:28.913 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.912+0000 7f04a2e00640 1 --2- 172.21.15.155:0/1026599603 >> v2:172.21.15.2:3300/0 conn(0x7f049c0cf6f0 0x7f049c0d0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:28.913 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.912+0000 7f04a2e00640 1 --2- 172.21.15.155:0/1026599603 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f049c0d2b60 0x7f049c0cf1b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:28.913 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.912+0000 7f04a2e00640 1 --2- 172.21.15.155:0/1026599603 >> v2:172.21.15.155:3300/0 conn(0x7f049c161ca0 0x7f049c0d2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:28.914 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.912+0000 7f04a2e00640 1 -- 172.21.15.155:0/1026599603 >> 172.21.15.155:0/1026599603 conn(0x7f049c08bfd0 msgr2=0x7f049c0d45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:46:28.914 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.912+0000 7f04a2e00640 1 -- 172.21.15.155:0/1026599603 shutdown_connections 2024-09-10T08:46:28.914 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.912+0000 7f04a2e00640 1 -- 172.21.15.155:0/1026599603 wait complete. 2024-09-10T08:46:28.914 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.914+0000 7f04a2e00640 1 Processor -- start 2024-09-10T08:46:28.914 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.914+0000 7f04a2e00640 1 -- start start 2024-09-10T08:46:28.917 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.915+0000 7f04a2e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f049c0cf6f0 0x7f049c0cb670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:28.917 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.915+0000 7f04a2e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f049c0d2b60 0x7f049c0cd540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:28.917 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.915+0000 7f04a2e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f049c161ca0 0x7f049c0b9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:28.917 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.915+0000 7f04a2e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f049c0d0410 con 0x7f049c0d2b60 2024-09-10T08:46:28.917 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.915+0000 7f04a2e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f049c0d0130 con 0x7f049c0cf6f0 2024-09-10T08:46:28.917 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.915+0000 7f04a2e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f049c06d040 con 0x7f049c161ca0 2024-09-10T08:46:28.918 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.915+0000 7f049be00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f049c0cf6f0 0x7f049c0cb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:28.918 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.915+0000 7f049be00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f049c0cf6f0 0x7f049c0cb670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:57408/0 (socket says 172.21.15.155:57408) 2024-09-10T08:46:28.918 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.915+0000 7f04a0e00640 1 --2- 172.21.15.155:0/2061580762 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f049c161ca0 0x7f049c0b9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:28.918 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.915+0000 7f049be00640 1 -- 172.21.15.155:0/2061580762 learned_addr learned my addr 172.21.15.155:0/2061580762 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-09-10T08:46:28.918 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.915+0000 7f049b400640 1 --2- 172.21.15.155:0/2061580762 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f049c0d2b60 0x7f049c0cd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:28.918 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.916+0000 7f049be00640 1 -- 172.21.15.155:0/2061580762 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f049c161ca0 msgr2=0x7f049c0b9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:28.918 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.916+0000 7f049be00640 1 --2- 172.21.15.155:0/2061580762 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f049c161ca0 0x7f049c0b9590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:28.918 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.916+0000 7f049be00640 1 -- 172.21.15.155:0/2061580762 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f049c0d2b60 msgr2=0x7f049c0cd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:28.918 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.916+0000 7f049be00640 1 --2- 172.21.15.155:0/2061580762 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f049c0d2b60 0x7f049c0cd540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:28.918 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.916+0000 7f049be00640 1 -- 172.21.15.155:0/2061580762 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f049c0ce980 con 0x7f049c0cf6f0 2024-09-10T08:46:28.918 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.916+0000 7f049be00640 1 --2- 172.21.15.155:0/2061580762 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f049c0cf6f0 0x7f049c0cb670 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f048c00e870 tx=0x7f048c00ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:28.918 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.916+0000 7f0493e00640 1 -- 172.21.15.155:0/2061580762 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f048c017070 con 0x7f049c0cf6f0 2024-09-10T08:46:28.918 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.916+0000 7f0493e00640 1 -- 172.21.15.155:0/2061580762 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f048c00c940 con 0x7f049c0cf6f0 2024-09-10T08:46:28.918 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.916+0000 7f0493e00640 1 -- 172.21.15.155:0/2061580762 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f048c00cd30 con 0x7f049c0cf6f0 2024-09-10T08:46:28.919 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.916+0000 7f04a2e00640 1 -- 172.21.15.155:0/2061580762 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f049c0b7b30 con 0x7f049c0cf6f0 2024-09-10T08:46:28.919 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.916+0000 7f04a2e00640 1 -- 172.21.15.155:0/2061580762 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f049c0cdea0 con 0x7f049c0cf6f0 2024-09-10T08:46:28.919 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.917+0000 7f0493e00640 1 -- 172.21.15.155:0/2061580762 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f048c01a070 con 0x7f049c0cf6f0 2024-09-10T08:46:28.919 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.917+0000 7f0493e00640 1 -- 172.21.15.155:0/2061580762 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f048c006020 con 0x7f049c0cf6f0 2024-09-10T08:46:28.919 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.917+0000 7f04a2e00640 1 -- 172.21.15.155:0/2061580762 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f049c0cf1b0 con 0x7f049c0cf6f0 2024-09-10T08:46:28.920 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.920+0000 7f0493e00640 1 -- 172.21.15.155:0/2061580762 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f048c0064d0 con 0x7f049c0cf6f0 2024-09-10T08:46:28.991 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.991+0000 7f04a2e00640 1 -- 172.21.15.155:0/2061580762 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd new", "uuid": "fb53289a-419f-46d8-9e3a-384ac529dc57", "id": 5} v 0) -- 0x7f049c15f9f0 con 0x7f049c0cf6f0 2024-09-10T08:46:28.995 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.995+0000 7f0493e00640 1 -- 172.21.15.155:0/2061580762 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fb53289a-419f-46d8-9e3a-384ac529dc57", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f048c0066b0 con 0x7f049c0cf6f0 2024-09-10T08:46:28.995 INFO:teuthology.orchestra.run.smithi155.stdout:5 2024-09-10T08:46:28.997 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.996+0000 7f04a2e00640 1 -- 172.21.15.155:0/2061580762 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f049c0cf6f0 msgr2=0x7f049c0cb670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:28.997 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.996+0000 7f04a2e00640 1 --2- 172.21.15.155:0/2061580762 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f049c0cf6f0 0x7f049c0cb670 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f048c00e870 tx=0x7f048c00ed30 comp rx=0 tx=0).stop 2024-09-10T08:46:28.997 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.996+0000 7f04a2e00640 1 -- 172.21.15.155:0/2061580762 shutdown_connections 2024-09-10T08:46:28.997 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.996+0000 7f04a2e00640 1 --2- 172.21.15.155:0/2061580762 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f049c161ca0 0x7f049c0b9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:28.997 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.996+0000 7f04a2e00640 1 --2- 172.21.15.155:0/2061580762 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f049c0d2b60 0x7f049c0cd540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:28.997 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.996+0000 7f04a2e00640 1 --2- 172.21.15.155:0/2061580762 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f049c0cf6f0 0x7f049c0cb670 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:28.997 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.996+0000 7f04a2e00640 1 -- 172.21.15.155:0/2061580762 >> 172.21.15.155:0/2061580762 conn(0x7f049c08bfd0 msgr2=0x7f049c0b6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:46:28.997 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.996+0000 7f04a2e00640 1 -- 172.21.15.155:0/2061580762 shutdown_connections 2024-09-10T08:46:28.997 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:28.996+0000 7f04a2e00640 1 -- 172.21.15.155:0/2061580762 wait complete. 2024-09-10T08:46:29.011 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new 3f9ddd54-ede4-4565-aff6-ae1c07e7c678 6 2024-09-10T08:46:29.091 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:46:29.091+0000 7f4648928040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-10T08:46:29.156 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:46:29.156+0000 7f4648928040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-10T08:46:29.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.160+0000 7f61a8400640 1 Processor -- start 2024-09-10T08:46:29.161 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.161+0000 7f61a8400640 1 -- start start 2024-09-10T08:46:29.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.162+0000 7f61a8400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f61a0161ca0 0x7f61a00d2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:29.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.162+0000 7f61a8400640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f61a00d2b60 0x7f61a00cf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:29.162 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.162+0000 7f61a8400640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61a00cfe50 con 0x7f61a00cf6f0 2024-09-10T08:46:29.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.162+0000 7f61a8400640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f61a00d2fd0 con 0x7f61a0161ca0 2024-09-10T08:46:29.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.162+0000 7f61a8400640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f61a00d34a0 con 0x7f61a00d2b60 2024-09-10T08:46:29.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.162+0000 7f61a5000640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f61a00d2b60 0x7f61a00cf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:29.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.162+0000 7f61a5000640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f61a00d2b60 0x7f61a00cf1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:57416/0 (socket says 172.21.15.155:57416) 2024-09-10T08:46:29.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.162+0000 7f61a5000640 1 -- 172.21.15.155:0/2526388109 learned_addr learned my addr 172.21.15.155:0/2526388109 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-09-10T08:46:29.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.162+0000 7f61a5a00640 1 --2- 172.21.15.155:0/2526388109 >> v2:172.21.15.2:3300/0 conn(0x7f61a0161ca0 0x7f61a00d2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:29.163 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.162+0000 7f61a5000640 1 -- 172.21.15.155:0/2526388109 >> v2:172.21.15.2:3300/0 conn(0x7f61a0161ca0 msgr2=0x7f61a00d2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:46:29.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.162+0000 7f61a5000640 1 --2- 172.21.15.155:0/2526388109 >> v2:172.21.15.2:3300/0 conn(0x7f61a0161ca0 0x7f61a00d2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:29.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.162+0000 7f61a5000640 1 -- 172.21.15.155:0/2526388109 >> v1:172.21.15.2:6789/0 conn(0x7f61a00cf6f0 legacy=0x7f61a00d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:29.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.163+0000 7f61a5000640 1 -- 172.21.15.155:0/2526388109 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61a00d0130 con 0x7f61a00d2b60 2024-09-10T08:46:29.164 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.164+0000 7f61a5000640 1 --2- 172.21.15.155:0/2526388109 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61a00d2b60 0x7f61a00cf1b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f61a00c7c20 tx=0x7f618c02a200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=797926321b92a6f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:29.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.164+0000 7f619fe00640 1 -- 172.21.15.155:0/2526388109 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f618c037070 con 0x7f61a00d2b60 2024-09-10T08:46:29.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.164+0000 7f619fe00640 1 -- 172.21.15.155:0/2526388109 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f618c032440 con 0x7f61a00d2b60 2024-09-10T08:46:29.165 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.164+0000 7f619fe00640 1 -- 172.21.15.155:0/2526388109 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f618c032810 con 0x7f61a00d2b60 2024-09-10T08:46:29.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.165+0000 7f61a8400640 1 -- 172.21.15.155:0/2526388109 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61a00d2b60 msgr2=0x7f61a00cf1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:29.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.165+0000 7f61a8400640 1 --2- 172.21.15.155:0/2526388109 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61a00d2b60 0x7f61a00cf1b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f61a00c7c20 tx=0x7f618c02a200 comp rx=0 tx=0).stop 2024-09-10T08:46:29.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.165+0000 7f61a8400640 1 -- 172.21.15.155:0/2526388109 shutdown_connections 2024-09-10T08:46:29.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.165+0000 7f61a8400640 1 --2- 172.21.15.155:0/2526388109 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61a00d2b60 0x7f61a00cf1b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:29.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.165+0000 7f61a8400640 1 --2- 172.21.15.155:0/2526388109 >> v2:172.21.15.2:3300/0 conn(0x7f61a0161ca0 0x7f61a00d2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:29.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.165+0000 7f61a8400640 1 -- 172.21.15.155:0/2526388109 >> 172.21.15.155:0/2526388109 conn(0x7f61a008bfd0 msgr2=0x7f61a00d45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:46:29.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.165+0000 7f61a8400640 1 -- 172.21.15.155:0/2526388109 shutdown_connections 2024-09-10T08:46:29.166 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.165+0000 7f61a8400640 1 -- 172.21.15.155:0/2526388109 wait complete. 2024-09-10T08:46:29.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.167+0000 7f61a8400640 1 Processor -- start 2024-09-10T08:46:29.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.167+0000 7f61a8400640 1 -- start start 2024-09-10T08:46:29.169 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.168+0000 7f61a8400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61a00cf6f0 0x7f61a01f70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:29.170 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.168+0000 7f61a8400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61a00d2b60 0x7f61a00b94a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:29.170 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.168+0000 7f61a8400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61a0161ca0 0x7f61a00b99e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:29.170 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.168+0000 7f61a8400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f61a006d040 con 0x7f61a00cf6f0 2024-09-10T08:46:29.170 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.168+0000 7f61a8400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f61a006cdf0 con 0x7f61a0161ca0 2024-09-10T08:46:29.170 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.168+0000 7f61a8400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f61a00cfb60 con 0x7f61a00d2b60 2024-09-10T08:46:29.170 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.168+0000 7f61a6400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61a0161ca0 0x7f61a00b99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:29.170 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.168+0000 7f61a5000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61a00d2b60 0x7f61a00b94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:29.170 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.168+0000 7f61a6400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61a0161ca0 0x7f61a00b99e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:57418/0 (socket says 172.21.15.155:57418) 2024-09-10T08:46:29.170 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.168+0000 7f61a6400640 1 -- 172.21.15.155:0/1099879306 learned_addr learned my addr 172.21.15.155:0/1099879306 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-09-10T08:46:29.170 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.168+0000 7f61a5a00640 1 --2- 172.21.15.155:0/1099879306 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61a00cf6f0 0x7f61a01f70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:29.170 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.168+0000 7f61a6400640 1 -- 172.21.15.155:0/1099879306 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61a00d2b60 msgr2=0x7f61a00b94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:29.171 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.168+0000 7f61a6400640 1 --2- 172.21.15.155:0/1099879306 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61a00d2b60 0x7f61a00b94a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:29.171 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.168+0000 7f61a6400640 1 -- 172.21.15.155:0/1099879306 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61a00cf6f0 msgr2=0x7f61a01f70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:29.171 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.168+0000 7f61a6400640 1 --2- 172.21.15.155:0/1099879306 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61a00cf6f0 0x7f61a01f70b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:29.171 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.168+0000 7f61a6400640 1 -- 172.21.15.155:0/1099879306 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61a00cb670 con 0x7f61a0161ca0 2024-09-10T08:46:29.171 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.168+0000 7f61a5a00640 1 --2- 172.21.15.155:0/1099879306 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61a00cf6f0 0x7f61a01f70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:46:29.171 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.169+0000 7f61a6400640 1 --2- 172.21.15.155:0/1099879306 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61a0161ca0 0x7f61a00b99e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f619800c7a0 tx=0x7f619800cc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:29.171 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.169+0000 7f619d600640 1 -- 172.21.15.155:0/1099879306 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6198003b70 con 0x7f61a0161ca0 2024-09-10T08:46:29.171 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.169+0000 7f619d600640 1 -- 172.21.15.155:0/1099879306 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6198003d30 con 0x7f61a0161ca0 2024-09-10T08:46:29.171 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.169+0000 7f61a8400640 1 -- 172.21.15.155:0/1099879306 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61a00cb950 con 0x7f61a0161ca0 2024-09-10T08:46:29.171 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.169+0000 7f619d600640 1 -- 172.21.15.155:0/1099879306 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f619800aa90 con 0x7f61a0161ca0 2024-09-10T08:46:29.171 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.169+0000 7f61a8400640 1 -- 172.21.15.155:0/1099879306 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61a00cbf10 con 0x7f61a0161ca0 2024-09-10T08:46:29.171 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.169+0000 7f619d600640 1 -- 172.21.15.155:0/1099879306 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f619800ac30 con 0x7f61a0161ca0 2024-09-10T08:46:29.171 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.170+0000 7f619d600640 1 -- 172.21.15.155:0/1099879306 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f61980056c0 con 0x7f61a0161ca0 2024-09-10T08:46:29.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.170+0000 7f61a8400640 1 -- 172.21.15.155:0/1099879306 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61a00cf1b0 con 0x7f61a0161ca0 2024-09-10T08:46:29.172 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.172+0000 7f619d600640 1 -- 172.21.15.155:0/1099879306 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f61980050d0 con 0x7f61a0161ca0 2024-09-10T08:46:29.244 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.243+0000 7f61a8400640 1 -- 172.21.15.155:0/1099879306 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3f9ddd54-ede4-4565-aff6-ae1c07e7c678", "id": 6} v 0) -- 0x7f61a006d700 con 0x7f61a0161ca0 2024-09-10T08:46:29.248 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.247+0000 7f619d600640 1 -- 172.21.15.155:0/1099879306 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3f9ddd54-ede4-4565-aff6-ae1c07e7c678", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f61980052b0 con 0x7f61a0161ca0 2024-09-10T08:46:29.248 INFO:teuthology.orchestra.run.smithi155.stdout:6 2024-09-10T08:46:29.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.248+0000 7f61a8400640 1 -- 172.21.15.155:0/1099879306 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61a0161ca0 msgr2=0x7f61a00b99e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:29.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.248+0000 7f61a8400640 1 --2- 172.21.15.155:0/1099879306 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61a0161ca0 0x7f61a00b99e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f619800c7a0 tx=0x7f619800cc60 comp rx=0 tx=0).stop 2024-09-10T08:46:29.249 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.249+0000 7f61a8400640 1 -- 172.21.15.155:0/1099879306 shutdown_connections 2024-09-10T08:46:29.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.249+0000 7f61a8400640 1 --2- 172.21.15.155:0/1099879306 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61a0161ca0 0x7f61a00b99e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:29.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.249+0000 7f61a8400640 1 --2- 172.21.15.155:0/1099879306 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61a00d2b60 0x7f61a00b94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:29.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.249+0000 7f61a8400640 1 --2- 172.21.15.155:0/1099879306 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61a00cf6f0 0x7f61a01f70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:29.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.249+0000 7f61a8400640 1 -- 172.21.15.155:0/1099879306 >> 172.21.15.155:0/1099879306 conn(0x7f61a008bfd0 msgr2=0x7f61a006e090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:46:29.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.249+0000 7f61a8400640 1 -- 172.21.15.155:0/1099879306 shutdown_connections 2024-09-10T08:46:29.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.249+0000 7f61a8400640 1 -- 172.21.15.155:0/1099879306 wait complete. 2024-09-10T08:46:29.263 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new 328d0681-eef4-4556-94e1-9745bd4adbe8 7 2024-09-10T08:46:29.303 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:46:29.301+0000 7f0af2728040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-10T08:46:29.368 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:46:29.366+0000 7f0af2728040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-10T08:46:29.413 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.413+0000 7f3f0b200640 1 Processor -- start 2024-09-10T08:46:29.414 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.413+0000 7f3f0b200640 1 -- start start 2024-09-10T08:46:29.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.414+0000 7f3f0b200640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3f040d2d30 0x7f3f040cf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:29.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.414+0000 7f3f0b200640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f040cfe50 con 0x7f3f04161ca0 2024-09-10T08:46:29.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.414+0000 7f3f0b200640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f040d0130 con 0x7f3f040cf6f0 2024-09-10T08:46:29.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.414+0000 7f3f0b200640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f3f040d34a0 con 0x7f3f040d2d30 2024-09-10T08:46:29.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.415+0000 7f3f03400640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3f040d2d30 0x7f3f040cf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:29.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.415+0000 7f3f09200640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f3f040cf6f0 0x7f3f0406d560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.155:51390/0 (socket says 172.21.15.155:51390) 2024-09-10T08:46:29.415 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.415+0000 7f3f09200640 1 -- 172.21.15.155:0/1944170764 learned_addr learned my addr 172.21.15.155:0/1944170764 (peer_addr_for_me v1:172.21.15.155:0/0) 2024-09-10T08:46:29.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.415+0000 7f3f03400640 1 -- 172.21.15.155:0/1944170764 >> v1:172.21.15.155:6789/0 conn(0x7f3f040cf6f0 legacy=0x7f3f0406d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:29.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.415+0000 7f3f03400640 1 -- 172.21.15.155:0/1944170764 >> v1:172.21.15.2:6789/0 conn(0x7f3f04161ca0 legacy=0x7f3f040d2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:29.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.415+0000 7f3f02a00640 1 -- 172.21.15.155:0/1944170764 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1954787720 0 0) 0x7f3f040d0130 con 0x7f3f040cf6f0 2024-09-10T08:46:29.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.415+0000 7f3f03400640 1 -- 172.21.15.155:0/1944170764 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f040d0410 con 0x7f3f040d2d30 2024-09-10T08:46:29.416 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.416+0000 7f3f03400640 1 --2- 172.21.15.155:0/1944170764 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3f040d2d30 0x7f3f040cf1b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3ef00097a0 tx=0x7f3ef002a0a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0951af557e93461 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:29.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.416+0000 7f3f02a00640 1 -- 172.21.15.155:0/1944170764 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef0037070 con 0x7f3f040d2d30 2024-09-10T08:46:29.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.416+0000 7f3f02a00640 1 -- 172.21.15.155:0/1944170764 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ef002ad30 con 0x7f3f040d2d30 2024-09-10T08:46:29.417 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.416+0000 7f3f02a00640 1 -- 172.21.15.155:0/1944170764 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef0032660 con 0x7f3f040d2d30 2024-09-10T08:46:29.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.417+0000 7f3f0b200640 1 -- 172.21.15.155:0/1944170764 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3f040d2d30 msgr2=0x7f3f040cf1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:29.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.417+0000 7f3f0b200640 1 --2- 172.21.15.155:0/1944170764 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3f040d2d30 0x7f3f040cf1b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3ef00097a0 tx=0x7f3ef002a0a0 comp rx=0 tx=0).stop 2024-09-10T08:46:29.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.417+0000 7f3f0b200640 1 -- 172.21.15.155:0/1944170764 shutdown_connections 2024-09-10T08:46:29.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.417+0000 7f3f0b200640 1 --2- 172.21.15.155:0/1944170764 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3f040d2d30 0x7f3f040cf1b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:29.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.417+0000 7f3f0b200640 1 -- 172.21.15.155:0/1944170764 >> 172.21.15.155:0/1944170764 conn(0x7f3f0408bfd0 msgr2=0x7f3f040d45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:46:29.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.417+0000 7f3f0b200640 1 -- 172.21.15.155:0/1944170764 shutdown_connections 2024-09-10T08:46:29.418 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.417+0000 7f3f0b200640 1 -- 172.21.15.155:0/1944170764 wait complete. 2024-09-10T08:46:29.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.419+0000 7f3f0b200640 1 Processor -- start 2024-09-10T08:46:29.419 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.419+0000 7f3f0b200640 1 -- start start 2024-09-10T08:46:29.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.420+0000 7f3f0b200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f040cf6f0 0x7f3f0414a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:29.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.420+0000 7f3f0b200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f040d2d30 0x7f3f0414b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:29.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.420+0000 7f3f0b200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3f04161ca0 0x7f3f040d0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:29.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.420+0000 7f3f0b200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3f040cfb60 con 0x7f3f040cf6f0 2024-09-10T08:46:29.421 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.420+0000 7f3f0b200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3f0406cdf0 con 0x7f3f04161ca0 2024-09-10T08:46:29.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.420+0000 7f3f0b200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3f0406dc70 con 0x7f3f040d2d30 2024-09-10T08:46:29.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.420+0000 7f3f03400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f040d2d30 0x7f3f0414b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:29.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.420+0000 7f3f09200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3f04161ca0 0x7f3f040d0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:29.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.420+0000 7f3f03400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f040d2d30 0x7f3f0414b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:37176/0 (socket says 172.21.15.155:37176) 2024-09-10T08:46:29.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.420+0000 7f3f03400640 1 -- 172.21.15.155:0/2052799810 learned_addr learned my addr 172.21.15.155:0/2052799810 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-09-10T08:46:29.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.420+0000 7f3f03e00640 1 --2- 172.21.15.155:0/2052799810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f040cf6f0 0x7f3f0414a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:29.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.421+0000 7f3f03400640 1 -- 172.21.15.155:0/2052799810 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3f04161ca0 msgr2=0x7f3f040d0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:29.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.421+0000 7f3f03400640 1 --2- 172.21.15.155:0/2052799810 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3f04161ca0 0x7f3f040d0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:29.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.421+0000 7f3f03400640 1 -- 172.21.15.155:0/2052799810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f040cf6f0 msgr2=0x7f3f0414a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:29.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.421+0000 7f3f03400640 1 --2- 172.21.15.155:0/2052799810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f040cf6f0 0x7f3f0414a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:29.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.421+0000 7f3f03400640 1 -- 172.21.15.155:0/2052799810 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f0414b5e0 con 0x7f3f040d2d30 2024-09-10T08:46:29.422 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.421+0000 7f3f09200640 1 --2- 172.21.15.155:0/2052799810 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3f04161ca0 0x7f3f040d0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:46:29.423 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.421+0000 7f3f03400640 1 --2- 172.21.15.155:0/2052799810 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f040d2d30 0x7f3f0414b0a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3ef0035040 tx=0x7f3ef00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:29.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.421+0000 7f3efbe00640 1 -- 172.21.15.155:0/2052799810 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef0037040 con 0x7f3f040d2d30 2024-09-10T08:46:29.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.421+0000 7f3efbe00640 1 -- 172.21.15.155:0/2052799810 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ef0004030 con 0x7f3f040d2d30 2024-09-10T08:46:29.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.421+0000 7f3f0b200640 1 -- 172.21.15.155:0/2052799810 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f040cda20 con 0x7f3f040d2d30 2024-09-10T08:46:29.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.421+0000 7f3efbe00640 1 -- 172.21.15.155:0/2052799810 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef0004420 con 0x7f3f040d2d30 2024-09-10T08:46:29.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.421+0000 7f3f0b200640 1 -- 172.21.15.155:0/2052799810 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f040cdfe0 con 0x7f3f040d2d30 2024-09-10T08:46:29.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.422+0000 7f3efbe00640 1 -- 172.21.15.155:0/2052799810 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3ef003a070 con 0x7f3f040d2d30 2024-09-10T08:46:29.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.422+0000 7f3efbe00640 1 -- 172.21.15.155:0/2052799810 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f3ef003cda0 con 0x7f3f040d2d30 2024-09-10T08:46:29.424 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.422+0000 7f3f0b200640 1 -- 172.21.15.155:0/2052799810 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f040cf1b0 con 0x7f3f040d2d30 2024-09-10T08:46:29.427 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.427+0000 7f3efbe00640 1 -- 172.21.15.155:0/2052799810 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f3f0414b5e0 con 0x7f3f040d2d30 2024-09-10T08:46:29.498 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.498+0000 7f3f0b200640 1 -- 172.21.15.155:0/2052799810 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd new", "uuid": "328d0681-eef4-4556-94e1-9745bd4adbe8", "id": 7} v 0) -- 0x7f3f040ce7e0 con 0x7f3f040d2d30 2024-09-10T08:46:29.511 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.511+0000 7f3efbe00640 1 -- 172.21.15.155:0/2052799810 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "328d0681-eef4-4556-94e1-9745bd4adbe8", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f3ef0041020 con 0x7f3f040d2d30 2024-09-10T08:46:29.512 INFO:teuthology.orchestra.run.smithi155.stdout:7 2024-09-10T08:46:29.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.512+0000 7f3f0b200640 1 -- 172.21.15.155:0/2052799810 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f040d2d30 msgr2=0x7f3f0414b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:29.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.512+0000 7f3f0b200640 1 --2- 172.21.15.155:0/2052799810 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f040d2d30 0x7f3f0414b0a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3ef0035040 tx=0x7f3ef00046c0 comp rx=0 tx=0).stop 2024-09-10T08:46:29.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.512+0000 7f3f0b200640 1 -- 172.21.15.155:0/2052799810 shutdown_connections 2024-09-10T08:46:29.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.512+0000 7f3f0b200640 1 --2- 172.21.15.155:0/2052799810 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3f04161ca0 0x7f3f040d0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:29.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.512+0000 7f3f0b200640 1 --2- 172.21.15.155:0/2052799810 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f040d2d30 0x7f3f0414b0a0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:29.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.512+0000 7f3f0b200640 1 --2- 172.21.15.155:0/2052799810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3f040cf6f0 0x7f3f0414a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:29.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.512+0000 7f3f0b200640 1 -- 172.21.15.155:0/2052799810 >> 172.21.15.155:0/2052799810 conn(0x7f3f0408bfd0 msgr2=0x7f3f0406d560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:46:29.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.512+0000 7f3f0b200640 1 -- 172.21.15.155:0/2052799810 shutdown_connections 2024-09-10T08:46:29.513 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:46:29.512+0000 7f3f0b200640 1 -- 172.21.15.155:0/2052799810 wait complete. 2024-09-10T08:46:29.528 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-10T08:46:29.528 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-10T08:46:29.532 INFO:tasks.ceph.osd.0:Started 2024-09-10T08:46:29.532 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-10T08:46:29.532 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-10T08:46:29.536 INFO:tasks.ceph.osd.1:Started 2024-09-10T08:46:29.536 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-10T08:46:29.536 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-10T08:46:29.540 INFO:tasks.ceph.osd.2:Started 2024-09-10T08:46:29.540 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-10T08:46:29.540 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-10T08:46:29.544 INFO:tasks.ceph.osd.3:Started 2024-09-10T08:46:29.545 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-10T08:46:29.545 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-10T08:46:29.549 INFO:tasks.ceph.osd.4:Started 2024-09-10T08:46:29.550 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-10T08:46:29.550 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-10T08:46:29.556 INFO:tasks.ceph.osd.5:Started 2024-09-10T08:46:29.557 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-10T08:46:29.557 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-10T08:46:29.560 INFO:tasks.ceph.osd.6:Started 2024-09-10T08:46:29.560 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-10T08:46:29.560 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-10T08:46:29.565 INFO:tasks.ceph.osd.7:Started 2024-09-10T08:46:29.565 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:46:29.634 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:46:29.634+0000 7f4648928040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-10T08:46:29.745 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:46:29.744+0000 7f4648928040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-10T08:46:29.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:29.792+0000 7fdb18400640 1 Processor -- start 2024-09-10T08:46:29.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:29.792+0000 7fdb18400640 1 -- start start 2024-09-10T08:46:29.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:29.793+0000 7fdb18400640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fdb1015e6b0 0x7fdb100d4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:29.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:29.793+0000 7fdb18400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fdb100d5210 0x7fdb100d2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:29.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:29.793+0000 7fdb18400640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb100d1120 con 0x7fdb1006ce60 2024-09-10T08:46:29.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:29.793+0000 7fdb18400640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fdb100d1a50 con 0x7fdb100d5210 2024-09-10T08:46:29.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:29.793+0000 7fdb18400640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fdb100d1400 con 0x7fdb1015e6b0 2024-09-10T08:46:29.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:29.794+0000 7fdb15000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fdb100d5210 0x7fdb100d2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:29.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:29.794+0000 7fdb15000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fdb100d5210 0x7fdb100d2ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53812/0 (socket says 172.21.15.2:53812) 2024-09-10T08:46:29.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:29.794+0000 7fdb15000640 1 -- 172.21.15.2:0/249099170 learned_addr learned my addr 172.21.15.2:0/249099170 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:46:29.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:29.794+0000 7fdb15a00640 1 --2- 172.21.15.2:0/249099170 >> v2:172.21.15.155:3300/0 conn(0x7fdb1015e6b0 0x7fdb100d4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:29.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:29.794+0000 7fdb15000640 1 -- 172.21.15.2:0/249099170 >> v2:172.21.15.155:3300/0 conn(0x7fdb1015e6b0 msgr2=0x7fdb100d4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:46:29.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:29.794+0000 7fdb15000640 1 --2- 172.21.15.2:0/249099170 >> v2:172.21.15.155:3300/0 conn(0x7fdb1015e6b0 0x7fdb100d4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:29.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:29.794+0000 7fdb15000640 1 -- 172.21.15.2:0/249099170 >> v1:172.21.15.155:6789/0 conn(0x7fdb1006ce60 legacy=0x7fdb100cf7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:29.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:29.794+0000 7fdb15000640 1 -- 172.21.15.2:0/249099170 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb100d16e0 con 0x7fdb100d5210 2024-09-10T08:46:29.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:29.795+0000 7fdb15000640 1 --2- 172.21.15.2:0/249099170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb100d5210 0x7fdb100d2ba0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fdb1008cdc0 tx=0x7fdafc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cb02bb8b14e169f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:29.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:29.795+0000 7fdb0fe00640 1 -- 172.21.15.2:0/249099170 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdafc037070 con 0x7fdb100d5210 2024-09-10T08:46:29.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:29.796+0000 7fdb0fe00640 1 -- 172.21.15.2:0/249099170 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdafc032440 con 0x7fdb100d5210 2024-09-10T08:46:29.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:29.796+0000 7fdb0fe00640 1 -- 172.21.15.2:0/249099170 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdafc032810 con 0x7fdb100d5210 2024-09-10T08:46:29.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:29.796+0000 7fdb18400640 1 -- 172.21.15.2:0/249099170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb100d5210 msgr2=0x7fdb100d2ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:29.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:29.796+0000 7fdb18400640 1 --2- 172.21.15.2:0/249099170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb100d5210 0x7fdb100d2ba0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fdb1008cdc0 tx=0x7fdafc02a1e0 comp rx=0 tx=0).stop 2024-09-10T08:46:29.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:29.796+0000 7fdb18400640 1 -- 172.21.15.2:0/249099170 shutdown_connections 2024-09-10T08:46:29.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:29.796+0000 7fdb18400640 1 --2- 172.21.15.2:0/249099170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb100d5210 0x7fdb100d2ba0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:29.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:29.796+0000 7fdb18400640 1 --2- 172.21.15.2:0/249099170 >> v2:172.21.15.155:3300/0 conn(0x7fdb1015e6b0 0x7fdb100d4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:29.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:29.796+0000 7fdb18400640 1 -- 172.21.15.2:0/249099170 >> 172.21.15.2:0/249099170 conn(0x7fdb1008bfd0 msgr2=0x7fdb100d45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:46:29.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:29.796+0000 7fdb18400640 1 -- 172.21.15.2:0/249099170 shutdown_connections 2024-09-10T08:46:29.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:29.796+0000 7fdb18400640 1 -- 172.21.15.2:0/249099170 wait complete. 2024-09-10T08:46:29.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:29.798+0000 7fdb18400640 1 Processor -- start 2024-09-10T08:46:29.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:29.798+0000 7fdb18400640 1 -- start start 2024-09-10T08:46:29.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:29.799+0000 7fdb18400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb1006ce60 0x7fdb10155e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:29.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:29.799+0000 7fdb18400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb100d5210 0x7fdb1015eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:29.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:29.799+0000 7fdb18400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb1015e6b0 0x7fdb100b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:29.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:29.799+0000 7fdb18400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdb100d0db0 con 0x7fdb1015e6b0 2024-09-10T08:46:29.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:29.799+0000 7fdb18400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fdb100cf210 con 0x7fdb1006ce60 2024-09-10T08:46:29.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:29.799+0000 7fdb18400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fdb100d30e0 con 0x7fdb100d5210 2024-09-10T08:46:29.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:29.799+0000 7fdb16400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb1015e6b0 0x7fdb100b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:29.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:29.799+0000 7fdb15000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb100d5210 0x7fdb1015eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:29.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:29.799+0000 7fdb15a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb1006ce60 0x7fdb10155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:29.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:29.799+0000 7fdb15000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb100d5210 0x7fdb1015eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.2:54886/0 (socket says 172.21.15.2:54886) 2024-09-10T08:46:29.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:29.799+0000 7fdb15a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb1006ce60 0x7fdb10155e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.2:33422/0 (socket says 172.21.15.2:33422) 2024-09-10T08:46:29.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:29.799+0000 7fdb15000640 1 -- 172.21.15.2:0/108044488 learned_addr learned my addr 172.21.15.2:0/108044488 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:46:29.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:29.800+0000 7fdb15000640 1 -- 172.21.15.2:0/108044488 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb1006ce60 msgr2=0x7fdb10155e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:29.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:29.800+0000 7fdb15000640 1 --2- 172.21.15.2:0/108044488 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb1006ce60 0x7fdb10155e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:29.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:29.800+0000 7fdb15000640 1 -- 172.21.15.2:0/108044488 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb1015e6b0 msgr2=0x7fdb100b1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:29.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:29.800+0000 7fdb15000640 1 --2- 172.21.15.2:0/108044488 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb1015e6b0 0x7fdb100b1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:29.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:29.800+0000 7fdb15000640 1 -- 172.21.15.2:0/108044488 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb1015f760 con 0x7fdb100d5210 2024-09-10T08:46:29.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:29.800+0000 7fdb15a00640 1 --2- 172.21.15.2:0/108044488 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb1006ce60 0x7fdb10155e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:46:29.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:29.800+0000 7fdb15000640 1 --2- 172.21.15.2:0/108044488 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb100d5210 0x7fdb1015eca0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fdafc02a220 tx=0x7fdafc0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:29.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:29.800+0000 7fdb0d600640 1 -- 172.21.15.2:0/108044488 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdafc037040 con 0x7fdb100d5210 2024-09-10T08:46:29.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:29.800+0000 7fdb0d600640 1 -- 172.21.15.2:0/108044488 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdafc042070 con 0x7fdb100d5210 2024-09-10T08:46:29.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:29.800+0000 7fdb18400640 1 -- 172.21.15.2:0/108044488 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb1015fa40 con 0x7fdb100d5210 2024-09-10T08:46:29.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:29.801+0000 7fdb0d600640 1 -- 172.21.15.2:0/108044488 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdafc030880 con 0x7fdb100d5210 2024-09-10T08:46:29.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:29.801+0000 7fdb18400640 1 -- 172.21.15.2:0/108044488 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb10160000 con 0x7fdb100d5210 2024-09-10T08:46:29.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:29.801+0000 7fdb0d600640 1 -- 172.21.15.2:0/108044488 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fdafc030a20 con 0x7fdb100d5210 2024-09-10T08:46:29.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:29.801+0000 7fdb0d600640 1 -- 172.21.15.2:0/108044488 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fdafc030d10 con 0x7fdb100d5210 2024-09-10T08:46:29.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:29.802+0000 7fdb18400640 1 -- 172.21.15.2:0/108044488 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb100d2ba0 con 0x7fdb100d5210 2024-09-10T08:46:29.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:29.804+0000 7fdb0d600640 1 -- 172.21.15.2:0/108044488 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fdafc047460 con 0x7fdb100d5210 2024-09-10T08:46:29.867 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:46:29.867+0000 7f4648928040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-10T08:46:29.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:29.867+0000 7fdb18400640 1 -- 172.21.15.2:0/108044488 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdb100d1d20 con 0x7fdb100d5210 2024-09-10T08:46:29.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:29.868+0000 7fdb0d600640 1 -- 172.21.15.2:0/108044488 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fdafc047640 con 0x7fdb100d5210 2024-09-10T08:46:29.869 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:46:29.869 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":10,"fsid":"f20a15a7-d363-4d44-98cb-4f4f466b52b8","created":"2024-09-10T08:46:26.481619+0000","modified":"2024-09-10T08:46:29.499894+0000","last_up_change":"0.000000","last_in_change":"2024-09-10T08:46:29.499894+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c90be333-506b-46d1-b00a-10d089a84776","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3f8bdde8-6cd3-4112-8939-a876191c7368","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3835f5ab-ed3a-4f46-ae6c-f0edf21708d7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"add6ad27-b411-4a82-9622-b0c1c1782cf1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c7b642f4-8bd2-4262-9a82-ee1061cfab7b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"fb53289a-419f-46d8-9e3a-384ac529dc57","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"3f9ddd54-ede4-4565-aff6-ae1c07e7c678","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"328d0681-eef4-4556-94e1-9745bd4adbe8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:46:29.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:29.869+0000 7fdb18400640 1 -- 172.21.15.2:0/108044488 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb100d5210 msgr2=0x7fdb1015eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:29.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:29.869+0000 7fdb18400640 1 --2- 172.21.15.2:0/108044488 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb100d5210 0x7fdb1015eca0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fdafc02a220 tx=0x7fdafc0046c0 comp rx=0 tx=0).stop 2024-09-10T08:46:29.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:29.869+0000 7fdb18400640 1 -- 172.21.15.2:0/108044488 shutdown_connections 2024-09-10T08:46:29.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:29.869+0000 7fdb18400640 1 --2- 172.21.15.2:0/108044488 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdb1015e6b0 0x7fdb100b1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:29.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:29.869+0000 7fdb18400640 1 --2- 172.21.15.2:0/108044488 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb100d5210 0x7fdb1015eca0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:29.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:29.869+0000 7fdb18400640 1 --2- 172.21.15.2:0/108044488 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb1006ce60 0x7fdb10155e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:29.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:29.869+0000 7fdb18400640 1 -- 172.21.15.2:0/108044488 >> 172.21.15.2:0/108044488 conn(0x7fdb1008bfd0 msgr2=0x7fdb100b7460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:46:29.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:29.869+0000 7fdb18400640 1 -- 172.21.15.2:0/108044488 shutdown_connections 2024-09-10T08:46:29.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:29.869+0000 7fdb18400640 1 -- 172.21.15.2:0/108044488 wait complete. 2024-09-10T08:46:29.887 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-10T08:46:29.888 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-10T08:46:29.906 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:46:29.905+0000 7f0af2728040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-10T08:46:29.924 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:46:29.924+0000 7f4648928040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-10T08:46:30.009 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:46:30.008+0000 7f0af2728040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-10T08:46:30.054 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:46:30.054+0000 7f4648928040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-10T08:46:30.116 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:46:30.116+0000 7f4648928040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-10T08:46:30.136 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:46:30.135+0000 7f0af2728040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-10T08:46:30.169 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:46:30.169+0000 7f4648928040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-10T08:46:30.193 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:46:30.192+0000 7f0af2728040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-10T08:46:30.295 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:46:30.295+0000 7f4648928040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-10T08:46:30.327 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:46:30.326+0000 7f0af2728040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-10T08:46:30.355 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:46:30.354+0000 7f4648928040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-10T08:46:30.393 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:46:30.392+0000 7f0af2728040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-10T08:46:30.414 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:46:30.413+0000 7f4648928040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-10T08:46:30.448 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:46:30.447+0000 7f0af2728040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-10T08:46:30.492 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:46:30.492+0000 7f4648928040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-10T08:46:30.545 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:46:30.544+0000 7f4648928040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-10T08:46:30.581 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:46:30.580+0000 7f0af2728040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-10T08:46:30.598 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:46:30.598+0000 7f4648928040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-10T08:46:30.643 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:46:30.641+0000 7f0af2728040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-10T08:46:30.693 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-10T08:46:30.706 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:46:30.705+0000 7f0af2728040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-10T08:46:30.789 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:46:30.788+0000 7f0af2728040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-10T08:46:30.830 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:30.829+0000 7f499d200640 1 Processor -- start 2024-09-10T08:46:30.830 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:30.829+0000 7f499d200640 1 -- start start 2024-09-10T08:46:30.832 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:30.830+0000 7f499d200640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f49980d2bf0 0x7f49980d3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:30.832 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:30.830+0000 7f499d200640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49980b58b0 con 0x7f49980b7460 2024-09-10T08:46:30.832 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:30.830+0000 7f499d200640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49980cf600 con 0x7f49980b4da0 2024-09-10T08:46:30.832 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:30.830+0000 7f499d200640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f49980d35a0 con 0x7f49980d2bf0 2024-09-10T08:46:30.832 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:30.831+0000 7f4996800640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f49980b7460 0x7f49980b7870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41234/0 (socket says 172.21.15.2:41234) 2024-09-10T08:46:30.832 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:30.831+0000 7f4996800640 1 -- 172.21.15.2:0/488853989 learned_addr learned my addr 172.21.15.2:0/488853989 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:46:30.832 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:30.831+0000 7f498fe00640 1 --2- 172.21.15.2:0/488853989 >> v2:172.21.15.155:3300/0 conn(0x7f49980d2bf0 0x7f49980d3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:30.833 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:30.831+0000 7f4995400640 1 -- 172.21.15.2:0/488853989 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3587913035 0 0) 0x7f49980b58b0 con 0x7f49980b7460 2024-09-10T08:46:30.833 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:30.831+0000 7f4995400640 1 -- 172.21.15.2:0/488853989 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f497c003520 con 0x7f49980b7460 2024-09-10T08:46:30.833 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:30.831+0000 7f498fe00640 1 -- 172.21.15.2:0/488853989 >> v1:172.21.15.155:6789/0 conn(0x7f49980b4da0 legacy=0x7f49980b51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:30.833 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:30.831+0000 7f498fe00640 1 -- 172.21.15.2:0/488853989 >> v1:172.21.15.2:6789/0 conn(0x7f49980b7460 legacy=0x7f49980b7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:30.833 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:30.831+0000 7f498fe00640 1 -- 172.21.15.2:0/488853989 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49980cf8e0 con 0x7f49980d2bf0 2024-09-10T08:46:30.834 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:30.832+0000 7f498fe00640 1 --2- 172.21.15.2:0/488853989 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49980d2bf0 0x7f49980d3060 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f49800097a0 tx=0x7f498002a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba32ffd46baa7d1c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:30.834 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:30.833+0000 7f4995400640 1 -- 172.21.15.2:0/488853989 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4980037070 con 0x7f49980d2bf0 2024-09-10T08:46:30.834 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:30.833+0000 7f4995400640 1 -- 172.21.15.2:0/488853989 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4980032440 con 0x7f49980d2bf0 2024-09-10T08:46:30.835 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:30.833+0000 7f4995400640 1 -- 172.21.15.2:0/488853989 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4980032810 con 0x7f49980d2bf0 2024-09-10T08:46:30.835 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:30.833+0000 7f499d200640 1 -- 172.21.15.2:0/488853989 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49980d2bf0 msgr2=0x7f49980d3060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:30.835 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:30.833+0000 7f499d200640 1 --2- 172.21.15.2:0/488853989 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49980d2bf0 0x7f49980d3060 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f49800097a0 tx=0x7f498002a1a0 comp rx=0 tx=0).stop 2024-09-10T08:46:30.835 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:30.833+0000 7f499d200640 1 -- 172.21.15.2:0/488853989 shutdown_connections 2024-09-10T08:46:30.835 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:30.833+0000 7f499d200640 1 --2- 172.21.15.2:0/488853989 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49980d2bf0 0x7f49980d3060 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:30.835 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:30.833+0000 7f499d200640 1 -- 172.21.15.2:0/488853989 >> 172.21.15.2:0/488853989 conn(0x7f499808bff0 msgr2=0x7f49980d4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:46:30.835 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:30.833+0000 7f499d200640 1 -- 172.21.15.2:0/488853989 shutdown_connections 2024-09-10T08:46:30.835 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:30.833+0000 7f499d200640 1 -- 172.21.15.2:0/488853989 wait complete. 2024-09-10T08:46:30.836 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:30.835+0000 7f499d200640 1 Processor -- start 2024-09-10T08:46:30.836 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:30.835+0000 7f499d200640 1 -- start start 2024-09-10T08:46:30.838 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:30.836+0000 7f499d200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49980b4da0 0x7f499815bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:30.838 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:30.836+0000 7f499d200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49980b7460 0x7f49980b2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:30.838 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:30.836+0000 7f499d200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49980d2bf0 0x7f49980ca950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:30.838 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:30.836+0000 7f499d200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f49980cfea0 con 0x7f49980d2bf0 2024-09-10T08:46:30.838 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:30.836+0000 7f499d200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f49980cf220 con 0x7f49980b7460 2024-09-10T08:46:30.838 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:30.836+0000 7f499d200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f49980cf3a0 con 0x7f49980b4da0 2024-09-10T08:46:30.838 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:30.836+0000 7f4996800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49980d2bf0 0x7f49980ca950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:30.838 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:30.836+0000 7f498fe00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49980b7460 0x7f49980b2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:30.838 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:30.836+0000 7f4996800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49980d2bf0 0x7f49980ca950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53836/0 (socket says 172.21.15.2:53836) 2024-09-10T08:46:30.838 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:30.836+0000 7f4996800640 1 -- 172.21.15.2:0/2762088570 learned_addr learned my addr 172.21.15.2:0/2762088570 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:46:30.838 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:30.836+0000 7f4995e00640 1 --2- 172.21.15.2:0/2762088570 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49980b4da0 0x7f499815bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:30.839 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:30.836+0000 7f498fe00640 1 -- 172.21.15.2:0/2762088570 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49980b4da0 msgr2=0x7f499815bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:30.839 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:30.836+0000 7f498fe00640 1 --2- 172.21.15.2:0/2762088570 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49980b4da0 0x7f499815bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:30.839 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:30.837+0000 7f498fe00640 1 -- 172.21.15.2:0/2762088570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49980d2bf0 msgr2=0x7f49980ca950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:30.839 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:30.837+0000 7f498fe00640 1 --2- 172.21.15.2:0/2762088570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49980d2bf0 0x7f49980ca950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:30.839 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:30.837+0000 7f498fe00640 1 -- 172.21.15.2:0/2762088570 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49980b2b80 con 0x7f49980b7460 2024-09-10T08:46:30.839 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:30.837+0000 7f4996800640 1 --2- 172.21.15.2:0/2762088570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49980d2bf0 0x7f49980ca950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:46:30.840 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:30.837+0000 7f498fe00640 1 --2- 172.21.15.2:0/2762088570 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49980b7460 0x7f49980b2410 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4980031000 tx=0x7f49800046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:30.840 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:30.837+0000 7f498e000640 1 -- 172.21.15.2:0/2762088570 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4980041030 con 0x7f49980b7460 2024-09-10T08:46:30.840 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:30.837+0000 7f498e000640 1 -- 172.21.15.2:0/2762088570 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4980030500 con 0x7f49980b7460 2024-09-10T08:46:30.840 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:30.837+0000 7f498e000640 1 -- 172.21.15.2:0/2762088570 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4980037040 con 0x7f49980b7460 2024-09-10T08:46:30.840 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:30.837+0000 7f499d200640 1 -- 172.21.15.2:0/2762088570 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49980b2e60 con 0x7f49980b7460 2024-09-10T08:46:30.840 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:30.837+0000 7f499d200640 1 -- 172.21.15.2:0/2762088570 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49980b3420 con 0x7f49980b7460 2024-09-10T08:46:30.840 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:30.838+0000 7f498e000640 1 -- 172.21.15.2:0/2762088570 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4980044070 con 0x7f49980b7460 2024-09-10T08:46:30.841 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:30.838+0000 7f498e000640 1 -- 172.21.15.2:0/2762088570 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f498003d650 con 0x7f49980b7460 2024-09-10T08:46:30.841 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:30.838+0000 7f499d200640 1 -- 172.21.15.2:0/2762088570 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49980d3060 con 0x7f49980b7460 2024-09-10T08:46:30.842 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:30.841+0000 7f498e000640 1 -- 172.21.15.2:0/2762088570 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f498003d8e0 con 0x7f49980b7460 2024-09-10T08:46:30.846 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:46:30.845+0000 7f0af2728040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-10T08:46:30.878 INFO:tasks.ceph.osd.2.smithi002.stderr:2024-09-10T08:46:30.877+0000 7f8c1e14d640 -1 Falling back to public interface 2024-09-10T08:46:30.902 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:46:30.901+0000 7f0af2728040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-10T08:46:30.906 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:30.905+0000 7f499d200640 1 -- 172.21.15.2:0/2762088570 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f49980d1de0 con 0x7f49980b7460 2024-09-10T08:46:30.907 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:30.906+0000 7f498e000640 1 -- 172.21.15.2:0/2762088570 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f498003dac0 con 0x7f49980b7460 2024-09-10T08:46:30.907 INFO:teuthology.misc.health.smithi002.stdout: 2024-09-10T08:46:30.908 INFO:teuthology.misc.health.smithi002.stdout:{"epoch":10,"fsid":"f20a15a7-d363-4d44-98cb-4f4f466b52b8","created":"2024-09-10T08:46:26.481619+0000","modified":"2024-09-10T08:46:29.499894+0000","last_up_change":"0.000000","last_in_change":"2024-09-10T08:46:29.499894+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c90be333-506b-46d1-b00a-10d089a84776","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3f8bdde8-6cd3-4112-8939-a876191c7368","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3835f5ab-ed3a-4f46-ae6c-f0edf21708d7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"add6ad27-b411-4a82-9622-b0c1c1782cf1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c7b642f4-8bd2-4262-9a82-ee1061cfab7b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"fb53289a-419f-46d8-9e3a-384ac529dc57","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"3f9ddd54-ede4-4565-aff6-ae1c07e7c678","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"328d0681-eef4-4556-94e1-9745bd4adbe8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:46:30.908 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:30.907+0000 7f499d200640 1 -- 172.21.15.2:0/2762088570 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49980b7460 msgr2=0x7f49980b2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:30.909 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:30.907+0000 7f499d200640 1 --2- 172.21.15.2:0/2762088570 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49980b7460 0x7f49980b2410 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4980031000 tx=0x7f49800046c0 comp rx=0 tx=0).stop 2024-09-10T08:46:30.909 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:30.907+0000 7f499d200640 1 -- 172.21.15.2:0/2762088570 shutdown_connections 2024-09-10T08:46:30.909 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:30.907+0000 7f499d200640 1 --2- 172.21.15.2:0/2762088570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f49980d2bf0 0x7f49980ca950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:30.909 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:30.907+0000 7f499d200640 1 --2- 172.21.15.2:0/2762088570 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49980b7460 0x7f49980b2410 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:30.909 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:30.907+0000 7f499d200640 1 --2- 172.21.15.2:0/2762088570 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f49980b4da0 0x7f499815bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:30.909 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:30.907+0000 7f499d200640 1 -- 172.21.15.2:0/2762088570 >> 172.21.15.2:0/2762088570 conn(0x7f499808bff0 msgr2=0x7f49980d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:46:30.909 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:30.907+0000 7f499d200640 1 -- 172.21.15.2:0/2762088570 shutdown_connections 2024-09-10T08:46:30.909 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:30.907+0000 7f499d200640 1 -- 172.21.15.2:0/2762088570 wait complete. 2024-09-10T08:46:30.920 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-10T08:46:31.081 INFO:tasks.ceph.osd.1.smithi002.stderr:2024-09-10T08:46:31.080+0000 7fad9f82c640 -1 Falling back to public interface 2024-09-10T08:46:31.085 INFO:tasks.ceph.osd.3.smithi002.stderr:2024-09-10T08:46:31.084+0000 7f91d160b640 -1 Falling back to public interface 2024-09-10T08:46:31.087 INFO:tasks.ceph.osd.7.smithi155.stderr:2024-09-10T08:46:31.087+0000 7f806c80b640 -1 Falling back to public interface 2024-09-10T08:46:31.087 INFO:tasks.ceph.osd.5.smithi155.stderr:2024-09-10T08:46:31.087+0000 7fe1cd81a640 -1 Falling back to public interface 2024-09-10T08:46:31.088 INFO:tasks.ceph.osd.4.smithi155.stderr:2024-09-10T08:46:31.087+0000 7fa053b1d640 -1 Falling back to public interface 2024-09-10T08:46:31.090 INFO:tasks.ceph.osd.0.smithi002.stderr:2024-09-10T08:46:31.089+0000 7f06eb824640 -1 Falling back to public interface 2024-09-10T08:46:31.144 INFO:tasks.ceph.osd.6.smithi155.stderr:2024-09-10T08:46:31.144+0000 7f62f261e640 -1 Falling back to public interface 2024-09-10T08:46:31.353 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:46:31.353+0000 7f4648928040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-10T08:46:31.696 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:46:31.694+0000 7f0af2728040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-10T08:46:32.377 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:46:32.373+0000 7f45e8200640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-10T08:46:32.377 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:46:32.375+0000 7f45e8200640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-10T08:46:34.750 INFO:tasks.ceph.osd.7.smithi155.stderr:2024-09-10T08:46:34.750+0000 7f806c80b640 -1 osd.7 0 log_to_monitors true 2024-09-10T08:46:34.785 INFO:tasks.ceph.osd.3.smithi002.stderr:2024-09-10T08:46:34.784+0000 7f91d160b640 -1 osd.3 0 log_to_monitors true 2024-09-10T08:46:34.872 INFO:tasks.ceph.osd.4.smithi155.stderr:2024-09-10T08:46:34.872+0000 7fa053b1d640 -1 osd.4 0 log_to_monitors true 2024-09-10T08:46:35.058 INFO:tasks.ceph.osd.0.smithi002.stderr:2024-09-10T08:46:35.057+0000 7f06eb824640 -1 osd.0 0 log_to_monitors true 2024-09-10T08:46:35.058 INFO:tasks.ceph.osd.2.smithi002.stderr:2024-09-10T08:46:35.057+0000 7f8c1e14d640 -1 osd.2 0 log_to_monitors true 2024-09-10T08:46:35.063 INFO:tasks.ceph.osd.1.smithi002.stderr:2024-09-10T08:46:35.062+0000 7fad9f82c640 -1 osd.1 0 log_to_monitors true 2024-09-10T08:46:35.065 INFO:tasks.ceph.osd.6.smithi155.stderr:2024-09-10T08:46:35.065+0000 7f62f261e640 -1 osd.6 0 log_to_monitors true 2024-09-10T08:46:35.283 INFO:tasks.ceph.osd.5.smithi155.stderr:2024-09-10T08:46:35.282+0000 7fe1cd81a640 -1 osd.5 0 log_to_monitors true 2024-09-10T08:46:37.701 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:46:37.708 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:46:37.727 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-10T08:46:37.979 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:37.977+0000 7f32ca400640 1 Processor -- start 2024-09-10T08:46:37.979 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:37.978+0000 7f32ca400640 1 -- start start 2024-09-10T08:46:37.980 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:37.979+0000 7f32ca400640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f32bc005ab0 0x7f32bc053f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:37.982 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:37.980+0000 7f32ca400640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32bc052330 con 0x7f32bc0e7120 2024-09-10T08:46:37.982 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:37.980+0000 7f32ca400640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32bc006cd0 con 0x7f32bc04eb60 2024-09-10T08:46:37.982 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:37.980+0000 7f32ca400640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f32bc0520e0 con 0x7f32bc005ab0 2024-09-10T08:46:37.982 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:37.980+0000 7f32c9a00640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f32bc04eb60 0x7f32bc01d530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.2:33304/0 (socket says 172.21.15.2:33304) 2024-09-10T08:46:37.982 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:37.980+0000 7f32c9a00640 1 -- 172.21.15.2:0/2315395819 learned_addr learned my addr 172.21.15.2:0/2315395819 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:46:37.982 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:37.981+0000 7f32c9000640 1 --2- 172.21.15.2:0/2315395819 >> v2:172.21.15.155:3300/0 conn(0x7f32bc005ab0 0x7f32bc053f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:37.982 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:37.981+0000 7f32c3400640 1 -- 172.21.15.2:0/2315395819 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3203816275 0 0) 0x7f32bc006cd0 con 0x7f32bc04eb60 2024-09-10T08:46:37.983 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:37.981+0000 7f32c3400640 1 -- 172.21.15.2:0/2315395819 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f32ac003520 con 0x7f32bc04eb60 2024-09-10T08:46:37.983 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:37.981+0000 7f32c9000640 1 -- 172.21.15.2:0/2315395819 >> v1:172.21.15.155:6789/0 conn(0x7f32bc04eb60 legacy=0x7f32bc01d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:37.983 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:37.981+0000 7f32c3400640 1 -- 172.21.15.2:0/2315395819 <== mon.1 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1814504671 0 0) 0x7f32ac003520 con 0x7f32bc04eb60 2024-09-10T08:46:37.983 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:37.981+0000 7f32c9000640 1 -- 172.21.15.2:0/2315395819 >> v1:172.21.15.2:6789/0 conn(0x7f32bc0e7120 legacy=0x7f32bc005e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:37.983 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:37.981+0000 7f32c9000640 1 -- 172.21.15.2:0/2315395819 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32bc006fb0 con 0x7f32bc005ab0 2024-09-10T08:46:37.983 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:37.982+0000 7f32c9000640 1 --2- 172.21.15.2:0/2315395819 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f32bc005ab0 0x7f32bc053f50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f32b4009710 tx=0x7f32b402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=148f58a0cbca5848 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:37.984 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:37.983+0000 7f32c3400640 1 -- 172.21.15.2:0/2315395819 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32b4037070 con 0x7f32bc005ab0 2024-09-10T08:46:37.984 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:37.983+0000 7f32c3400640 1 -- 172.21.15.2:0/2315395819 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32b402ac90 con 0x7f32bc005ab0 2024-09-10T08:46:37.985 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:37.983+0000 7f32c3400640 1 -- 172.21.15.2:0/2315395819 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c40504d0 con 0x7f32bc005ab0 2024-09-10T08:46:37.986 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:37.984+0000 7f32ca400640 1 -- 172.21.15.2:0/2315395819 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f32bc005ab0 msgr2=0x7f32bc053f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:37.986 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:37.984+0000 7f32ca400640 1 --2- 172.21.15.2:0/2315395819 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f32bc005ab0 0x7f32bc053f50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f32b4009710 tx=0x7f32b402a180 comp rx=0 tx=0).stop 2024-09-10T08:46:37.986 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:37.985+0000 7f32ca400640 1 -- 172.21.15.2:0/2315395819 shutdown_connections 2024-09-10T08:46:37.986 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:37.985+0000 7f32ca400640 1 --2- 172.21.15.2:0/2315395819 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f32bc005ab0 0x7f32bc053f50 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:37.986 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:37.985+0000 7f32ca400640 1 -- 172.21.15.2:0/2315395819 >> 172.21.15.2:0/2315395819 conn(0x7f32bc036090 msgr2=0x7f32bc0364a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:46:37.986 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:37.985+0000 7f32ca400640 1 -- 172.21.15.2:0/2315395819 shutdown_connections 2024-09-10T08:46:37.987 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:37.985+0000 7f32ca400640 1 -- 172.21.15.2:0/2315395819 wait complete. 2024-09-10T08:46:37.990 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:37.987+0000 7f32ca400640 1 Processor -- start 2024-09-10T08:46:37.990 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:37.987+0000 7f32ca400640 1 -- start start 2024-09-10T08:46:37.990 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:37.988+0000 7f32ca400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32bc005ab0 0x7f32bc0dc420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:37.990 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:37.988+0000 7f32ca400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f32bc04eb60 0x7f32bc17fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:37.990 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:37.988+0000 7f32ca400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f32bc0e7120 0x7f32bc038dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:37.990 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:37.988+0000 7f32ca400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f32bc01dc40 con 0x7f32bc005ab0 2024-09-10T08:46:37.990 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:37.988+0000 7f32ca400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f32bc053a10 con 0x7f32bc0e7120 2024-09-10T08:46:37.990 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:37.988+0000 7f32ca400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f32bc01ddc0 con 0x7f32bc04eb60 2024-09-10T08:46:37.992 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:37.989+0000 7f32c9000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32bc005ab0 0x7f32bc0dc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:37.992 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:37.989+0000 7f32c9000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32bc005ab0 0x7f32bc0dc420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59154/0 (socket says 172.21.15.2:59154) 2024-09-10T08:46:37.993 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:37.989+0000 7f32c9000640 1 -- 172.21.15.2:0/1197677126 learned_addr learned my addr 172.21.15.2:0/1197677126 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:46:37.993 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:37.989+0000 7f32c9a00640 1 --2- 172.21.15.2:0/1197677126 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f32bc0e7120 0x7f32bc038dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:37.993 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:37.990+0000 7f32c3e00640 1 --2- 172.21.15.2:0/1197677126 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f32bc04eb60 0x7f32bc17fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:37.993 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:37.990+0000 7f32c9a00640 1 -- 172.21.15.2:0/1197677126 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f32bc04eb60 msgr2=0x7f32bc17fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:37.993 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:37.990+0000 7f32c9a00640 1 --2- 172.21.15.2:0/1197677126 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f32bc04eb60 0x7f32bc17fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:37.993 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:37.990+0000 7f32c9a00640 1 -- 172.21.15.2:0/1197677126 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32bc005ab0 msgr2=0x7f32bc0dc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:37.993 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:37.990+0000 7f32c9a00640 1 --2- 172.21.15.2:0/1197677126 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32bc005ab0 0x7f32bc0dc420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:37.994 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:37.990+0000 7f32c9a00640 1 -- 172.21.15.2:0/1197677126 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32bc180900 con 0x7f32bc0e7120 2024-09-10T08:46:37.994 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:37.990+0000 7f32c9a00640 1 --2- 172.21.15.2:0/1197677126 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f32bc0e7120 0x7f32bc038dd0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f32c4076b40 tx=0x7f32c4074400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:37.994 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:37.991+0000 7f32c0c00640 1 -- 172.21.15.2:0/1197677126 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c406a210 con 0x7f32bc0e7120 2024-09-10T08:46:37.994 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:37.991+0000 7f32c0c00640 1 -- 172.21.15.2:0/1197677126 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32c406e110 con 0x7f32bc0e7120 2024-09-10T08:46:37.994 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:37.991+0000 7f32c0c00640 1 -- 172.21.15.2:0/1197677126 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c406e520 con 0x7f32bc0e7120 2024-09-10T08:46:37.994 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:37.991+0000 7f32ca400640 1 -- 172.21.15.2:0/1197677126 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32bc180be0 con 0x7f32bc0e7120 2024-09-10T08:46:37.994 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:37.991+0000 7f32ca400640 1 -- 172.21.15.2:0/1197677126 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32bc0dc960 con 0x7f32bc0e7120 2024-09-10T08:46:37.994 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:37.993+0000 7f32c0c00640 1 -- 172.21.15.2:0/1197677126 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 4) ==== 90442+0+0 (secure 0 0 0) 0x7f32c406e6c0 con 0x7f32bc0e7120 2024-09-10T08:46:37.996 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:37.994+0000 7f32c0c00640 1 --2- 172.21.15.2:0/1197677126 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f32a806bda0 0x7f32a806e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:37.996 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:37.994+0000 7f32c0c00640 1 -- 172.21.15.2:0/1197677126 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7f32c4105dd0 con 0x7f32bc0e7120 2024-09-10T08:46:37.996 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:37.995+0000 7f32c9000640 1 --2- 172.21.15.2:0/1197677126 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f32a806bda0 0x7f32a806e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:37.997 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:37.996+0000 7f32c9000640 1 --2- 172.21.15.2:0/1197677126 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f32a806bda0 0x7f32a806e260 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f32b402a1c0 tx=0x7f32b402e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:37.997 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:37.996+0000 7f32ca400640 1 -- 172.21.15.2:0/1197677126 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32bc04b5e0 con 0x7f32bc0e7120 2024-09-10T08:46:38.006 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:38.005+0000 7f32c0c00640 1 -- 172.21.15.2:0/1197677126 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f32c40d4f90 con 0x7f32bc0e7120 2024-09-10T08:46:38.330 INFO:tasks.ceph.osd.3.smithi002.stderr:2024-09-10T08:46:38.329+0000 7f91cbe00640 -1 osd.3 0 waiting for initial osdmap 2024-09-10T08:46:38.343 INFO:tasks.ceph.osd.3.smithi002.stderr:2024-09-10T08:46:38.341+0000 7f91c1e00640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T08:46:38.354 INFO:tasks.ceph.osd.0.smithi002.stderr:2024-09-10T08:46:38.353+0000 7f06e6200640 -1 osd.0 0 waiting for initial osdmap 2024-09-10T08:46:38.366 INFO:tasks.ceph.osd.0.smithi002.stderr:2024-09-10T08:46:38.365+0000 7f06dc200640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T08:46:38.375 INFO:tasks.ceph.osd.2.smithi002.stderr:2024-09-10T08:46:38.374+0000 7f8c19000640 -1 osd.2 0 waiting for initial osdmap 2024-09-10T08:46:38.381 INFO:tasks.ceph.osd.1.smithi002.stderr:2024-09-10T08:46:38.380+0000 7fad9b000640 -1 osd.1 0 waiting for initial osdmap 2024-09-10T08:46:38.381 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:38.380+0000 7f32ca400640 1 -- 172.21.15.2:0/1197677126 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f32bc047b50 con 0x7f32bc0e7120 2024-09-10T08:46:38.383 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:38.382+0000 7f32c0c00640 1 -- 172.21.15.2:0/1197677126 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7f32c40d9290 con 0x7f32bc0e7120 2024-09-10T08:46:38.383 INFO:teuthology.misc.health.smithi002.stdout: 2024-09-10T08:46:38.383 INFO:teuthology.misc.health.smithi002.stdout:{"epoch":12,"fsid":"f20a15a7-d363-4d44-98cb-4f4f466b52b8","created":"2024-09-10T08:46:26.481619+0000","modified":"2024-09-10T08:46:36.516108+0000","last_up_change":"0.000000","last_in_change":"2024-09-10T08:46:29.499894+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c90be333-506b-46d1-b00a-10d089a84776","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3f8bdde8-6cd3-4112-8939-a876191c7368","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3835f5ab-ed3a-4f46-ae6c-f0edf21708d7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"add6ad27-b411-4a82-9622-b0c1c1782cf1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c7b642f4-8bd2-4262-9a82-ee1061cfab7b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"fb53289a-419f-46d8-9e3a-384ac529dc57","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"3f9ddd54-ede4-4565-aff6-ae1c07e7c678","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"328d0681-eef4-4556-94e1-9745bd4adbe8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:46:38.386 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:38.384+0000 7f32ca400640 1 -- 172.21.15.2:0/1197677126 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f32a806bda0 msgr2=0x7f32a806e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:38.386 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:38.384+0000 7f32ca400640 1 --2- 172.21.15.2:0/1197677126 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f32a806bda0 0x7f32a806e260 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f32b402a1c0 tx=0x7f32b402e000 comp rx=0 tx=0).stop 2024-09-10T08:46:38.386 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:38.384+0000 7f32ca400640 1 -- 172.21.15.2:0/1197677126 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f32bc0e7120 msgr2=0x7f32bc038dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:38.386 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:38.384+0000 7f32ca400640 1 --2- 172.21.15.2:0/1197677126 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f32bc0e7120 0x7f32bc038dd0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f32c4076b40 tx=0x7f32c4074400 comp rx=0 tx=0).stop 2024-09-10T08:46:38.386 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:38.384+0000 7f32ca400640 1 -- 172.21.15.2:0/1197677126 shutdown_connections 2024-09-10T08:46:38.386 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:38.384+0000 7f32ca400640 1 --2- 172.21.15.2:0/1197677126 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f32bc0e7120 0x7f32bc038dd0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:38.386 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:38.384+0000 7f32ca400640 1 --2- 172.21.15.2:0/1197677126 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f32a806bda0 0x7f32a806e260 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:38.386 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:38.384+0000 7f32ca400640 1 --2- 172.21.15.2:0/1197677126 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f32bc04eb60 0x7f32bc17fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:38.386 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:38.384+0000 7f32ca400640 1 --2- 172.21.15.2:0/1197677126 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32bc005ab0 0x7f32bc0dc420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:38.386 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:38.384+0000 7f32ca400640 1 -- 172.21.15.2:0/1197677126 >> 172.21.15.2:0/1197677126 conn(0x7f32bc036090 msgr2=0x7f32bc01d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:46:38.387 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:38.384+0000 7f32ca400640 1 -- 172.21.15.2:0/1197677126 shutdown_connections 2024-09-10T08:46:38.387 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:38.384+0000 7f32ca400640 1 -- 172.21.15.2:0/1197677126 wait complete. 2024-09-10T08:46:38.388 INFO:tasks.ceph.osd.1.smithi002.stderr:2024-09-10T08:46:38.387+0000 7fad90600640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T08:46:38.390 INFO:tasks.ceph.osd.2.smithi002.stderr:2024-09-10T08:46:38.390+0000 7f8c0f000640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T08:46:38.399 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-10T08:46:38.861 INFO:tasks.ceph.osd.7.smithi155.stderr:2024-09-10T08:46:38.861+0000 7f8067200640 -1 osd.7 0 waiting for initial osdmap 2024-09-10T08:46:38.868 INFO:tasks.ceph.osd.7.smithi155.stderr:2024-09-10T08:46:38.868+0000 7f805d200640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T08:46:38.887 INFO:tasks.ceph.osd.4.smithi155.stderr:2024-09-10T08:46:38.886+0000 7fa04f400640 -1 osd.4 0 waiting for initial osdmap 2024-09-10T08:46:38.890 INFO:tasks.ceph.osd.5.smithi155.stderr:2024-09-10T08:46:38.890+0000 7fe1c8000640 -1 osd.5 0 waiting for initial osdmap 2024-09-10T08:46:38.893 INFO:tasks.ceph.osd.4.smithi155.stderr:2024-09-10T08:46:38.893+0000 7fa044a00640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T08:46:38.894 INFO:tasks.ceph.osd.5.smithi155.stderr:2024-09-10T08:46:38.894+0000 7fe1be000640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T08:46:38.918 INFO:tasks.ceph.osd.6.smithi155.stderr:2024-09-10T08:46:38.918+0000 7f62ede00640 -1 osd.6 0 waiting for initial osdmap 2024-09-10T08:46:38.926 INFO:tasks.ceph.osd.6.smithi155.stderr:2024-09-10T08:46:38.926+0000 7f62e3400640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T08:46:45.206 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-10T08:46:45.353 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.353+0000 7f3852400640 1 Processor -- start 2024-09-10T08:46:45.353 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.353+0000 7f3852400640 1 -- start start 2024-09-10T08:46:45.356 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.355+0000 7f3852400640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f384c0d0fa0 0x7f384c0d1380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:45.356 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.355+0000 7f3852400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f384c0d51a0 0x7f384c0d2160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:45.356 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.355+0000 7f3852400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f384c162170 0x7f384c1625a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:45.356 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.355+0000 7f3852400640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f384c0d18c0 con 0x7f384c0d51a0 2024-09-10T08:46:45.356 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.355+0000 7f3852400640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f384c15ec90 con 0x7f384c0d0fa0 2024-09-10T08:46:45.356 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.355+0000 7f3852400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f384c15ef70 con 0x7f384c162170 2024-09-10T08:46:45.356 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.355+0000 7f384be00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f384c0d51a0 0x7f384c0d2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:45.356 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.355+0000 7f384be00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f384c0d51a0 0x7f384c0d2160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59160/0 (socket says 172.21.15.2:59160) 2024-09-10T08:46:45.356 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.355+0000 7f384be00640 1 -- 172.21.15.2:0/247507726 learned_addr learned my addr 172.21.15.2:0/247507726 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:46:45.356 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.355+0000 7f3851a00640 1 --2- 172.21.15.2:0/247507726 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f384c162170 0x7f384c1625a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:45.356 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.355+0000 7f3851000640 1 --2- 172.21.15.2:0/247507726 >> v2:172.21.15.155:3300/0 conn(0x7f384c0d0fa0 0x7f384c0d1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:45.357 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.355+0000 7f384be00640 1 -- 172.21.15.2:0/247507726 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f384c162170 msgr2=0x7f384c1625a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:46:45.357 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.355+0000 7f384be00640 1 --2- 172.21.15.2:0/247507726 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f384c162170 0x7f384c1625a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:45.357 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.355+0000 7f384be00640 1 -- 172.21.15.2:0/247507726 >> v2:172.21.15.155:3300/0 conn(0x7f384c0d0fa0 msgr2=0x7f384c0d1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:46:45.357 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.355+0000 7f384be00640 1 --2- 172.21.15.2:0/247507726 >> v2:172.21.15.155:3300/0 conn(0x7f384c0d0fa0 0x7f384c0d1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:45.357 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.356+0000 7f384be00640 1 -- 172.21.15.2:0/247507726 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f384c15f250 con 0x7f384c0d51a0 2024-09-10T08:46:45.357 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.356+0000 7f3851000640 1 --2- 172.21.15.2:0/247507726 >> v2:172.21.15.155:3300/0 conn(0x7f384c0d0fa0 0x7f384c0d1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:46:45.358 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.357+0000 7f384be00640 1 --2- 172.21.15.2:0/247507726 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f384c0d51a0 0x7f384c0d2160 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f384c08cb80 tx=0x7f383802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d641a72107839ecd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:45.358 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.357+0000 7f384b400640 1 -- 172.21.15.2:0/247507726 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3838037070 con 0x7f384c0d51a0 2024-09-10T08:46:45.358 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.357+0000 7f384b400640 1 -- 172.21.15.2:0/247507726 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3838032440 con 0x7f384c0d51a0 2024-09-10T08:46:45.358 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.357+0000 7f384b400640 1 -- 172.21.15.2:0/247507726 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3838032810 con 0x7f384c0d51a0 2024-09-10T08:46:45.358 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.357+0000 7f3852400640 1 -- 172.21.15.2:0/247507726 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f384c0d51a0 msgr2=0x7f384c0d2160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:45.359 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.357+0000 7f3852400640 1 --2- 172.21.15.2:0/247507726 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f384c0d51a0 0x7f384c0d2160 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f384c08cb80 tx=0x7f383802a140 comp rx=0 tx=0).stop 2024-09-10T08:46:45.359 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.358+0000 7f3852400640 1 -- 172.21.15.2:0/247507726 shutdown_connections 2024-09-10T08:46:45.359 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.358+0000 7f3852400640 1 --2- 172.21.15.2:0/247507726 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f384c162170 0x7f384c1625a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:45.359 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.358+0000 7f3852400640 1 --2- 172.21.15.2:0/247507726 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f384c0d51a0 0x7f384c0d2160 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:45.359 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.358+0000 7f3852400640 1 --2- 172.21.15.2:0/247507726 >> v2:172.21.15.155:3300/0 conn(0x7f384c0d0fa0 0x7f384c0d1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:45.359 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.358+0000 7f3852400640 1 -- 172.21.15.2:0/247507726 >> 172.21.15.2:0/247507726 conn(0x7f384c08bff0 msgr2=0x7f384c0d4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:46:45.359 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.358+0000 7f3852400640 1 -- 172.21.15.2:0/247507726 shutdown_connections 2024-09-10T08:46:45.359 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.358+0000 7f3852400640 1 -- 172.21.15.2:0/247507726 wait complete. 2024-09-10T08:46:45.360 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.359+0000 7f3852400640 1 Processor -- start 2024-09-10T08:46:45.360 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.360+0000 7f3852400640 1 -- start start 2024-09-10T08:46:45.361 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.361+0000 7f3852400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f384c0d0fa0 0x7f384c0cdf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:45.362 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.361+0000 7f3852400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f384c0d51a0 0x7f384c15fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:45.362 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.361+0000 7f3852400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f384c162170 0x7f384c160240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:45.362 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.361+0000 7f3852400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f384c0d26a0 con 0x7f384c0d0fa0 2024-09-10T08:46:45.362 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.361+0000 7f3852400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f384c15e9a0 con 0x7f384c0d51a0 2024-09-10T08:46:45.362 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.361+0000 7f3852400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f384c0d2820 con 0x7f384c162170 2024-09-10T08:46:45.362 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.361+0000 7f3851a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f384c162170 0x7f384c160240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:45.362 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.361+0000 7f3851a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f384c162170 0x7f384c160240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.2:33584/0 (socket says 172.21.15.2:33584) 2024-09-10T08:46:45.362 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.361+0000 7f3851a00640 1 -- 172.21.15.2:0/4051058022 learned_addr learned my addr 172.21.15.2:0/4051058022 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:46:45.362 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.361+0000 7f384be00640 1 --2- 172.21.15.2:0/4051058022 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f384c0d51a0 0x7f384c15fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:45.362 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.361+0000 7f3851000640 1 --2- 172.21.15.2:0/4051058022 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f384c0d0fa0 0x7f384c0cdf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:45.362 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.361+0000 7f3851a00640 1 -- 172.21.15.2:0/4051058022 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f384c0d51a0 msgr2=0x7f384c15fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:45.362 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.361+0000 7f3851a00640 1 --2- 172.21.15.2:0/4051058022 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f384c0d51a0 0x7f384c15fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:45.362 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.361+0000 7f3851a00640 1 -- 172.21.15.2:0/4051058022 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f384c0d0fa0 msgr2=0x7f384c0cdf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:45.363 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.361+0000 7f3851a00640 1 --2- 172.21.15.2:0/4051058022 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f384c0d0fa0 0x7f384c0cdf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:45.363 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.361+0000 7f3851a00640 1 -- 172.21.15.2:0/4051058022 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f384c0cd740 con 0x7f384c162170 2024-09-10T08:46:45.363 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.362+0000 7f3851a00640 1 --2- 172.21.15.2:0/4051058022 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f384c162170 0x7f384c160240 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f384400efc0 tx=0x7f384400c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:45.363 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.362+0000 7f3848c00640 1 -- 172.21.15.2:0/4051058022 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3844018020 con 0x7f384c162170 2024-09-10T08:46:45.363 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.362+0000 7f3848c00640 1 -- 172.21.15.2:0/4051058022 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3844014480 con 0x7f384c162170 2024-09-10T08:46:45.364 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.362+0000 7f3848c00640 1 -- 172.21.15.2:0/4051058022 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3844014870 con 0x7f384c162170 2024-09-10T08:46:45.364 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.362+0000 7f3852400640 1 -- 172.21.15.2:0/4051058022 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f384c0cc980 con 0x7f384c162170 2024-09-10T08:46:45.364 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.362+0000 7f3852400640 1 -- 172.21.15.2:0/4051058022 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f384c0ccf40 con 0x7f384c162170 2024-09-10T08:46:45.364 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.363+0000 7f3852400640 1 -- 172.21.15.2:0/4051058022 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f384c0d1380 con 0x7f384c162170 2024-09-10T08:46:45.364 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.364+0000 7f3848c00640 1 -- 172.21.15.2:0/4051058022 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3844005d10 con 0x7f384c162170 2024-09-10T08:46:45.365 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.365+0000 7f3848c00640 1 --2- 172.21.15.2:0/4051058022 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f382c06be30 0x7f382c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:45.365 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.365+0000 7f3848c00640 1 -- 172.21.15.2:0/4051058022 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f384408b510 con 0x7f384c162170 2024-09-10T08:46:45.365 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.365+0000 7f3851000640 1 --2- 172.21.15.2:0/4051058022 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f382c06be30 0x7f382c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:45.366 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.366+0000 7f3851000640 1 --2- 172.21.15.2:0/4051058022 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f382c06be30 0x7f382c06e2f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3840009950 tx=0x7f3840008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:45.371 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.371+0000 7f3848c00640 1 -- 172.21.15.2:0/4051058022 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3844022070 con 0x7f384c162170 2024-09-10T08:46:45.555 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.555+0000 7f3852400640 1 -- 172.21.15.2:0/4051058022 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f384c0b3dd0 con 0x7f384c162170 2024-09-10T08:46:45.556 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.556+0000 7f3848c00640 1 -- 172.21.15.2:0/4051058022 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12836 (secure 0 0 0) 0x7f3844010040 con 0x7f384c162170 2024-09-10T08:46:45.556 INFO:teuthology.misc.health.smithi002.stdout: 2024-09-10T08:46:45.556 INFO:teuthology.misc.health.smithi002.stdout:{"epoch":16,"fsid":"f20a15a7-d363-4d44-98cb-4f4f466b52b8","created":"2024-09-10T08:46:26.481619+0000","modified":"2024-09-10T08:46:42.337108+0000","last_up_change":"2024-09-10T08:46:39.323912+0000","last_in_change":"2024-09-10T08:46:29.499894+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:46:39.426180+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c90be333-506b-46d1-b00a-10d089a84776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6822","nonce":298678486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6823","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6826","nonce":298678486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6831","nonce":298678486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6829","nonce":298678486}]},"public_addr":"172.21.15.2:6822/298678486","cluster_addr":"172.21.15.2:6826/298678486","heartbeat_back_addr":"172.21.15.2:6831/298678486","heartbeat_front_addr":"172.21.15.2:6829/298678486","state":["exists","up"]},{"osd":1,"uuid":"3f8bdde8-6cd3-4112-8939-a876191c7368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6809","nonce":1619566025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6811","nonce":1619566025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6815","nonce":1619566025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6813","nonce":1619566025}]},"public_addr":"172.21.15.2:6809/1619566025","cluster_addr":"172.21.15.2:6811/1619566025","heartbeat_back_addr":"172.21.15.2:6815/1619566025","heartbeat_front_addr":"172.21.15.2:6813/1619566025","state":["exists","up"]},{"osd":2,"uuid":"3835f5ab-ed3a-4f46-ae6c-f0edf21708d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6801","nonce":3992427579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6803","nonce":3992427579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6807","nonce":3992427579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6805","nonce":3992427579}]},"public_addr":"172.21.15.2:6801/3992427579","cluster_addr":"172.21.15.2:6803/3992427579","heartbeat_back_addr":"172.21.15.2:6807/3992427579","heartbeat_front_addr":"172.21.15.2:6805/3992427579","state":["exists","up"]},{"osd":3,"uuid":"add6ad27-b411-4a82-9622-b0c1c1782cf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6817","nonce":1270626884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6819","nonce":1270626884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6827","nonce":1270626884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6824","nonce":1270626884}]},"public_addr":"172.21.15.2:6817/1270626884","cluster_addr":"172.21.15.2:6819/1270626884","heartbeat_back_addr":"172.21.15.2:6827/1270626884","heartbeat_front_addr":"172.21.15.2:6824/1270626884","state":["exists","up"]},{"osd":4,"uuid":"c7b642f4-8bd2-4262-9a82-ee1061cfab7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6803","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6806","nonce":553254873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6813","nonce":553254873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6822","nonce":553254873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6819","nonce":553254873}]},"public_addr":"172.21.15.155:6806/553254873","cluster_addr":"172.21.15.155:6813/553254873","heartbeat_back_addr":"172.21.15.155:6822/553254873","heartbeat_front_addr":"172.21.15.155:6819/553254873","state":["exists","up"]},{"osd":5,"uuid":"fb53289a-419f-46d8-9e3a-384ac529dc57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6805","nonce":2107688472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6811","nonce":2107688472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6823","nonce":2107688472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6817","nonce":2107688472}]},"public_addr":"172.21.15.155:6805/2107688472","cluster_addr":"172.21.15.155:6811/2107688472","heartbeat_back_addr":"172.21.15.155:6823/2107688472","heartbeat_front_addr":"172.21.15.155:6817/2107688472","state":["exists","up"]},{"osd":6,"uuid":"3f9ddd54-ede4-4565-aff6-ae1c07e7c678","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6825","nonce":944542383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6827","nonce":944542383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6831","nonce":944542383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6829","nonce":944542383}]},"public_addr":"172.21.15.155:6825/944542383","cluster_addr":"172.21.15.155:6827/944542383","heartbeat_back_addr":"172.21.15.155:6831/944542383","heartbeat_front_addr":"172.21.15.155:6829/944542383","state":["exists","up"]},{"osd":7,"uuid":"328d0681-eef4-4556-94e1-9745bd4adbe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6801","nonce":2220093913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6807","nonce":2220093913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6818","nonce":2220093913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6812","nonce":2220093913}]},"public_addr":"172.21.15.155:6801/2220093913","cluster_addr":"172.21.15.155:6807/2220093913","heartbeat_back_addr":"172.21.15.155:6818/2220093913","heartbeat_front_addr":"172.21.15.155:6812/2220093913","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.052980+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.104550+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.025661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:35.784354+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:35.863363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.322312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.100890+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:35.763584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:46:45.558 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.558+0000 7f3852400640 1 -- 172.21.15.2:0/4051058022 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f382c06be30 msgr2=0x7f382c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:45.558 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.558+0000 7f3852400640 1 --2- 172.21.15.2:0/4051058022 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f382c06be30 0x7f382c06e2f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3840009950 tx=0x7f3840008040 comp rx=0 tx=0).stop 2024-09-10T08:46:45.558 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.558+0000 7f3852400640 1 -- 172.21.15.2:0/4051058022 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f384c162170 msgr2=0x7f384c160240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:45.558 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.558+0000 7f3852400640 1 --2- 172.21.15.2:0/4051058022 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f384c162170 0x7f384c160240 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f384400efc0 tx=0x7f384400c490 comp rx=0 tx=0).stop 2024-09-10T08:46:45.558 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.558+0000 7f3852400640 1 -- 172.21.15.2:0/4051058022 shutdown_connections 2024-09-10T08:46:45.559 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.558+0000 7f3852400640 1 --2- 172.21.15.2:0/4051058022 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f382c06be30 0x7f382c06e2f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:45.559 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.558+0000 7f3852400640 1 --2- 172.21.15.2:0/4051058022 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f384c162170 0x7f384c160240 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:45.559 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.558+0000 7f3852400640 1 --2- 172.21.15.2:0/4051058022 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f384c0d51a0 0x7f384c15fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:45.559 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.558+0000 7f3852400640 1 --2- 172.21.15.2:0/4051058022 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f384c0d0fa0 0x7f384c0cdf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:45.559 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.558+0000 7f3852400640 1 -- 172.21.15.2:0/4051058022 >> 172.21.15.2:0/4051058022 conn(0x7f384c08bff0 msgr2=0x7f384c0b2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:46:45.559 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.558+0000 7f3852400640 1 -- 172.21.15.2:0/4051058022 shutdown_connections 2024-09-10T08:46:45.559 INFO:teuthology.misc.health.smithi002.stderr:2024-09-10T08:46:45.558+0000 7f3852400640 1 -- 172.21.15.2:0/4051058022 wait complete. 2024-09-10T08:46:45.570 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-10T08:46:45.571 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-10T08:46:45.571 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T08:46:45.571 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T08:46:45.575 INFO:tasks.ceph.mds.a:Started 2024-09-10T08:46:45.575 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T08:46:45.576 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T08:46:45.579 INFO:tasks.ceph.mds.c:Started 2024-09-10T08:46:45.579 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T08:46:45.579 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T08:46:45.583 INFO:tasks.ceph.mds.b:Started 2024-09-10T08:46:45.584 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T08:46:45.584 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T08:46:45.587 INFO:tasks.ceph.mds.d:Started 2024-09-10T08:46:45.588 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-10T08:46:45.588 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:46:45.708 INFO:tasks.ceph.mds.a.smithi002.stdout:starting mds.a at 2024-09-10T08:46:45.708 INFO:tasks.ceph.mds.c.smithi002.stdout:starting mds.c at 2024-09-10T08:46:45.719 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2024-09-10T08:46:45.719 INFO:tasks.ceph.mds.d.smithi155.stdout:starting mds.d at 2024-09-10T08:46:45.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.754+0000 7f2e99a00640 1 Processor -- start 2024-09-10T08:46:45.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.754+0000 7f2e99a00640 1 -- start start 2024-09-10T08:46:45.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.755+0000 7f2e99a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2e9415e6b0 0x7f2e940d4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:45.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.755+0000 7f2e99a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e940d5210 0x7f2e940d2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:45.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.755+0000 7f2e99a00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2e9406ce60 0x7f2e940d30e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:45.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.755+0000 7f2e99a00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f2e940d1a50 con 0x7f2e9415e6b0 2024-09-10T08:46:45.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.755+0000 7f2e99a00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f2e940d1120 con 0x7f2e9406ce60 2024-09-10T08:46:45.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.755+0000 7f2e99a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2e940d1400 con 0x7f2e940d5210 2024-09-10T08:46:45.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.755+0000 7f2e92a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2e9415e6b0 0x7f2e940d4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:45.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.755+0000 7f2e92a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2e9415e6b0 0x7f2e940d4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59206/0 (socket says 172.21.15.2:59206) 2024-09-10T08:46:45.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.755+0000 7f2e92a00640 1 -- 172.21.15.2:0/3731591463 learned_addr learned my addr 172.21.15.2:0/3731591463 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:46:45.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.756+0000 7f2e92000640 1 --2- 172.21.15.2:0/3731591463 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e940d5210 0x7f2e940d2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:45.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.756+0000 7f2e93400640 1 --2- 172.21.15.2:0/3731591463 >> v2:172.21.15.155:3300/0 conn(0x7f2e9406ce60 0x7f2e940d30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:45.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.756+0000 7f2e92a00640 1 -- 172.21.15.2:0/3731591463 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e940d5210 msgr2=0x7f2e940d2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:46:45.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.756+0000 7f2e92a00640 1 --2- 172.21.15.2:0/3731591463 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e940d5210 0x7f2e940d2ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:45.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.756+0000 7f2e92a00640 1 -- 172.21.15.2:0/3731591463 >> v2:172.21.15.155:3300/0 conn(0x7f2e9406ce60 msgr2=0x7f2e940d30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:46:45.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.756+0000 7f2e92a00640 1 --2- 172.21.15.2:0/3731591463 >> v2:172.21.15.155:3300/0 conn(0x7f2e9406ce60 0x7f2e940d30e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:45.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.756+0000 7f2e92a00640 1 -- 172.21.15.2:0/3731591463 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e940d16e0 con 0x7f2e9415e6b0 2024-09-10T08:46:45.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.757+0000 7f2e92a00640 1 --2- 172.21.15.2:0/3731591463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e9415e6b0 0x7f2e940d4cd0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2e940ceca0 tx=0x7f2e8402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd07468e7d38b37d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:45.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.757+0000 7f2e91600640 1 -- 172.21.15.2:0/3731591463 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e84037070 con 0x7f2e9415e6b0 2024-09-10T08:46:45.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.757+0000 7f2e91600640 1 -- 172.21.15.2:0/3731591463 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e84032440 con 0x7f2e9415e6b0 2024-09-10T08:46:45.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.757+0000 7f2e91600640 1 -- 172.21.15.2:0/3731591463 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e84032810 con 0x7f2e9415e6b0 2024-09-10T08:46:45.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.757+0000 7f2e99a00640 1 -- 172.21.15.2:0/3731591463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e9415e6b0 msgr2=0x7f2e940d4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:45.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.757+0000 7f2e99a00640 1 --2- 172.21.15.2:0/3731591463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e9415e6b0 0x7f2e940d4cd0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2e940ceca0 tx=0x7f2e8402a140 comp rx=0 tx=0).stop 2024-09-10T08:46:45.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.758+0000 7f2e99a00640 1 -- 172.21.15.2:0/3731591463 shutdown_connections 2024-09-10T08:46:45.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.758+0000 7f2e99a00640 1 --2- 172.21.15.2:0/3731591463 >> v2:172.21.15.155:3300/0 conn(0x7f2e9406ce60 0x7f2e940d30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:45.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.758+0000 7f2e99a00640 1 --2- 172.21.15.2:0/3731591463 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e940d5210 0x7f2e940d2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:45.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.758+0000 7f2e99a00640 1 --2- 172.21.15.2:0/3731591463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e9415e6b0 0x7f2e940d4cd0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:45.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.758+0000 7f2e99a00640 1 -- 172.21.15.2:0/3731591463 >> 172.21.15.2:0/3731591463 conn(0x7f2e9408bfd0 msgr2=0x7f2e940d45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:46:45.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.758+0000 7f2e99a00640 1 -- 172.21.15.2:0/3731591463 shutdown_connections 2024-09-10T08:46:45.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.758+0000 7f2e99a00640 1 -- 172.21.15.2:0/3731591463 wait complete. 2024-09-10T08:46:45.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.759+0000 7f2e99a00640 1 Processor -- start 2024-09-10T08:46:45.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.759+0000 7f2e99a00640 1 -- start start 2024-09-10T08:46:45.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.760+0000 7f2e99a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e9406ce60 0x7f2e94157cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:45.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.760+0000 7f2e99a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e940d5210 0x7f2e941f96e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:45.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.760+0000 7f2e99a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e9415e6b0 0x7f2e940c9060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:45.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.760+0000 7f2e99a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2e940d0db0 con 0x7f2e9406ce60 2024-09-10T08:46:45.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.760+0000 7f2e99a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2e940cf210 con 0x7f2e940d5210 2024-09-10T08:46:45.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.760+0000 7f2e99a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2e940cf7a0 con 0x7f2e9415e6b0 2024-09-10T08:46:45.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.761+0000 7f2e93400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e9415e6b0 0x7f2e940c9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:45.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.761+0000 7f2e92000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e940d5210 0x7f2e941f96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:45.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.761+0000 7f2e92000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e940d5210 0x7f2e941f96e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.2:58134/0 (socket says 172.21.15.2:58134) 2024-09-10T08:46:45.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.761+0000 7f2e92000640 1 -- 172.21.15.2:0/1455841711 learned_addr learned my addr 172.21.15.2:0/1455841711 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:46:45.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.761+0000 7f2e93400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e9415e6b0 0x7f2e940c9060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.2:33622/0 (socket says 172.21.15.2:33622) 2024-09-10T08:46:45.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.761+0000 7f2e92a00640 1 --2- 172.21.15.2:0/1455841711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e9406ce60 0x7f2e94157cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:45.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.761+0000 7f2e92000640 1 -- 172.21.15.2:0/1455841711 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e9415e6b0 msgr2=0x7f2e940c9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:45.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.761+0000 7f2e92000640 1 --2- 172.21.15.2:0/1455841711 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e9415e6b0 0x7f2e940c9060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:45.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.761+0000 7f2e92000640 1 -- 172.21.15.2:0/1455841711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e9406ce60 msgr2=0x7f2e94157cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:45.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.761+0000 7f2e92000640 1 --2- 172.21.15.2:0/1455841711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e9406ce60 0x7f2e94157cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:45.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.761+0000 7f2e92000640 1 -- 172.21.15.2:0/1455841711 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e941f9c20 con 0x7f2e940d5210 2024-09-10T08:46:45.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.761+0000 7f2e93400640 1 --2- 172.21.15.2:0/1455841711 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e9415e6b0 0x7f2e940c9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:46:45.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.761+0000 7f2e92a00640 1 --2- 172.21.15.2:0/1455841711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e9406ce60 0x7f2e94157cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:46:45.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.761+0000 7f2e92000640 1 --2- 172.21.15.2:0/1455841711 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e940d5210 0x7f2e941f96e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2e8000e980 tx=0x7f2e8000ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:45.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.761+0000 7f2e8aa00640 1 -- 172.21.15.2:0/1455841711 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e80017070 con 0x7f2e940d5210 2024-09-10T08:46:45.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.762+0000 7f2e8aa00640 1 -- 172.21.15.2:0/1455841711 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e8000ca00 con 0x7f2e940d5210 2024-09-10T08:46:45.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.762+0000 7f2e8aa00640 1 -- 172.21.15.2:0/1455841711 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e8000cdd0 con 0x7f2e940d5210 2024-09-10T08:46:45.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.762+0000 7f2e99a00640 1 -- 172.21.15.2:0/1455841711 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e940c7fc0 con 0x7f2e940d5210 2024-09-10T08:46:45.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.762+0000 7f2e99a00640 1 -- 172.21.15.2:0/1455841711 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e940c8580 con 0x7f2e940d5210 2024-09-10T08:46:45.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.763+0000 7f2e99a00640 1 -- 172.21.15.2:0/1455841711 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e940d4cd0 con 0x7f2e940d5210 2024-09-10T08:46:45.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.764+0000 7f2e8aa00640 1 -- 172.21.15.2:0/1455841711 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2e8001a070 con 0x7f2e940d5210 2024-09-10T08:46:45.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.764+0000 7f2e8aa00640 1 --2- 172.21.15.2:0/1455841711 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f2e7406be30 0x7f2e7406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:45.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.765+0000 7f2e8aa00640 1 -- 172.21.15.2:0/1455841711 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f2e8008adf0 con 0x7f2e940d5210 2024-09-10T08:46:45.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.765+0000 7f2e92a00640 1 --2- 172.21.15.2:0/1455841711 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f2e7406be30 0x7f2e7406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:45.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.765+0000 7f2e92a00640 1 --2- 172.21.15.2:0/1455841711 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f2e7406be30 0x7f2e7406e2f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2e84034000 tx=0x7f2e8402e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:45.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.770+0000 7f2e8aa00640 1 -- 172.21.15.2:0/1455841711 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2e80059490 con 0x7f2e940d5210 2024-09-10T08:46:45.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.993+0000 7f2e99a00640 1 -- 172.21.15.2:0/1455841711 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2e940d3a80 con 0x7f2e940d5210 2024-09-10T08:46:45.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.994+0000 7f2e8aa00640 1 -- 172.21.15.2:0/1455841711 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1428 (secure 0 0 0) 0x7f2e8005d790 con 0x7f2e940d5210 2024-09-10T08:46:45.994 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:46:45.994 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":2,"btime":"2024-09-10T08:46:45:716887+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4276,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/800933941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":800933941},{"type":"v1","addr":"172.21.15.2:6834","nonce":800933941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-10T08:46:45.994 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 2 2024-09-10T08:46:45.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.996+0000 7f2e99a00640 1 -- 172.21.15.2:0/1455841711 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f2e7406be30 msgr2=0x7f2e7406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:45.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.996+0000 7f2e99a00640 1 --2- 172.21.15.2:0/1455841711 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f2e7406be30 0x7f2e7406e2f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2e84034000 tx=0x7f2e8402e000 comp rx=0 tx=0).stop 2024-09-10T08:46:45.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.996+0000 7f2e99a00640 1 -- 172.21.15.2:0/1455841711 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e940d5210 msgr2=0x7f2e941f96e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:45.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.996+0000 7f2e99a00640 1 --2- 172.21.15.2:0/1455841711 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e940d5210 0x7f2e941f96e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2e8000e980 tx=0x7f2e8000ee40 comp rx=0 tx=0).stop 2024-09-10T08:46:45.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.996+0000 7f2e99a00640 1 -- 172.21.15.2:0/1455841711 shutdown_connections 2024-09-10T08:46:45.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.996+0000 7f2e99a00640 1 --2- 172.21.15.2:0/1455841711 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f2e7406be30 0x7f2e7406e2f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:45.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.996+0000 7f2e99a00640 1 --2- 172.21.15.2:0/1455841711 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e9415e6b0 0x7f2e940c9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:45.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.996+0000 7f2e99a00640 1 --2- 172.21.15.2:0/1455841711 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e940d5210 0x7f2e941f96e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:45.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.996+0000 7f2e99a00640 1 --2- 172.21.15.2:0/1455841711 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e9406ce60 0x7f2e94157cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:45.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.996+0000 7f2e99a00640 1 -- 172.21.15.2:0/1455841711 >> 172.21.15.2:0/1455841711 conn(0x7f2e9408bfd0 msgr2=0x7f2e940d1f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:46:45.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.996+0000 7f2e99a00640 1 -- 172.21.15.2:0/1455841711 shutdown_connections 2024-09-10T08:46:45.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:45.996+0000 7f2e99a00640 1 -- 172.21.15.2:0/1455841711 wait complete. 2024-09-10T08:46:48.012 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:46:48.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.178+0000 7f672f000640 1 Processor -- start 2024-09-10T08:46:48.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.179+0000 7f672f000640 1 -- start start 2024-09-10T08:46:48.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.180+0000 7f672f000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6728162900 0x7f6728070c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:48.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.180+0000 7f672f000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6728071180 0x7f6728168520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:48.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.180+0000 7f672f000640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67280d0580 con 0x7f672815e720 2024-09-10T08:46:48.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.180+0000 7f672f000640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f6728071610 con 0x7f6728071180 2024-09-10T08:46:48.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.180+0000 7f672f000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f672815eb00 con 0x7f6728162900 2024-09-10T08:46:48.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.180+0000 7f672d000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6728071180 0x7f6728168520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:48.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.180+0000 7f672d000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6728071180 0x7f6728168520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53500/0 (socket says 172.21.15.2:53500) 2024-09-10T08:46:48.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.180+0000 7f672d000640 1 -- 172.21.15.2:0/1642841140 learned_addr learned my addr 172.21.15.2:0/1642841140 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:46:48.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.180+0000 7f6727e00640 1 --1- 172.21.15.2:0/1642841140 >> v1:172.21.15.155:6789/0 conn(0x7f672815e720 0x7f67281621f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.2:41912/0 (socket says 172.21.15.2:41912) 2024-09-10T08:46:48.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.180+0000 7f671fe00640 1 --2- 172.21.15.2:0/1642841140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6728162900 0x7f6728070c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:48.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.180+0000 7f672d000640 1 -- 172.21.15.2:0/1642841140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6728162900 msgr2=0x7f6728070c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:46:48.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.180+0000 7f672d000640 1 --2- 172.21.15.2:0/1642841140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6728162900 0x7f6728070c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:48.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.180+0000 7f672d000640 1 -- 172.21.15.2:0/1642841140 >> v1:172.21.15.155:6789/0 conn(0x7f672815e720 legacy=0x7f67281621f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:48.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.180+0000 7f672d000640 1 -- 172.21.15.2:0/1642841140 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f672806ed30 con 0x7f6728071180 2024-09-10T08:46:48.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.181+0000 7f672d000640 1 --2- 172.21.15.2:0/1642841140 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6728071180 0x7f6728168520 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6720009e50 tx=0x7f672002a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b23d426eded0ed4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:48.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.182+0000 7f6727400640 1 -- 172.21.15.2:0/1642841140 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6720036070 con 0x7f6728071180 2024-09-10T08:46:48.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.182+0000 7f6727400640 1 -- 172.21.15.2:0/1642841140 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6720031600 con 0x7f6728071180 2024-09-10T08:46:48.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.182+0000 7f6727400640 1 -- 172.21.15.2:0/1642841140 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67200319d0 con 0x7f6728071180 2024-09-10T08:46:48.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.182+0000 7f672f000640 1 -- 172.21.15.2:0/1642841140 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6728071180 msgr2=0x7f6728168520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:48.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.182+0000 7f672f000640 1 --2- 172.21.15.2:0/1642841140 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6728071180 0x7f6728168520 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6720009e50 tx=0x7f672002a7a0 comp rx=0 tx=0).stop 2024-09-10T08:46:48.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.182+0000 7f672f000640 1 -- 172.21.15.2:0/1642841140 shutdown_connections 2024-09-10T08:46:48.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.182+0000 7f672f000640 1 --2- 172.21.15.2:0/1642841140 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6728162900 0x7f6728070c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:48.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.182+0000 7f672f000640 1 --2- 172.21.15.2:0/1642841140 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6728071180 0x7f6728168520 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:48.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.182+0000 7f672f000640 1 -- 172.21.15.2:0/1642841140 >> 172.21.15.2:0/1642841140 conn(0x7f67280d23f0 msgr2=0x7f67280d2800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:46:48.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.182+0000 7f672f000640 1 -- 172.21.15.2:0/1642841140 shutdown_connections 2024-09-10T08:46:48.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.182+0000 7f672f000640 1 -- 172.21.15.2:0/1642841140 wait complete. 2024-09-10T08:46:48.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.184+0000 7f672f000640 1 Processor -- start 2024-09-10T08:46:48.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.184+0000 7f672f000640 1 -- start start 2024-09-10T08:46:48.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.185+0000 7f672f000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6728071180 0x7f672815ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:48.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.185+0000 7f672f000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f672815e720 0x7f67280b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:48.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.185+0000 7f672f000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6728162900 0x7f67280b0830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:48.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.185+0000 7f672f000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f67280d0dc0 con 0x7f6728162900 2024-09-10T08:46:48.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.185+0000 7f672f000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f67280d0ae0 con 0x7f672815e720 2024-09-10T08:46:48.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.185+0000 7f672f000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f67280d10a0 con 0x7f6728071180 2024-09-10T08:46:48.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.185+0000 7f672d000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6728162900 0x7f67280b0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:48.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.185+0000 7f672d000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6728162900 0x7f67280b0830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53516/0 (socket says 172.21.15.2:53516) 2024-09-10T08:46:48.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.185+0000 7f672d000640 1 -- 172.21.15.2:0/845561058 learned_addr learned my addr 172.21.15.2:0/845561058 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:46:48.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.185+0000 7f6727e00640 1 --2- 172.21.15.2:0/845561058 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6728071180 0x7f672815ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:48.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.185+0000 7f671fe00640 1 --2- 172.21.15.2:0/845561058 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f672815e720 0x7f67280b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:48.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.186+0000 7f672d000640 1 -- 172.21.15.2:0/845561058 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6728071180 msgr2=0x7f672815ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:48.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.186+0000 7f672d000640 1 --2- 172.21.15.2:0/845561058 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6728071180 0x7f672815ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:48.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.186+0000 7f672d000640 1 -- 172.21.15.2:0/845561058 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f672815e720 msgr2=0x7f67280b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:48.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.186+0000 7f672d000640 1 --2- 172.21.15.2:0/845561058 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f672815e720 0x7f67280b02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:48.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.186+0000 7f672d000640 1 -- 172.21.15.2:0/845561058 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67280cc250 con 0x7f6728162900 2024-09-10T08:46:48.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.186+0000 7f6727e00640 1 --2- 172.21.15.2:0/845561058 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6728071180 0x7f672815ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:46:48.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.186+0000 7f672d000640 1 --2- 172.21.15.2:0/845561058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6728162900 0x7f67280b0830 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6720009e50 tx=0x7f6720004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:48.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.186+0000 7f6724c00640 1 -- 172.21.15.2:0/845561058 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6720041020 con 0x7f6728162900 2024-09-10T08:46:48.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.186+0000 7f6724c00640 1 -- 172.21.15.2:0/845561058 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67200077a0 con 0x7f6728162900 2024-09-10T08:46:48.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.186+0000 7f6724c00640 1 -- 172.21.15.2:0/845561058 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6720036040 con 0x7f6728162900 2024-09-10T08:46:48.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.186+0000 7f672f000640 1 -- 172.21.15.2:0/845561058 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67280cc530 con 0x7f6728162900 2024-09-10T08:46:48.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.186+0000 7f672f000640 1 -- 172.21.15.2:0/845561058 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67280c6d10 con 0x7f6728162900 2024-09-10T08:46:48.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.187+0000 7f672f000640 1 -- 172.21.15.2:0/845561058 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67280c9280 con 0x7f6728162900 2024-09-10T08:46:48.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.188+0000 7f6724c00640 1 -- 172.21.15.2:0/845561058 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6720044020 con 0x7f6728162900 2024-09-10T08:46:48.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.189+0000 7f6724c00640 1 --2- 172.21.15.2:0/845561058 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f670406be30 0x7f670406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:48.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.189+0000 7f6724c00640 1 -- 172.21.15.2:0/845561058 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f67200ab6f0 con 0x7f6728162900 2024-09-10T08:46:48.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.189+0000 7f6727e00640 1 --2- 172.21.15.2:0/845561058 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f670406be30 0x7f670406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:48.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.190+0000 7f6727e00640 1 --2- 172.21.15.2:0/845561058 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f670406be30 0x7f670406e2f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6718007fd0 tx=0x7f6718007d60 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:48.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.195+0000 7f6724c00640 1 -- 172.21.15.2:0/845561058 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f672004b030 con 0x7f6728162900 2024-09-10T08:46:48.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.417+0000 7f672f000640 1 -- 172.21.15.2:0/845561058 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f67280d3220 con 0x7f6728162900 2024-09-10T08:46:48.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.418+0000 7f6724c00640 1 -- 172.21.15.2:0/845561058 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3903 (secure 0 0 0) 0x7f672007a3e0 con 0x7f6728162900 2024-09-10T08:46:48.418 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:46:48.418 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":3,"btime":"2024-09-10T08:46:46:718353+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/4081738683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":4081738683},{"type":"v1","addr":"172.21.15.2:6835","nonce":4081738683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1478106484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":1478106484},{"type":"v1","addr":"172.21.15.155:6837","nonce":1478106484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/800933941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":800933941},{"type":"v1","addr":"172.21.15.2:6834","nonce":800933941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/2996773231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2996773231},{"type":"v1","addr":"172.21.15.155:6836","nonce":2996773231}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-10T08:46:48.418 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 3 2024-09-10T08:46:48.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.420+0000 7f672f000640 1 -- 172.21.15.2:0/845561058 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f670406be30 msgr2=0x7f670406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:48.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.420+0000 7f672f000640 1 --2- 172.21.15.2:0/845561058 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f670406be30 0x7f670406e2f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6718007fd0 tx=0x7f6718007d60 comp rx=0 tx=0).stop 2024-09-10T08:46:48.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.420+0000 7f672f000640 1 -- 172.21.15.2:0/845561058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6728162900 msgr2=0x7f67280b0830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:48.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.420+0000 7f672f000640 1 --2- 172.21.15.2:0/845561058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6728162900 0x7f67280b0830 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6720009e50 tx=0x7f6720004a40 comp rx=0 tx=0).stop 2024-09-10T08:46:48.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.420+0000 7f672f000640 1 -- 172.21.15.2:0/845561058 shutdown_connections 2024-09-10T08:46:48.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.420+0000 7f672f000640 1 --2- 172.21.15.2:0/845561058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6728162900 0x7f67280b0830 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:48.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.420+0000 7f672f000640 1 --2- 172.21.15.2:0/845561058 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f672815e720 0x7f67280b02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:48.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.420+0000 7f672f000640 1 --2- 172.21.15.2:0/845561058 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f670406be30 0x7f670406e2f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:48.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.420+0000 7f672f000640 1 --2- 172.21.15.2:0/845561058 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6728071180 0x7f672815ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:48.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.420+0000 7f672f000640 1 -- 172.21.15.2:0/845561058 >> 172.21.15.2:0/845561058 conn(0x7f67280d23f0 msgr2=0x7f67280cd410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:46:48.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.420+0000 7f672f000640 1 -- 172.21.15.2:0/845561058 shutdown_connections 2024-09-10T08:46:48.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.420+0000 7f672f000640 1 -- 172.21.15.2:0/845561058 wait complete. 2024-09-10T08:46:48.436 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-10T08:46:48.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.592+0000 7f1091a00640 1 Processor -- start 2024-09-10T08:46:48.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.592+0000 7f1091a00640 1 -- start start 2024-09-10T08:46:48.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.593+0000 7f1091a00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f108c15e960 0x7f108c06fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:48.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.593+0000 7f1091a00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f108c071120 con 0x7f108c0d0350 2024-09-10T08:46:48.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.593+0000 7f1091a00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f108c070080 con 0x7f108c073540 2024-09-10T08:46:48.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.593+0000 7f1091a00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f108c070c90 con 0x7f108c15e960 2024-09-10T08:46:48.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.593+0000 7f108b400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f108c0d0350 0x7f108c0ae2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:42012/0 (socket says 172.21.15.2:42012) 2024-09-10T08:46:48.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.594+0000 7f108b400640 1 -- 172.21.15.2:0/129145568 learned_addr learned my addr 172.21.15.2:0/129145568 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:46:48.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.594+0000 7f108aa00640 1 --2- 172.21.15.2:0/129145568 >> v2:172.21.15.155:3300/0 conn(0x7f108c15e960 0x7f108c06fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:48.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.594+0000 7f1089600640 1 -- 172.21.15.2:0/129145568 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1924350268 0 0) 0x7f108c071120 con 0x7f108c0d0350 2024-09-10T08:46:48.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.594+0000 7f1089600640 1 -- 172.21.15.2:0/129145568 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1070003520 con 0x7f108c0d0350 2024-09-10T08:46:48.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.594+0000 7f1089600640 1 -- 172.21.15.2:0/129145568 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1589037739 0 0) 0x7f108c070080 con 0x7f108c073540 2024-09-10T08:46:48.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.594+0000 7f1089600640 1 -- 172.21.15.2:0/129145568 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f108c071120 con 0x7f108c073540 2024-09-10T08:46:48.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.594+0000 7f1089600640 1 -- 172.21.15.2:0/129145568 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3598107521 0 0) 0x7f1070003520 con 0x7f108c0d0350 2024-09-10T08:46:48.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.594+0000 7f108aa00640 1 -- 172.21.15.2:0/129145568 >> v1:172.21.15.155:6789/0 conn(0x7f108c073540 legacy=0x7f108c0cfc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:48.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.594+0000 7f108aa00640 1 -- 172.21.15.2:0/129145568 >> v1:172.21.15.2:6789/0 conn(0x7f108c0d0350 legacy=0x7f108c0ae2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:48.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.594+0000 7f108aa00640 1 -- 172.21.15.2:0/129145568 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f108c070360 con 0x7f108c15e960 2024-09-10T08:46:48.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.595+0000 7f108aa00640 1 --2- 172.21.15.2:0/129145568 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f108c15e960 0x7f108c06fa80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f107c0097a0 tx=0x7f107c02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46365da21da452b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:48.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.596+0000 7f1089600640 1 -- 172.21.15.2:0/129145568 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f107c037070 con 0x7f108c15e960 2024-09-10T08:46:48.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.596+0000 7f1089600640 1 -- 172.21.15.2:0/129145568 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f107c02ac50 con 0x7f108c15e960 2024-09-10T08:46:48.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.596+0000 7f1089600640 1 -- 172.21.15.2:0/129145568 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10840019f0 con 0x7f108c15e960 2024-09-10T08:46:48.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.596+0000 7f1091a00640 1 -- 172.21.15.2:0/129145568 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f108c15e960 msgr2=0x7f108c06fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:48.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.596+0000 7f1091a00640 1 --2- 172.21.15.2:0/129145568 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f108c15e960 0x7f108c06fa80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f107c0097a0 tx=0x7f107c02a1c0 comp rx=0 tx=0).stop 2024-09-10T08:46:48.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.596+0000 7f1091a00640 1 -- 172.21.15.2:0/129145568 shutdown_connections 2024-09-10T08:46:48.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.596+0000 7f1091a00640 1 --2- 172.21.15.2:0/129145568 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f108c15e960 0x7f108c06fa80 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:48.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.596+0000 7f1091a00640 1 -- 172.21.15.2:0/129145568 >> 172.21.15.2:0/129145568 conn(0x7f108c0b6a00 msgr2=0x7f108c09aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:46:48.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.596+0000 7f1091a00640 1 -- 172.21.15.2:0/129145568 shutdown_connections 2024-09-10T08:46:48.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.596+0000 7f1091a00640 1 -- 172.21.15.2:0/129145568 wait complete. 2024-09-10T08:46:48.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.598+0000 7f1091a00640 1 Processor -- start 2024-09-10T08:46:48.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.598+0000 7f1091a00640 1 -- start start 2024-09-10T08:46:48.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.599+0000 7f1091a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f108c073540 0x7f108c161170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:48.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.599+0000 7f1091a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f108c0d0350 0x7f108c1587e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:48.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.599+0000 7f1091a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f108c15e960 0x7f108c155d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:48.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.599+0000 7f1091a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f108c0b09f0 con 0x7f108c15e960 2024-09-10T08:46:48.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.599+0000 7f1091a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f108c070920 con 0x7f108c073540 2024-09-10T08:46:48.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.599+0000 7f1091a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f108c0b0b70 con 0x7f108c0d0350 2024-09-10T08:46:48.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.599+0000 7f108b400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f108c15e960 0x7f108c155d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:48.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.599+0000 7f108a000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f108c0d0350 0x7f108c1587e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:48.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.599+0000 7f108b400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f108c15e960 0x7f108c155d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53524/0 (socket says 172.21.15.2:53524) 2024-09-10T08:46:48.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.599+0000 7f108b400640 1 -- 172.21.15.2:0/2115418805 learned_addr learned my addr 172.21.15.2:0/2115418805 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:46:48.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.599+0000 7f108aa00640 1 --2- 172.21.15.2:0/2115418805 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f108c073540 0x7f108c161170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:48.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.600+0000 7f108aa00640 1 -- 172.21.15.2:0/2115418805 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f108c0d0350 msgr2=0x7f108c1587e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:48.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.600+0000 7f108aa00640 1 --2- 172.21.15.2:0/2115418805 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f108c0d0350 0x7f108c1587e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:48.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.600+0000 7f108aa00640 1 -- 172.21.15.2:0/2115418805 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f108c15e960 msgr2=0x7f108c155d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:48.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.600+0000 7f108aa00640 1 --2- 172.21.15.2:0/2115418805 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f108c15e960 0x7f108c155d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:48.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.600+0000 7f108aa00640 1 -- 172.21.15.2:0/2115418805 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f108c15fdf0 con 0x7f108c073540 2024-09-10T08:46:48.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.600+0000 7f108b400640 1 --2- 172.21.15.2:0/2115418805 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f108c15e960 0x7f108c155d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:46:48.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.600+0000 7f108aa00640 1 --2- 172.21.15.2:0/2115418805 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f108c073540 0x7f108c161170 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f107c031000 tx=0x7f107c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:48.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.600+0000 7f1082a00640 1 -- 172.21.15.2:0/2115418805 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f107c041020 con 0x7f108c073540 2024-09-10T08:46:48.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.600+0000 7f1082a00640 1 -- 172.21.15.2:0/2115418805 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f107c03d420 con 0x7f108c073540 2024-09-10T08:46:48.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.600+0000 7f1082a00640 1 -- 172.21.15.2:0/2115418805 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f107c037040 con 0x7f108c073540 2024-09-10T08:46:48.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.600+0000 7f1091a00640 1 -- 172.21.15.2:0/2115418805 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f108c1600d0 con 0x7f108c073540 2024-09-10T08:46:48.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.601+0000 7f1091a00640 1 -- 172.21.15.2:0/2115418805 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f108c160690 con 0x7f108c073540 2024-09-10T08:46:48.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.601+0000 7f1091a00640 1 -- 172.21.15.2:0/2115418805 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f108c06fa80 con 0x7f108c073540 2024-09-10T08:46:48.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.603+0000 7f1082a00640 1 -- 172.21.15.2:0/2115418805 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f107c044020 con 0x7f108c073540 2024-09-10T08:46:48.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.603+0000 7f1082a00640 1 --2- 172.21.15.2:0/2115418805 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f106c06be80 0x7f106c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:48.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.604+0000 7f1082a00640 1 -- 172.21.15.2:0/2115418805 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f107c0aaec0 con 0x7f108c073540 2024-09-10T08:46:48.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.604+0000 7f108a000640 1 --2- 172.21.15.2:0/2115418805 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f106c06be80 0x7f106c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:48.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.604+0000 7f108a000640 1 --2- 172.21.15.2:0/2115418805 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f106c06be80 0x7f106c06e340 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f108c075f70 tx=0x7f1078009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:48.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.608+0000 7f1082a00640 1 -- 172.21.15.2:0/2115418805 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f107c04b030 con 0x7f108c073540 2024-09-10T08:46:48.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.795+0000 7f1091a00640 1 -- 172.21.15.2:0/2115418805 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f108c0b42c0 con 0x7f108c073540 2024-09-10T08:46:48.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.795+0000 7f1082a00640 1 -- 172.21.15.2:0/2115418805 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) ==== 84+0+65 (secure 0 0 0) 0x7f107c079550 con 0x7f108c073540 2024-09-10T08:46:48.796 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:46:48.796 INFO:teuthology.orchestra.run.smithi002.stdout:[ 2024-09-10T08:46:48.796 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T08:46:48.796 INFO:teuthology.orchestra.run.smithi002.stdout: "poolnum": 1, 2024-09-10T08:46:48.796 INFO:teuthology.orchestra.run.smithi002.stdout: "poolname": ".mgr" 2024-09-10T08:46:48.796 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T08:46:48.796 INFO:teuthology.orchestra.run.smithi002.stdout:] 2024-09-10T08:46:48.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.798+0000 7f1091a00640 1 -- 172.21.15.2:0/2115418805 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f106c06be80 msgr2=0x7f106c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:48.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.798+0000 7f1091a00640 1 --2- 172.21.15.2:0/2115418805 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f106c06be80 0x7f106c06e340 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f108c075f70 tx=0x7f1078009040 comp rx=0 tx=0).stop 2024-09-10T08:46:48.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.798+0000 7f1091a00640 1 -- 172.21.15.2:0/2115418805 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f108c073540 msgr2=0x7f108c161170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:48.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.798+0000 7f1091a00640 1 --2- 172.21.15.2:0/2115418805 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f108c073540 0x7f108c161170 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f107c031000 tx=0x7f107c0046c0 comp rx=0 tx=0).stop 2024-09-10T08:46:48.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.798+0000 7f1091a00640 1 -- 172.21.15.2:0/2115418805 shutdown_connections 2024-09-10T08:46:48.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.798+0000 7f1091a00640 1 --2- 172.21.15.2:0/2115418805 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f108c15e960 0x7f108c155d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:48.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.798+0000 7f1091a00640 1 --2- 172.21.15.2:0/2115418805 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f106c06be80 0x7f106c06e340 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:48.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.798+0000 7f1091a00640 1 --2- 172.21.15.2:0/2115418805 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f108c0d0350 0x7f108c1587e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:48.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.798+0000 7f1091a00640 1 --2- 172.21.15.2:0/2115418805 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f108c073540 0x7f108c161170 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:48.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.798+0000 7f1091a00640 1 -- 172.21.15.2:0/2115418805 >> 172.21.15.2:0/2115418805 conn(0x7f108c0b6a00 msgr2=0x7f108c15d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:46:48.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.798+0000 7f1091a00640 1 -- 172.21.15.2:0/2115418805 shutdown_connections 2024-09-10T08:46:48.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.798+0000 7f1091a00640 1 -- 172.21.15.2:0/2115418805 wait complete. 2024-09-10T08:46:48.813 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T08:46:48.813 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T08:46:48.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.973+0000 7f02a5a00640 1 Processor -- start 2024-09-10T08:46:48.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.973+0000 7f02a5a00640 1 -- start start 2024-09-10T08:46:48.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.975+0000 7f02a5a00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f02a0161b20 0x7f02a00adb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:48.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.975+0000 7f02a5a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f02a0073340 0x7f02a00737b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:48.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.975+0000 7f02a5a00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02a006ea00 con 0x7f02a00b44f0 2024-09-10T08:46:48.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.975+0000 7f02a5a00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f02a0161f00 con 0x7f02a0073340 2024-09-10T08:46:48.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.975+0000 7f02a5a00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f02a00ae040 con 0x7f02a0161b20 2024-09-10T08:46:48.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.975+0000 7f029f400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f02a00b44f0 0x7f02a006faa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:42026/0 (socket says 172.21.15.2:42026) 2024-09-10T08:46:48.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.975+0000 7f029f400640 1 -- 172.21.15.2:0/2756386376 learned_addr learned my addr 172.21.15.2:0/2756386376 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:46:48.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.975+0000 7f0297e00640 1 --2- 172.21.15.2:0/2756386376 >> v2:172.21.15.2:3300/0 conn(0x7f02a0073340 0x7f02a00737b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:48.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.975+0000 7f029ea00640 1 --2- 172.21.15.2:0/2756386376 >> v2:172.21.15.155:3300/0 conn(0x7f02a0161b20 0x7f02a00adb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:48.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.975+0000 7f029e000640 1 -- 172.21.15.2:0/2756386376 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1603559393 0 0) 0x7f02a006ea00 con 0x7f02a00b44f0 2024-09-10T08:46:48.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.975+0000 7f029e000640 1 -- 172.21.15.2:0/2756386376 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0284003520 con 0x7f02a00b44f0 2024-09-10T08:46:48.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.975+0000 7f0297e00640 1 -- 172.21.15.2:0/2756386376 >> v2:172.21.15.155:3300/0 conn(0x7f02a0161b20 msgr2=0x7f02a00adb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:46:48.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.975+0000 7f0297e00640 1 --2- 172.21.15.2:0/2756386376 >> v2:172.21.15.155:3300/0 conn(0x7f02a0161b20 0x7f02a00adb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:48.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.975+0000 7f0297e00640 1 -- 172.21.15.2:0/2756386376 >> v1:172.21.15.2:6789/0 conn(0x7f02a00b44f0 legacy=0x7f02a006faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:48.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.975+0000 7f0297e00640 1 -- 172.21.15.2:0/2756386376 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02a006ece0 con 0x7f02a0073340 2024-09-10T08:46:48.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.976+0000 7f0297e00640 1 --2- 172.21.15.2:0/2756386376 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02a0073340 0x7f02a00737b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f02a0050090 tx=0x7f028802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c765e3b146fac12f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:48.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.977+0000 7f029e000640 1 -- 172.21.15.2:0/2756386376 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0288037070 con 0x7f02a0073340 2024-09-10T08:46:48.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.977+0000 7f029e000640 1 -- 172.21.15.2:0/2756386376 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0288032440 con 0x7f02a0073340 2024-09-10T08:46:48.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.977+0000 7f029e000640 1 -- 172.21.15.2:0/2756386376 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0288032810 con 0x7f02a0073340 2024-09-10T08:46:48.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.977+0000 7f02a5a00640 1 -- 172.21.15.2:0/2756386376 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02a0073340 msgr2=0x7f02a00737b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:48.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.977+0000 7f02a5a00640 1 --2- 172.21.15.2:0/2756386376 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02a0073340 0x7f02a00737b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f02a0050090 tx=0x7f028802a1a0 comp rx=0 tx=0).stop 2024-09-10T08:46:48.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.977+0000 7f02a5a00640 1 -- 172.21.15.2:0/2756386376 shutdown_connections 2024-09-10T08:46:48.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.977+0000 7f02a5a00640 1 --2- 172.21.15.2:0/2756386376 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02a0073340 0x7f02a00737b0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:48.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.977+0000 7f02a5a00640 1 --2- 172.21.15.2:0/2756386376 >> v2:172.21.15.155:3300/0 conn(0x7f02a0161b20 0x7f02a00adb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:48.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.977+0000 7f02a5a00640 1 -- 172.21.15.2:0/2756386376 >> 172.21.15.2:0/2756386376 conn(0x7f02a0072820 msgr2=0x7f02a0072c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:46:48.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.977+0000 7f02a5a00640 1 -- 172.21.15.2:0/2756386376 shutdown_connections 2024-09-10T08:46:48.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.977+0000 7f02a5a00640 1 -- 172.21.15.2:0/2756386376 wait complete. 2024-09-10T08:46:48.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.979+0000 7f02a5a00640 1 Processor -- start 2024-09-10T08:46:48.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.979+0000 7f02a5a00640 1 -- start start 2024-09-10T08:46:48.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.980+0000 7f02a5a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02a0073340 0x7f02a014d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:48.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.980+0000 7f02a5a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02a00b44f0 0x7f02a014ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:48.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.980+0000 7f02a5a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02a0161b20 0x7f02a0152330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:48.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.980+0000 7f02a5a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f02a006f580 con 0x7f02a00b44f0 2024-09-10T08:46:48.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.980+0000 7f02a5a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f02a006f2a0 con 0x7f02a0161b20 2024-09-10T08:46:48.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.980+0000 7f02a5a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f02a00b3d30 con 0x7f02a0073340 2024-09-10T08:46:48.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.980+0000 7f0297e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02a00b44f0 0x7f02a014ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:48.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.980+0000 7f0297e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02a00b44f0 0x7f02a014ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53550/0 (socket says 172.21.15.2:53550) 2024-09-10T08:46:48.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.980+0000 7f0297e00640 1 -- 172.21.15.2:0/376726155 learned_addr learned my addr 172.21.15.2:0/376726155 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:46:48.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.980+0000 7f029ea00640 1 --2- 172.21.15.2:0/376726155 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02a0073340 0x7f02a014d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:48.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.980+0000 7f029f400640 1 --2- 172.21.15.2:0/376726155 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02a0161b20 0x7f02a0152330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:48.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.981+0000 7f0297e00640 1 -- 172.21.15.2:0/376726155 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02a0073340 msgr2=0x7f02a014d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:48.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.981+0000 7f0297e00640 1 --2- 172.21.15.2:0/376726155 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02a0073340 0x7f02a014d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:48.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.981+0000 7f0297e00640 1 -- 172.21.15.2:0/376726155 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02a0161b20 msgr2=0x7f02a0152330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:48.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.981+0000 7f0297e00640 1 --2- 172.21.15.2:0/376726155 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02a0161b20 0x7f02a0152330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:48.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.981+0000 7f0297e00640 1 -- 172.21.15.2:0/376726155 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02a015c640 con 0x7f02a00b44f0 2024-09-10T08:46:48.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.981+0000 7f029ea00640 1 --2- 172.21.15.2:0/376726155 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02a0073340 0x7f02a014d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:46:48.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.981+0000 7f0297e00640 1 --2- 172.21.15.2:0/376726155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02a00b44f0 0x7f02a014ca80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0288000c00 tx=0x7f02880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:48.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.981+0000 7f0296a00640 1 -- 172.21.15.2:0/376726155 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0288041020 con 0x7f02a00b44f0 2024-09-10T08:46:48.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.981+0000 7f0296a00640 1 -- 172.21.15.2:0/376726155 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f028803d700 con 0x7f02a00b44f0 2024-09-10T08:46:48.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.981+0000 7f0296a00640 1 -- 172.21.15.2:0/376726155 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0288037040 con 0x7f02a00b44f0 2024-09-10T08:46:48.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.981+0000 7f02a5a00640 1 -- 172.21.15.2:0/376726155 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02a015c980 con 0x7f02a00b44f0 2024-09-10T08:46:48.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.981+0000 7f02a5a00640 1 -- 172.21.15.2:0/376726155 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02a00ce230 con 0x7f02a00b44f0 2024-09-10T08:46:48.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.982+0000 7f02a5a00640 1 -- 172.21.15.2:0/376726155 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02a00737b0 con 0x7f02a00b44f0 2024-09-10T08:46:48.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.983+0000 7f0296a00640 1 -- 172.21.15.2:0/376726155 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0288044020 con 0x7f02a00b44f0 2024-09-10T08:46:48.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.984+0000 7f0296a00640 1 --2- 172.21.15.2:0/376726155 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f027c06be30 0x7f027c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:48.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.984+0000 7f0296a00640 1 -- 172.21.15.2:0/376726155 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f02880ab340 con 0x7f02a00b44f0 2024-09-10T08:46:48.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.984+0000 7f029ea00640 1 --2- 172.21.15.2:0/376726155 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f027c06be30 0x7f027c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:48.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.985+0000 7f029ea00640 1 --2- 172.21.15.2:0/376726155 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f027c06be30 0x7f027c06e2f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0290009b90 tx=0x7f0290008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:48.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:48.989+0000 7f0296a00640 1 -- 172.21.15.2:0/376726155 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f028804b030 con 0x7f02a00b44f0 2024-09-10T08:46:49.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.173+0000 7f02a5a00640 1 -- 172.21.15.2:0/376726155 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f02a00d08a0 con 0x7f02a00b44f0 2024-09-10T08:46:49.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.734+0000 7f0296a00640 1 -- 172.21.15.2:0/376726155 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) ==== 138+0+0 (secure 0 0 0) 0x7f02a015c980 con 0x7f02a00b44f0 2024-09-10T08:46:49.735 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' created 2024-09-10T08:46:49.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.738+0000 7f02a5a00640 1 -- 172.21.15.2:0/376726155 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f027c06be30 msgr2=0x7f027c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:49.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.738+0000 7f02a5a00640 1 --2- 172.21.15.2:0/376726155 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f027c06be30 0x7f027c06e2f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0290009b90 tx=0x7f0290008040 comp rx=0 tx=0).stop 2024-09-10T08:46:49.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.738+0000 7f02a5a00640 1 -- 172.21.15.2:0/376726155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02a00b44f0 msgr2=0x7f02a014ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:49.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.738+0000 7f02a5a00640 1 --2- 172.21.15.2:0/376726155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02a00b44f0 0x7f02a014ca80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0288000c00 tx=0x7f02880046c0 comp rx=0 tx=0).stop 2024-09-10T08:46:49.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.738+0000 7f02a5a00640 1 -- 172.21.15.2:0/376726155 shutdown_connections 2024-09-10T08:46:49.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.738+0000 7f02a5a00640 1 --2- 172.21.15.2:0/376726155 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02a0161b20 0x7f02a0152330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:49.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.738+0000 7f02a5a00640 1 --2- 172.21.15.2:0/376726155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02a00b44f0 0x7f02a014ca80 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:49.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.738+0000 7f02a5a00640 1 --2- 172.21.15.2:0/376726155 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f027c06be30 0x7f027c06e2f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:49.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.738+0000 7f02a5a00640 1 --2- 172.21.15.2:0/376726155 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f02a0073340 0x7f02a014d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:49.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.738+0000 7f02a5a00640 1 -- 172.21.15.2:0/376726155 >> 172.21.15.2:0/376726155 conn(0x7f02a0072820 msgr2=0x7f02a0072c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:46:49.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.738+0000 7f02a5a00640 1 -- 172.21.15.2:0/376726155 shutdown_connections 2024-09-10T08:46:49.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.738+0000 7f02a5a00640 1 -- 172.21.15.2:0/376726155 wait complete. 2024-09-10T08:46:49.760 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-10T08:46:49.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.924+0000 7f1918800640 1 Processor -- start 2024-09-10T08:46:49.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.924+0000 7f1918800640 1 -- start start 2024-09-10T08:46:49.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.925+0000 7f1918800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f191015c460 0x7f191015d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:49.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.925+0000 7f1918800640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f191006df50 0x7f19100cec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:49.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.925+0000 7f1918800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f19100cf140 0x7f19100ccc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:49.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.925+0000 7f1918800640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f1910161030 con 0x7f19100cf140 2024-09-10T08:46:49.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.925+0000 7f1918800640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f19100cf5f0 con 0x7f191006df50 2024-09-10T08:46:49.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.925+0000 7f1918800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f191015da70 con 0x7f191015c460 2024-09-10T08:46:49.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.926+0000 7f1916800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f19100cf140 0x7f19100ccc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:49.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.926+0000 7f1916800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f19100cf140 0x7f19100ccc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53552/0 (socket says 172.21.15.2:53552) 2024-09-10T08:46:49.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.926+0000 7f1916800640 1 -- 172.21.15.2:0/1550096825 learned_addr learned my addr 172.21.15.2:0/1550096825 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:46:49.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.926+0000 7f1915e00640 1 --2- 172.21.15.2:0/1550096825 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f191015c460 0x7f191015d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:49.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.926+0000 7f1915400640 1 --2- 172.21.15.2:0/1550096825 >> v2:172.21.15.155:3300/0 conn(0x7f191006df50 0x7f19100cec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:49.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.926+0000 7f1916800640 1 -- 172.21.15.2:0/1550096825 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f191015c460 msgr2=0x7f191015d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:46:49.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.926+0000 7f1916800640 1 --2- 172.21.15.2:0/1550096825 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f191015c460 0x7f191015d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:49.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.926+0000 7f1916800640 1 -- 172.21.15.2:0/1550096825 >> v2:172.21.15.155:3300/0 conn(0x7f191006df50 msgr2=0x7f19100cec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:46:49.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.926+0000 7f1916800640 1 --2- 172.21.15.2:0/1550096825 >> v2:172.21.15.155:3300/0 conn(0x7f191006df50 0x7f19100cec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:49.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.926+0000 7f1916800640 1 -- 172.21.15.2:0/1550096825 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19101603b0 con 0x7f19100cf140 2024-09-10T08:46:49.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.927+0000 7f1916800640 1 --2- 172.21.15.2:0/1550096825 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19100cf140 0x7f19100ccc30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f19100b2d70 tx=0x7f190c02a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=655a1bb2e83a094d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:49.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.927+0000 7f1914a00640 1 -- 172.21.15.2:0/1550096825 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f190c036070 con 0x7f19100cf140 2024-09-10T08:46:49.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.927+0000 7f1914a00640 1 -- 172.21.15.2:0/1550096825 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f190c031600 con 0x7f19100cf140 2024-09-10T08:46:49.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.927+0000 7f1914a00640 1 -- 172.21.15.2:0/1550096825 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f190c0319d0 con 0x7f19100cf140 2024-09-10T08:46:49.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.928+0000 7f1918800640 1 -- 172.21.15.2:0/1550096825 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19100cf140 msgr2=0x7f19100ccc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:49.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.928+0000 7f1918800640 1 --2- 172.21.15.2:0/1550096825 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19100cf140 0x7f19100ccc30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f19100b2d70 tx=0x7f190c02a6c0 comp rx=0 tx=0).stop 2024-09-10T08:46:49.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.928+0000 7f1918800640 1 -- 172.21.15.2:0/1550096825 shutdown_connections 2024-09-10T08:46:49.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.928+0000 7f1918800640 1 --2- 172.21.15.2:0/1550096825 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19100cf140 0x7f19100ccc30 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:49.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.928+0000 7f1918800640 1 --2- 172.21.15.2:0/1550096825 >> v2:172.21.15.155:3300/0 conn(0x7f191006df50 0x7f19100cec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:49.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.928+0000 7f1918800640 1 --2- 172.21.15.2:0/1550096825 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f191015c460 0x7f191015d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:49.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.928+0000 7f1918800640 1 -- 172.21.15.2:0/1550096825 >> 172.21.15.2:0/1550096825 conn(0x7f19100d02c0 msgr2=0x7f19100d06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:46:49.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.928+0000 7f1918800640 1 -- 172.21.15.2:0/1550096825 shutdown_connections 2024-09-10T08:46:49.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.928+0000 7f1918800640 1 -- 172.21.15.2:0/1550096825 wait complete. 2024-09-10T08:46:49.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.930+0000 7f1918800640 1 Processor -- start 2024-09-10T08:46:49.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.930+0000 7f1918800640 1 -- start start 2024-09-10T08:46:49.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.931+0000 7f1918800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f191006df50 0x7f191014a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:49.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.931+0000 7f1918800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19100cf140 0x7f19101598c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:49.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.931+0000 7f1918800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f191015c460 0x7f1910159e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:49.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.931+0000 7f1918800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1910160c50 con 0x7f191015c460 2024-09-10T08:46:49.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.931+0000 7f1918800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1910160970 con 0x7f191006df50 2024-09-10T08:46:49.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.931+0000 7f1918800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1910160080 con 0x7f19100cf140 2024-09-10T08:46:49.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.931+0000 7f1916800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f191015c460 0x7f1910159e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:49.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.931+0000 7f1916800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f191015c460 0x7f1910159e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53560/0 (socket says 172.21.15.2:53560) 2024-09-10T08:46:49.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.931+0000 7f1916800640 1 -- 172.21.15.2:0/2955823114 learned_addr learned my addr 172.21.15.2:0/2955823114 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:46:49.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.931+0000 7f1915400640 1 --2- 172.21.15.2:0/2955823114 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19100cf140 0x7f19101598c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:49.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.931+0000 7f1915e00640 1 --2- 172.21.15.2:0/2955823114 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f191006df50 0x7f191014a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:49.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.931+0000 7f1916800640 1 -- 172.21.15.2:0/2955823114 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19100cf140 msgr2=0x7f19101598c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:49.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.931+0000 7f1916800640 1 --2- 172.21.15.2:0/2955823114 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19100cf140 0x7f19101598c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:49.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.931+0000 7f1916800640 1 -- 172.21.15.2:0/2955823114 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f191006df50 msgr2=0x7f191014a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:49.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.931+0000 7f1916800640 1 --2- 172.21.15.2:0/2955823114 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f191006df50 0x7f191014a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:49.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.931+0000 7f1916800640 1 -- 172.21.15.2:0/2955823114 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19101e6110 con 0x7f191015c460 2024-09-10T08:46:49.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.932+0000 7f1916800640 1 --2- 172.21.15.2:0/2955823114 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f191015c460 0x7f1910159e00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f190c009f70 tx=0x7f190c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:49.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.932+0000 7f190a000640 1 -- 172.21.15.2:0/2955823114 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f190c036050 con 0x7f191015c460 2024-09-10T08:46:49.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.932+0000 7f190a000640 1 -- 172.21.15.2:0/2955823114 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f190c042070 con 0x7f191015c460 2024-09-10T08:46:49.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.932+0000 7f190a000640 1 -- 172.21.15.2:0/2955823114 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f190c009510 con 0x7f191015c460 2024-09-10T08:46:49.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.932+0000 7f1918800640 1 -- 172.21.15.2:0/2955823114 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19101e63f0 con 0x7f191015c460 2024-09-10T08:46:49.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.932+0000 7f1918800640 1 -- 172.21.15.2:0/2955823114 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19101e69b0 con 0x7f191015c460 2024-09-10T08:46:49.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.933+0000 7f1918800640 1 -- 172.21.15.2:0/2955823114 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f191015c840 con 0x7f191015c460 2024-09-10T08:46:49.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.934+0000 7f190a000640 1 -- 172.21.15.2:0/2955823114 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f190c007bf0 con 0x7f191015c460 2024-09-10T08:46:49.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.935+0000 7f190a000640 1 --2- 172.21.15.2:0/2955823114 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f18f406be60 0x7f18f406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:49.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.935+0000 7f190a000640 1 -- 172.21.15.2:0/2955823114 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 5227+0+0 (secure 0 0 0) 0x7f190c0ab8c0 con 0x7f191015c460 2024-09-10T08:46:49.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.935+0000 7f1915e00640 1 --2- 172.21.15.2:0/2955823114 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f18f406be60 0x7f18f406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:49.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.936+0000 7f1915e00640 1 --2- 172.21.15.2:0/2955823114 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f18f406be60 0x7f18f406e320 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f191015a600 tx=0x7f1904009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:49.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:49.940+0000 7f190a000640 1 -- 172.21.15.2:0/2955823114 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f190c079df0 con 0x7f191015c460 2024-09-10T08:46:50.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.126+0000 7f1918800640 1 -- 172.21.15.2:0/2955823114 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f19100ced90 con 0x7f191015c460 2024-09-10T08:46:50.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.737+0000 7f190a000640 1 -- 172.21.15.2:0/2955823114 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v18) ==== 171+0+0 (secure 0 0 0) 0x7f190c07e0f0 con 0x7f191015c460 2024-09-10T08:46:50.738 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' created 2024-09-10T08:46:50.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.741+0000 7f1918800640 1 -- 172.21.15.2:0/2955823114 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f18f406be60 msgr2=0x7f18f406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:50.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.741+0000 7f1918800640 1 --2- 172.21.15.2:0/2955823114 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f18f406be60 0x7f18f406e320 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f191015a600 tx=0x7f1904009190 comp rx=0 tx=0).stop 2024-09-10T08:46:50.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.741+0000 7f1918800640 1 -- 172.21.15.2:0/2955823114 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f191015c460 msgr2=0x7f1910159e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:50.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.741+0000 7f1918800640 1 --2- 172.21.15.2:0/2955823114 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f191015c460 0x7f1910159e00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f190c009f70 tx=0x7f190c004a40 comp rx=0 tx=0).stop 2024-09-10T08:46:50.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.743+0000 7f1918800640 1 -- 172.21.15.2:0/2955823114 shutdown_connections 2024-09-10T08:46:50.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.743+0000 7f1918800640 1 --2- 172.21.15.2:0/2955823114 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f191015c460 0x7f1910159e00 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:50.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.743+0000 7f1918800640 1 --2- 172.21.15.2:0/2955823114 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f18f406be60 0x7f18f406e320 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:50.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.743+0000 7f1918800640 1 --2- 172.21.15.2:0/2955823114 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f19100cf140 0x7f19101598c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:50.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.743+0000 7f1918800640 1 --2- 172.21.15.2:0/2955823114 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f191006df50 0x7f191014a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:50.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.743+0000 7f1918800640 1 -- 172.21.15.2:0/2955823114 >> 172.21.15.2:0/2955823114 conn(0x7f19100d02c0 msgr2=0x7f191015dc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:46:50.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.746+0000 7f1918800640 1 -- 172.21.15.2:0/2955823114 shutdown_connections 2024-09-10T08:46:50.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.746+0000 7f1918800640 1 -- 172.21.15.2:0/2955823114 wait complete. 2024-09-10T08:46:50.783 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T08:46:50.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.943+0000 7f03ac800640 1 Processor -- start 2024-09-10T08:46:50.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.943+0000 7f03ac800640 1 -- start start 2024-09-10T08:46:50.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.945+0000 7f03ac800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f03a415b4c0 0x7f03a40cf6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:50.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.945+0000 7f03ac800640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f03a406f770 0x7f03a40ae150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:50.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.945+0000 7f03ac800640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03a40ad390 con 0x7f03a40af590 2024-09-10T08:46:50.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.945+0000 7f03ac800640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f03a40d1130 con 0x7f03a406f770 2024-09-10T08:46:50.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.945+0000 7f03ac800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f03a40ad140 con 0x7f03a415b4c0 2024-09-10T08:46:50.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.945+0000 7f03a9e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f03a415b4c0 0x7f03a40cf6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:50.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.945+0000 7f03a9e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f03a415b4c0 0x7f03a40cf6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.2:59132/0 (socket says 172.21.15.2:59132) 2024-09-10T08:46:50.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.945+0000 7f03a9400640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f03a40af590 0x7f03a406f060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.2:41928/0 (socket says 172.21.15.2:41928) 2024-09-10T08:46:50.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.945+0000 7f03a9e00640 1 -- 172.21.15.2:0/2722531860 learned_addr learned my addr 172.21.15.2:0/2722531860 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:46:50.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.945+0000 7f03aa800640 1 --2- 172.21.15.2:0/2722531860 >> v2:172.21.15.155:3300/0 conn(0x7f03a406f770 0x7f03a40ae150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:50.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.946+0000 7f03a8a00640 1 -- 172.21.15.2:0/2722531860 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3160057350 0 0) 0x7f03a40ad390 con 0x7f03a40af590 2024-09-10T08:46:50.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.946+0000 7f03a8a00640 1 -- 172.21.15.2:0/2722531860 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f038c005730 con 0x7f03a40af590 2024-09-10T08:46:50.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.946+0000 7f03aa800640 1 -- 172.21.15.2:0/2722531860 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f03a415b4c0 msgr2=0x7f03a40cf6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:46:50.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.946+0000 7f03aa800640 1 --2- 172.21.15.2:0/2722531860 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f03a415b4c0 0x7f03a40cf6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:50.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.946+0000 7f03aa800640 1 -- 172.21.15.2:0/2722531860 >> v1:172.21.15.155:6789/0 conn(0x7f03a40af590 legacy=0x7f03a406f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:50.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.946+0000 7f03aa800640 1 -- 172.21.15.2:0/2722531860 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03a40ad670 con 0x7f03a406f770 2024-09-10T08:46:50.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.946+0000 7f03a9e00640 1 --2- 172.21.15.2:0/2722531860 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f03a415b4c0 0x7f03a40cf6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:46:50.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.947+0000 7f03aa800640 1 --2- 172.21.15.2:0/2722531860 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f03a406f770 0x7f03a40ae150 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f03a0009d90 tx=0x7f03a002a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9e05d626aa7216a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:50.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.947+0000 7f03a8a00640 1 -- 172.21.15.2:0/2722531860 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a0031600 con 0x7f03a406f770 2024-09-10T08:46:50.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.947+0000 7f03a8a00640 1 -- 172.21.15.2:0/2722531860 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03a00317a0 con 0x7f03a406f770 2024-09-10T08:46:50.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.947+0000 7f03a8a00640 1 -- 172.21.15.2:0/2722531860 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a0031b50 con 0x7f03a406f770 2024-09-10T08:46:50.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.948+0000 7f03ac800640 1 -- 172.21.15.2:0/2722531860 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f03a406f770 msgr2=0x7f03a40ae150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:50.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.948+0000 7f03ac800640 1 --2- 172.21.15.2:0/2722531860 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f03a406f770 0x7f03a40ae150 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f03a0009d90 tx=0x7f03a002a5d0 comp rx=0 tx=0).stop 2024-09-10T08:46:50.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.948+0000 7f03ac800640 1 -- 172.21.15.2:0/2722531860 shutdown_connections 2024-09-10T08:46:50.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.948+0000 7f03ac800640 1 --2- 172.21.15.2:0/2722531860 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f03a406f770 0x7f03a40ae150 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:50.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.948+0000 7f03ac800640 1 --2- 172.21.15.2:0/2722531860 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f03a415b4c0 0x7f03a40cf6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:50.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.948+0000 7f03ac800640 1 -- 172.21.15.2:0/2722531860 >> 172.21.15.2:0/2722531860 conn(0x7f03a40d02c0 msgr2=0x7f03a40d06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:46:50.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.948+0000 7f03ac800640 1 -- 172.21.15.2:0/2722531860 shutdown_connections 2024-09-10T08:46:50.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.948+0000 7f03ac800640 1 -- 172.21.15.2:0/2722531860 wait complete. 2024-09-10T08:46:50.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.949+0000 7f03ac800640 1 Processor -- start 2024-09-10T08:46:50.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.949+0000 7f03ac800640 1 -- start start 2024-09-10T08:46:50.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.950+0000 7f03ac800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f03a406f770 0x7f03a414e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:50.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.950+0000 7f03ac800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f03a40af590 0x7f03a4155870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:50.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.950+0000 7f03ac800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03a415b4c0 0x7f03a4072200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:50.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.950+0000 7f03ac800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f03a40adc30 con 0x7f03a415b4c0 2024-09-10T08:46:50.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.950+0000 7f03ac800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f03a40af9d0 con 0x7f03a40af590 2024-09-10T08:46:50.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.950+0000 7f03ac800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f03a4071ef0 con 0x7f03a406f770 2024-09-10T08:46:50.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.951+0000 7f03aa800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03a415b4c0 0x7f03a4072200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:50.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.951+0000 7f03aa800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03a415b4c0 0x7f03a4072200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53576/0 (socket says 172.21.15.2:53576) 2024-09-10T08:46:50.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.951+0000 7f03aa800640 1 -- 172.21.15.2:0/4283643904 learned_addr learned my addr 172.21.15.2:0/4283643904 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:46:50.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.951+0000 7f03a9400640 1 --2- 172.21.15.2:0/4283643904 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f03a40af590 0x7f03a4155870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:50.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.951+0000 7f03a9e00640 1 --2- 172.21.15.2:0/4283643904 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f03a406f770 0x7f03a414e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:50.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.951+0000 7f03aa800640 1 -- 172.21.15.2:0/4283643904 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f03a406f770 msgr2=0x7f03a414e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:50.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.951+0000 7f03aa800640 1 --2- 172.21.15.2:0/4283643904 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f03a406f770 0x7f03a414e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:50.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.951+0000 7f03aa800640 1 -- 172.21.15.2:0/4283643904 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f03a40af590 msgr2=0x7f03a4155870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:50.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.951+0000 7f03aa800640 1 --2- 172.21.15.2:0/4283643904 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f03a40af590 0x7f03a4155870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:50.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.951+0000 7f03aa800640 1 -- 172.21.15.2:0/4283643904 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03a414ed60 con 0x7f03a415b4c0 2024-09-10T08:46:50.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.951+0000 7f03aa800640 1 --2- 172.21.15.2:0/4283643904 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03a415b4c0 0x7f03a4072200 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f03a0009eb0 tx=0x7f03a0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:50.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.952+0000 7f039e000640 1 -- 172.21.15.2:0/4283643904 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a0040070 con 0x7f03a415b4c0 2024-09-10T08:46:50.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.952+0000 7f039e000640 1 -- 172.21.15.2:0/4283643904 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03a003c850 con 0x7f03a415b4c0 2024-09-10T08:46:50.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.952+0000 7f039e000640 1 -- 172.21.15.2:0/4283643904 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a003cc40 con 0x7f03a415b4c0 2024-09-10T08:46:50.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.952+0000 7f03ac800640 1 -- 172.21.15.2:0/4283643904 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03a41533a0 con 0x7f03a415b4c0 2024-09-10T08:46:50.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.952+0000 7f03ac800640 1 -- 172.21.15.2:0/4283643904 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03a4155070 con 0x7f03a415b4c0 2024-09-10T08:46:50.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.953+0000 7f03ac800640 1 -- 172.21.15.2:0/4283643904 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03a415b8a0 con 0x7f03a415b4c0 2024-09-10T08:46:50.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.954+0000 7f039e000640 1 -- 172.21.15.2:0/4283643904 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f03a0039040 con 0x7f03a415b4c0 2024-09-10T08:46:50.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.955+0000 7f039e000640 1 --2- 172.21.15.2:0/4283643904 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f038806be60 0x7f038806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:50.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.955+0000 7f039e000640 1 -- 172.21.15.2:0/4283643904 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5609+0+0 (secure 0 0 0) 0x7f03a00abe60 con 0x7f03a415b4c0 2024-09-10T08:46:50.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.956+0000 7f03a9e00640 1 --2- 172.21.15.2:0/4283643904 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f038806be60 0x7f038806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:50.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.956+0000 7f03a9e00640 1 --2- 172.21.15.2:0/4283643904 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f038806be60 0x7f038806e320 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0398006ca0 tx=0x7f0398009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:50.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:50.960+0000 7f039e000640 1 -- 172.21.15.2:0/4283643904 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f03a007a330 con 0x7f03a415b4c0 2024-09-10T08:46:51.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.179+0000 7f03ac800640 1 -- 172.21.15.2:0/4283643904 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f03a406ea90 con 0x7f03a415b4c0 2024-09-10T08:46:51.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.762+0000 7f039e000640 1 -- 172.21.15.2:0/4283643904 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f03a007e630 con 0x7f03a415b4c0 2024-09-10T08:46:51.764 INFO:teuthology.orchestra.run.smithi002.stderr:new fs with metadata pool 2 and data pool 3 2024-09-10T08:46:51.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.767+0000 7f03ac800640 1 -- 172.21.15.2:0/4283643904 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f038806be60 msgr2=0x7f038806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:51.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.767+0000 7f03ac800640 1 --2- 172.21.15.2:0/4283643904 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f038806be60 0x7f038806e320 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0398006ca0 tx=0x7f0398009240 comp rx=0 tx=0).stop 2024-09-10T08:46:51.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.767+0000 7f03ac800640 1 -- 172.21.15.2:0/4283643904 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03a415b4c0 msgr2=0x7f03a4072200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:51.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.767+0000 7f03ac800640 1 --2- 172.21.15.2:0/4283643904 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03a415b4c0 0x7f03a4072200 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f03a0009eb0 tx=0x7f03a0004a40 comp rx=0 tx=0).stop 2024-09-10T08:46:51.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.769+0000 7f03ac800640 1 -- 172.21.15.2:0/4283643904 shutdown_connections 2024-09-10T08:46:51.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.769+0000 7f03ac800640 1 --2- 172.21.15.2:0/4283643904 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03a415b4c0 0x7f03a4072200 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:51.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.769+0000 7f03ac800640 1 --2- 172.21.15.2:0/4283643904 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f03a40af590 0x7f03a4155870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:51.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.769+0000 7f03ac800640 1 --2- 172.21.15.2:0/4283643904 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f038806be60 0x7f038806e320 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:51.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.769+0000 7f03ac800640 1 --2- 172.21.15.2:0/4283643904 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f03a406f770 0x7f03a414e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:51.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.769+0000 7f03ac800640 1 -- 172.21.15.2:0/4283643904 >> 172.21.15.2:0/4283643904 conn(0x7f03a40d02c0 msgr2=0x7f03a40b31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:46:51.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.769+0000 7f03ac800640 1 -- 172.21.15.2:0/4283643904 shutdown_connections 2024-09-10T08:46:51.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.770+0000 7f03ac800640 1 -- 172.21.15.2:0/4283643904 wait complete. 2024-09-10T08:46:51.803 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-10T08:46:51.804 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-10T08:46:51.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.965+0000 7f7a35400640 1 Processor -- start 2024-09-10T08:46:51.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.966+0000 7f7a35400640 1 -- start start 2024-09-10T08:46:51.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.967+0000 7f7a35400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a3015e500 0x7f7a300cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:51.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.967+0000 7f7a35400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7a300d4d90 0x7f7a300d2e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:51.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.967+0000 7f7a35400640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7a300d0b50 0x7f7a300d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:51.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.967+0000 7f7a35400640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f7a300d1500 con 0x7f7a300d4d90 2024-09-10T08:46:51.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.967+0000 7f7a35400640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f7a3015e8e0 con 0x7f7a300d0b50 2024-09-10T08:46:51.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.967+0000 7f7a35400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7a300d3380 con 0x7f7a3015e500 2024-09-10T08:46:51.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.967+0000 7f7a27e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7a300d4d90 0x7f7a300d2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:51.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.967+0000 7f7a27e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7a300d4d90 0x7f7a300d2e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53590/0 (socket says 172.21.15.2:53590) 2024-09-10T08:46:51.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.967+0000 7f7a27e00640 1 -- 172.21.15.2:0/107767687 learned_addr learned my addr 172.21.15.2:0/107767687 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:46:51.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.967+0000 7f7a2fe00640 1 --2- 172.21.15.2:0/107767687 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a3015e500 0x7f7a300cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:51.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.967+0000 7f7a34a00640 1 --2- 172.21.15.2:0/107767687 >> v2:172.21.15.155:3300/0 conn(0x7f7a300d0b50 0x7f7a300d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:51.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.967+0000 7f7a27e00640 1 -- 172.21.15.2:0/107767687 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a3015e500 msgr2=0x7f7a300cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:46:51.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.967+0000 7f7a27e00640 1 --2- 172.21.15.2:0/107767687 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a3015e500 0x7f7a300cefb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:51.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.967+0000 7f7a27e00640 1 -- 172.21.15.2:0/107767687 >> v2:172.21.15.155:3300/0 conn(0x7f7a300d0b50 msgr2=0x7f7a300d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:46:51.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.967+0000 7f7a27e00640 1 --2- 172.21.15.2:0/107767687 >> v2:172.21.15.155:3300/0 conn(0x7f7a300d0b50 0x7f7a300d0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:51.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.967+0000 7f7a27e00640 1 -- 172.21.15.2:0/107767687 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a300d0350 con 0x7f7a300d4d90 2024-09-10T08:46:51.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.968+0000 7f7a27e00640 1 --2- 172.21.15.2:0/107767687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a300d4d90 0x7f7a300d2e40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7a3008d850 tx=0x7f7a1802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecf503e65fd5d953 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:51.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.969+0000 7f7a2f400640 1 -- 172.21.15.2:0/107767687 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a18037070 con 0x7f7a300d4d90 2024-09-10T08:46:51.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.969+0000 7f7a2f400640 1 -- 172.21.15.2:0/107767687 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a18032440 con 0x7f7a300d4d90 2024-09-10T08:46:51.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.969+0000 7f7a2f400640 1 -- 172.21.15.2:0/107767687 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a18032810 con 0x7f7a300d4d90 2024-09-10T08:46:51.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.969+0000 7f7a35400640 1 -- 172.21.15.2:0/107767687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a300d4d90 msgr2=0x7f7a300d2e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:51.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.969+0000 7f7a35400640 1 --2- 172.21.15.2:0/107767687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a300d4d90 0x7f7a300d2e40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7a3008d850 tx=0x7f7a1802a1e0 comp rx=0 tx=0).stop 2024-09-10T08:46:51.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.969+0000 7f7a35400640 1 -- 172.21.15.2:0/107767687 shutdown_connections 2024-09-10T08:46:51.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.969+0000 7f7a35400640 1 --2- 172.21.15.2:0/107767687 >> v2:172.21.15.155:3300/0 conn(0x7f7a300d0b50 0x7f7a300d0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:51.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.969+0000 7f7a35400640 1 --2- 172.21.15.2:0/107767687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a300d4d90 0x7f7a300d2e40 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:51.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.969+0000 7f7a35400640 1 --2- 172.21.15.2:0/107767687 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a3015e500 0x7f7a300cefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:51.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.969+0000 7f7a35400640 1 -- 172.21.15.2:0/107767687 >> 172.21.15.2:0/107767687 conn(0x7f7a3009d720 msgr2=0x7f7a300d4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:46:51.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.969+0000 7f7a35400640 1 -- 172.21.15.2:0/107767687 shutdown_connections 2024-09-10T08:46:51.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.969+0000 7f7a35400640 1 -- 172.21.15.2:0/107767687 wait complete. 2024-09-10T08:46:51.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.971+0000 7f7a35400640 1 Processor -- start 2024-09-10T08:46:51.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.971+0000 7f7a35400640 1 -- start start 2024-09-10T08:46:51.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.972+0000 7f7a35400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a300d0b50 0x7f7a30161690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:51.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.972+0000 7f7a35400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a300d4d90 0x7f7a301f7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:51.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.972+0000 7f7a35400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a3015e500 0x7f7a301f7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:51.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.972+0000 7f7a35400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7a300d2640 con 0x7f7a300d0b50 2024-09-10T08:46:51.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.972+0000 7f7a35400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7a300d2360 con 0x7f7a3015e500 2024-09-10T08:46:51.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.972+0000 7f7a35400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7a300d2920 con 0x7f7a300d4d90 2024-09-10T08:46:51.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.972+0000 7f7a2fe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a300d0b50 0x7f7a30161690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:51.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.972+0000 7f7a2fe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a300d0b50 0x7f7a30161690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53592/0 (socket says 172.21.15.2:53592) 2024-09-10T08:46:51.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.972+0000 7f7a2fe00640 1 -- 172.21.15.2:0/4207597487 learned_addr learned my addr 172.21.15.2:0/4207597487 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:46:51.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.973+0000 7f7a27e00640 1 --2- 172.21.15.2:0/4207597487 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a300d4d90 0x7f7a301f7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:51.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.973+0000 7f7a2fe00640 1 -- 172.21.15.2:0/4207597487 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a300d4d90 msgr2=0x7f7a301f7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:51.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.973+0000 7f7a34a00640 1 --2- 172.21.15.2:0/4207597487 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a3015e500 0x7f7a301f7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:51.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.973+0000 7f7a2fe00640 1 --2- 172.21.15.2:0/4207597487 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a300d4d90 0x7f7a301f7aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:51.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.973+0000 7f7a2fe00640 1 -- 172.21.15.2:0/4207597487 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a3015e500 msgr2=0x7f7a301f7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:51.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.973+0000 7f7a2fe00640 1 --2- 172.21.15.2:0/4207597487 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a3015e500 0x7f7a301f7fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:51.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.973+0000 7f7a2fe00640 1 -- 172.21.15.2:0/4207597487 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a300b2d10 con 0x7f7a300d0b50 2024-09-10T08:46:51.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.973+0000 7f7a2fe00640 1 --2- 172.21.15.2:0/4207597487 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a300d0b50 0x7f7a30161690 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7a2000e9e0 tx=0x7f7a2000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:51.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.973+0000 7f7a2cc00640 1 -- 172.21.15.2:0/4207597487 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a20017070 con 0x7f7a300d0b50 2024-09-10T08:46:51.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.973+0000 7f7a2cc00640 1 -- 172.21.15.2:0/4207597487 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a2000c9d0 con 0x7f7a300d0b50 2024-09-10T08:46:51.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.973+0000 7f7a2cc00640 1 -- 172.21.15.2:0/4207597487 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a2000cdc0 con 0x7f7a300d0b50 2024-09-10T08:46:51.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.973+0000 7f7a35400640 1 -- 172.21.15.2:0/4207597487 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a300cd9b0 con 0x7f7a300d0b50 2024-09-10T08:46:51.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.974+0000 7f7a35400640 1 -- 172.21.15.2:0/4207597487 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a300b2f90 con 0x7f7a300d0b50 2024-09-10T08:46:51.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.974+0000 7f7a35400640 1 -- 172.21.15.2:0/4207597487 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a300cded0 con 0x7f7a300d0b50 2024-09-10T08:46:51.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.976+0000 7f7a2cc00640 1 -- 172.21.15.2:0/4207597487 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7a2001a070 con 0x7f7a300d0b50 2024-09-10T08:46:51.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.976+0000 7f7a2cc00640 1 --2- 172.21.15.2:0/4207597487 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f7a0c06be60 0x7f7a0c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:51.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.976+0000 7f7a2cc00640 1 -- 172.21.15.2:0/4207597487 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f7a2008aef0 con 0x7f7a300d0b50 2024-09-10T08:46:51.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.977+0000 7f7a27e00640 1 --2- 172.21.15.2:0/4207597487 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f7a0c06be60 0x7f7a0c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:51.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.978+0000 7f7a27e00640 1 --2- 172.21.15.2:0/4207597487 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f7a0c06be60 0x7f7a0c06e320 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7a18034000 tx=0x7f7a1802e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:51.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:51.981+0000 7f7a2cc00640 1 -- 172.21.15.2:0/4207597487 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7a300cded0 con 0x7f7a300d0b50 2024-09-10T08:46:52.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.172+0000 7f7a35400640 1 -- 172.21.15.2:0/4207597487 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f7a300cff90 con 0x7f7a300d0b50 2024-09-10T08:46:52.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.764+0000 7f7a2cc00640 1 -- 172.21.15.2:0/4207597487 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) ==== 157+0+0 (secure 0 0 0) 0x7f7a300b2d10 con 0x7f7a300d0b50 2024-09-10T08:46:52.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.768+0000 7f7a35400640 1 -- 172.21.15.2:0/4207597487 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f7a0c06be60 msgr2=0x7f7a0c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:52.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.768+0000 7f7a35400640 1 --2- 172.21.15.2:0/4207597487 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f7a0c06be60 0x7f7a0c06e320 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7a18034000 tx=0x7f7a1802e000 comp rx=0 tx=0).stop 2024-09-10T08:46:52.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.768+0000 7f7a35400640 1 -- 172.21.15.2:0/4207597487 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a300d0b50 msgr2=0x7f7a30161690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:52.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.768+0000 7f7a35400640 1 --2- 172.21.15.2:0/4207597487 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a300d0b50 0x7f7a30161690 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7a2000e9e0 tx=0x7f7a2000eea0 comp rx=0 tx=0).stop 2024-09-10T08:46:52.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.768+0000 7f7a35400640 1 -- 172.21.15.2:0/4207597487 shutdown_connections 2024-09-10T08:46:52.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.768+0000 7f7a35400640 1 --2- 172.21.15.2:0/4207597487 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a3015e500 0x7f7a301f7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:52.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.768+0000 7f7a35400640 1 --2- 172.21.15.2:0/4207597487 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f7a0c06be60 0x7f7a0c06e320 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:52.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.768+0000 7f7a35400640 1 --2- 172.21.15.2:0/4207597487 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7a300d4d90 0x7f7a301f7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:52.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.768+0000 7f7a35400640 1 --2- 172.21.15.2:0/4207597487 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7a300d0b50 0x7f7a30161690 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:52.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.768+0000 7f7a35400640 1 -- 172.21.15.2:0/4207597487 >> 172.21.15.2:0/4207597487 conn(0x7f7a3009d720 msgr2=0x7f7a300b9a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:46:52.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.768+0000 7f7a35400640 1 -- 172.21.15.2:0/4207597487 shutdown_connections 2024-09-10T08:46:52.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.768+0000 7f7a35400640 1 -- 172.21.15.2:0/4207597487 wait complete. 2024-09-10T08:46:52.790 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T08:46:52.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.958+0000 7f7f65400640 1 Processor -- start 2024-09-10T08:46:52.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.958+0000 7f7f65400640 1 -- start start 2024-09-10T08:46:52.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.959+0000 7f7f65400640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7f600d0ef0 0x7f7f600d1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:52.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.959+0000 7f7f65400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7f600cfe70 0x7f7f600d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:52.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.960+0000 7f7f65400640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f600d2140 con 0x7f7f6015e880 2024-09-10T08:46:52.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.960+0000 7f7f65400640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f7f6015ec60 con 0x7f7f600d0ef0 2024-09-10T08:46:52.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.960+0000 7f7f65400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7f600d1890 con 0x7f7f600cfe70 2024-09-10T08:46:52.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.960+0000 7f7f5e800640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f7f6015e880 0x7f7f600d31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:42036/0 (socket says 172.21.15.2:42036) 2024-09-10T08:46:52.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.960+0000 7f7f5e800640 1 -- 172.21.15.2:0/1810033335 learned_addr learned my addr 172.21.15.2:0/1810033335 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:46:52.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.960+0000 7f7f57e00640 1 --2- 172.21.15.2:0/1810033335 >> v2:172.21.15.155:3300/0 conn(0x7f7f600d0ef0 0x7f7f600d1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:52.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.960+0000 7f7f5f200640 1 --2- 172.21.15.2:0/1810033335 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7f600cfe70 0x7f7f600d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:52.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.960+0000 7f7f5de00640 1 -- 172.21.15.2:0/1810033335 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3241711814 0 0) 0x7f7f600d2140 con 0x7f7f6015e880 2024-09-10T08:46:52.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.960+0000 7f7f5de00640 1 -- 172.21.15.2:0/1810033335 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f44003520 con 0x7f7f6015e880 2024-09-10T08:46:52.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.960+0000 7f7f5de00640 1 -- 172.21.15.2:0/1810033335 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2487599620 0 0) 0x7f7f44003520 con 0x7f7f6015e880 2024-09-10T08:46:52.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.960+0000 7f7f5de00640 1 -- 172.21.15.2:0/1810033335 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7f600cfe70 msgr2=0x7f7f600d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:46:52.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.960+0000 7f7f5de00640 1 --2- 172.21.15.2:0/1810033335 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7f600cfe70 0x7f7f600d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:52.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.961+0000 7f7f5de00640 1 -- 172.21.15.2:0/1810033335 >> v2:172.21.15.155:3300/0 conn(0x7f7f600d0ef0 msgr2=0x7f7f600d1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:46:52.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.961+0000 7f7f5de00640 1 --2- 172.21.15.2:0/1810033335 >> v2:172.21.15.155:3300/0 conn(0x7f7f600d0ef0 0x7f7f600d1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:52.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.961+0000 7f7f5de00640 1 -- 172.21.15.2:0/1810033335 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f600d2420 con 0x7f7f6015e880 2024-09-10T08:46:52.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.961+0000 7f7f5de00640 1 -- 172.21.15.2:0/1810033335 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2345211856 0 0) 0x7f7f50001670 con 0x7f7f6015e880 2024-09-10T08:46:52.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.961+0000 7f7f5de00640 1 -- 172.21.15.2:0/1810033335 >> v1:172.21.15.2:6789/0 conn(0x7f7f6015e880 legacy=0x7f7f600d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:52.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.961+0000 7f7f5de00640 1 --2- 172.21.15.2:0/1810033335 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7f440039b0 0x7f7f44003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:52.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.961+0000 7f7f5de00640 1 --2- 172.21.15.2:0/1810033335 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7f600cfe70 0x7f7f44004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:52.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.961+0000 7f7f5de00640 1 --2- 172.21.15.2:0/1810033335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f44004d40 0x7f7f440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:52.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.961+0000 7f7f5de00640 1 -- 172.21.15.2:0/1810033335 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7f6015ec60 con 0x7f7f44004d40 2024-09-10T08:46:52.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.961+0000 7f7f5de00640 1 -- 172.21.15.2:0/1810033335 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7f4400b9c0 con 0x7f7f440039b0 2024-09-10T08:46:52.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.961+0000 7f7f5de00640 1 -- 172.21.15.2:0/1810033335 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7f4400bb40 con 0x7f7f600cfe70 2024-09-10T08:46:52.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.961+0000 7f7f57e00640 1 --2- 172.21.15.2:0/1810033335 >> v2:172.21.15.155:3300/0 conn(0x7f7f600d0ef0 0x7f7f600d1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:46:52.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.961+0000 7f7f5f200640 1 --2- 172.21.15.2:0/1810033335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f44004d40 0x7f7f440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:52.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.961+0000 7f7f5e800640 1 --2- 172.21.15.2:0/1810033335 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7f440039b0 0x7f7f44003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:52.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.961+0000 7f7f57e00640 1 --2- 172.21.15.2:0/1810033335 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7f600cfe70 0x7f7f44004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:52.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.961+0000 7f7f5f200640 1 -- 172.21.15.2:0/1810033335 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7f600cfe70 msgr2=0x7f7f44004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:46:52.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.961+0000 7f7f5f200640 1 --2- 172.21.15.2:0/1810033335 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7f600cfe70 0x7f7f44004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:52.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.961+0000 7f7f5f200640 1 -- 172.21.15.2:0/1810033335 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7f440039b0 msgr2=0x7f7f44003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:46:52.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.961+0000 7f7f5f200640 1 --2- 172.21.15.2:0/1810033335 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7f440039b0 0x7f7f44003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:52.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.961+0000 7f7f5f200640 1 -- 172.21.15.2:0/1810033335 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f44003520 con 0x7f7f44004d40 2024-09-10T08:46:52.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.962+0000 7f7f5f200640 1 --2- 172.21.15.2:0/1810033335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f44004d40 0x7f7f440051c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7f5800e170 tx=0x7f7f44005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=598936461870e4ac server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:52.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.962+0000 7f7f5de00640 1 -- 172.21.15.2:0/1810033335 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f58034020 con 0x7f7f44004d40 2024-09-10T08:46:52.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.962+0000 7f7f5de00640 1 -- 172.21.15.2:0/1810033335 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f580305f0 con 0x7f7f44004d40 2024-09-10T08:46:52.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.962+0000 7f7f5de00640 1 -- 172.21.15.2:0/1810033335 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f58009c10 con 0x7f7f44004d40 2024-09-10T08:46:52.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.963+0000 7f7f65400640 1 -- 172.21.15.2:0/1810033335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f44004d40 msgr2=0x7f7f440051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:52.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.963+0000 7f7f65400640 1 --2- 172.21.15.2:0/1810033335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f44004d40 0x7f7f440051c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7f5800e170 tx=0x7f7f44005830 comp rx=0 tx=0).stop 2024-09-10T08:46:52.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.963+0000 7f7f5f200640 1 -- 172.21.15.2:0/1810033335 reap_dead start 2024-09-10T08:46:52.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.963+0000 7f7f65400640 1 -- 172.21.15.2:0/1810033335 shutdown_connections 2024-09-10T08:46:52.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.963+0000 7f7f65400640 1 -- 172.21.15.2:0/1810033335 >> 172.21.15.2:0/1810033335 conn(0x7f7f6008bfd0 msgr2=0x7f7f600d4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:46:52.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.963+0000 7f7f65400640 1 -- 172.21.15.2:0/1810033335 shutdown_connections 2024-09-10T08:46:52.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.963+0000 7f7f65400640 1 -- 172.21.15.2:0/1810033335 wait complete. 2024-09-10T08:46:52.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.965+0000 7f7f65400640 1 Processor -- start 2024-09-10T08:46:52.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.965+0000 7f7f65400640 1 -- start start 2024-09-10T08:46:52.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.966+0000 7f7f65400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f44004d40 0x7f7f600ce590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:52.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.966+0000 7f7f65400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7f600cb640 0x7f7f6015a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:52.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.966+0000 7f7f65400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7f6014dad0 0x7f7f6014df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:52.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.966+0000 7f7f65400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7f600d0300 con 0x7f7f44004d40 2024-09-10T08:46:52.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.966+0000 7f7f65400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7f600d29e0 con 0x7f7f600cb640 2024-09-10T08:46:52.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.966+0000 7f7f65400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7f600d0480 con 0x7f7f6014dad0 2024-09-10T08:46:52.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.966+0000 7f7f5e800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f44004d40 0x7f7f600ce590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:52.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.966+0000 7f7f5e800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f44004d40 0x7f7f600ce590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53600/0 (socket says 172.21.15.2:53600) 2024-09-10T08:46:52.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.966+0000 7f7f5e800640 1 -- 172.21.15.2:0/4267454293 learned_addr learned my addr 172.21.15.2:0/4267454293 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:46:52.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.966+0000 7f7f57e00640 1 --2- 172.21.15.2:0/4267454293 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7f600cb640 0x7f7f6015a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:52.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.966+0000 7f7f5f200640 1 --2- 172.21.15.2:0/4267454293 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7f6014dad0 0x7f7f6014df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:52.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.966+0000 7f7f5e800640 1 -- 172.21.15.2:0/4267454293 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7f6014dad0 msgr2=0x7f7f6014df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:52.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.966+0000 7f7f5e800640 1 --2- 172.21.15.2:0/4267454293 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7f6014dad0 0x7f7f6014df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:52.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.966+0000 7f7f5e800640 1 -- 172.21.15.2:0/4267454293 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7f600cb640 msgr2=0x7f7f6015a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:52.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.966+0000 7f7f5e800640 1 --2- 172.21.15.2:0/4267454293 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7f600cb640 0x7f7f6015a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:52.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.967+0000 7f7f5e800640 1 -- 172.21.15.2:0/4267454293 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f6014e4a0 con 0x7f7f44004d40 2024-09-10T08:46:52.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.967+0000 7f7f5f200640 1 --2- 172.21.15.2:0/4267454293 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7f6014dad0 0x7f7f6014df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:46:52.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.967+0000 7f7f5e800640 1 --2- 172.21.15.2:0/4267454293 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f44004d40 0x7f7f600ce590 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7f50007310 tx=0x7f7f500077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:52.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.967+0000 7f7f56a00640 1 -- 172.21.15.2:0/4267454293 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5000f9c0 con 0x7f7f44004d40 2024-09-10T08:46:52.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.967+0000 7f7f56a00640 1 -- 172.21.15.2:0/4267454293 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f50018070 con 0x7f7f44004d40 2024-09-10T08:46:52.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.967+0000 7f7f65400640 1 -- 172.21.15.2:0/4267454293 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f600b9cf0 con 0x7f7f44004d40 2024-09-10T08:46:52.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.967+0000 7f7f56a00640 1 -- 172.21.15.2:0/4267454293 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5000fda0 con 0x7f7f44004d40 2024-09-10T08:46:52.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.967+0000 7f7f65400640 1 -- 172.21.15.2:0/4267454293 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f600b9210 con 0x7f7f44004d40 2024-09-10T08:46:52.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.968+0000 7f7f65400640 1 -- 172.21.15.2:0/4267454293 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f600d2140 con 0x7f7f44004d40 2024-09-10T08:46:52.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.969+0000 7f7f56a00640 1 -- 172.21.15.2:0/4267454293 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7f5001d460 con 0x7f7f44004d40 2024-09-10T08:46:52.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.970+0000 7f7f56a00640 1 --2- 172.21.15.2:0/4267454293 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f7f3c06be60 0x7f7f3c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:52.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.970+0000 7f7f56a00640 1 -- 172.21.15.2:0/4267454293 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 6007+0+0 (secure 0 0 0) 0x7f7f5008b0f0 con 0x7f7f44004d40 2024-09-10T08:46:52.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.970+0000 7f7f57e00640 1 --2- 172.21.15.2:0/4267454293 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f7f3c06be60 0x7f7f3c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:52.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.971+0000 7f7f57e00640 1 --2- 172.21.15.2:0/4267454293 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f7f3c06be60 0x7f7f3c06e320 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7f48009db0 tx=0x7f7f48009110 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:52.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:52.974+0000 7f7f56a00640 1 -- 172.21.15.2:0/4267454293 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7f6014e4a0 con 0x7f7f44004d40 2024-09-10T08:46:53.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:53.158+0000 7f7f65400640 1 -- 172.21.15.2:0/4267454293 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f7f60161390 con 0x7f7f44004d40 2024-09-10T08:46:54.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:54.792+0000 7f7f56a00640 1 -- 172.21.15.2:0/4267454293 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v22) ==== 228+0+0 (secure 0 0 0) 0x7f7f500598d0 con 0x7f7f44004d40 2024-09-10T08:46:54.792 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data_ec' created 2024-09-10T08:46:54.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:54.795+0000 7f7f65400640 1 -- 172.21.15.2:0/4267454293 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f7f3c06be60 msgr2=0x7f7f3c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:54.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:54.795+0000 7f7f65400640 1 --2- 172.21.15.2:0/4267454293 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f7f3c06be60 0x7f7f3c06e320 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7f48009db0 tx=0x7f7f48009110 comp rx=0 tx=0).stop 2024-09-10T08:46:54.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:54.795+0000 7f7f65400640 1 -- 172.21.15.2:0/4267454293 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f44004d40 msgr2=0x7f7f600ce590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:54.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:54.795+0000 7f7f65400640 1 --2- 172.21.15.2:0/4267454293 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f44004d40 0x7f7f600ce590 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7f50007310 tx=0x7f7f500077d0 comp rx=0 tx=0).stop 2024-09-10T08:46:54.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:54.796+0000 7f7f65400640 1 -- 172.21.15.2:0/4267454293 shutdown_connections 2024-09-10T08:46:54.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:54.796+0000 7f7f65400640 1 --2- 172.21.15.2:0/4267454293 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f7f3c06be60 0x7f7f3c06e320 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:54.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:54.796+0000 7f7f65400640 1 --2- 172.21.15.2:0/4267454293 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7f6014dad0 0x7f7f6014df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:54.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:54.796+0000 7f7f65400640 1 --2- 172.21.15.2:0/4267454293 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7f600cb640 0x7f7f6015a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:54.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:54.796+0000 7f7f65400640 1 --2- 172.21.15.2:0/4267454293 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f44004d40 0x7f7f600ce590 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:54.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:54.796+0000 7f7f65400640 1 -- 172.21.15.2:0/4267454293 >> 172.21.15.2:0/4267454293 conn(0x7f7f6008bfd0 msgr2=0x7f7f600b30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:46:54.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:54.796+0000 7f7f65400640 1 -- 172.21.15.2:0/4267454293 shutdown_connections 2024-09-10T08:46:54.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:54.796+0000 7f7f65400640 1 -- 172.21.15.2:0/4267454293 wait complete. 2024-09-10T08:46:54.823 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-10T08:46:54.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:54.987+0000 7f4258c00640 1 Processor -- start 2024-09-10T08:46:54.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:54.987+0000 7f4258c00640 1 -- start start 2024-09-10T08:46:54.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:54.988+0000 7f4258c00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f42540d4d90 0x7f42540cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:54.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:54.988+0000 7f4258c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42540d0b50 0x7f42540d0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:54.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:54.988+0000 7f4258c00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42540d0350 con 0x7f425415e500 2024-09-10T08:46:54.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:54.988+0000 7f4258c00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f425415e8e0 con 0x7f42540d4d90 2024-09-10T08:46:54.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:54.988+0000 7f4258c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f42540d14e0 con 0x7f42540d0b50 2024-09-10T08:46:54.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:54.988+0000 7f4252a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f42540d4d90 0x7f42540cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:54.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:54.988+0000 7f4253400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f425415e500 0x7f42540d2e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:42050/0 (socket says 172.21.15.2:42050) 2024-09-10T08:46:54.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:54.989+0000 7f4253400640 1 -- 172.21.15.2:0/1519785122 learned_addr learned my addr 172.21.15.2:0/1519785122 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:46:54.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:54.989+0000 7f4253e00640 1 --2- 172.21.15.2:0/1519785122 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42540d0b50 0x7f42540d0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:54.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:54.989+0000 7f4252a00640 1 -- 172.21.15.2:0/1519785122 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42540d0b50 msgr2=0x7f42540d0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:46:54.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:54.989+0000 7f4252a00640 1 --2- 172.21.15.2:0/1519785122 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42540d0b50 0x7f42540d0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:54.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:54.989+0000 7f4252a00640 1 -- 172.21.15.2:0/1519785122 >> v1:172.21.15.2:6789/0 conn(0x7f425415e500 legacy=0x7f42540d2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:54.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:54.989+0000 7f4252a00640 1 -- 172.21.15.2:0/1519785122 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42540d2080 con 0x7f42540d4d90 2024-09-10T08:46:54.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:54.989+0000 7f4253e00640 1 --2- 172.21.15.2:0/1519785122 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42540d0b50 0x7f42540d0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:46:54.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:54.990+0000 7f4252a00640 1 --2- 172.21.15.2:0/1519785122 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42540d4d90 0x7f42540cefb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f42400097a0 tx=0x7f424002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91ad70aedcce808f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:54.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:54.990+0000 7f4252000640 1 -- 172.21.15.2:0/1519785122 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4240037070 con 0x7f42540d4d90 2024-09-10T08:46:54.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:54.990+0000 7f4252000640 1 -- 172.21.15.2:0/1519785122 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4240032440 con 0x7f42540d4d90 2024-09-10T08:46:54.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:54.990+0000 7f4252000640 1 -- 172.21.15.2:0/1519785122 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4240032810 con 0x7f42540d4d90 2024-09-10T08:46:54.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:54.991+0000 7f4258c00640 1 -- 172.21.15.2:0/1519785122 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42540d4d90 msgr2=0x7f42540cefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:54.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:54.991+0000 7f4258c00640 1 --2- 172.21.15.2:0/1519785122 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42540d4d90 0x7f42540cefb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f42400097a0 tx=0x7f424002a180 comp rx=0 tx=0).stop 2024-09-10T08:46:54.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:54.991+0000 7f4258c00640 1 -- 172.21.15.2:0/1519785122 shutdown_connections 2024-09-10T08:46:54.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:54.991+0000 7f4258c00640 1 --2- 172.21.15.2:0/1519785122 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42540d0b50 0x7f42540d0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:54.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:54.991+0000 7f4258c00640 1 --2- 172.21.15.2:0/1519785122 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42540d4d90 0x7f42540cefb0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:54.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:54.991+0000 7f4258c00640 1 -- 172.21.15.2:0/1519785122 >> 172.21.15.2:0/1519785122 conn(0x7f425409d720 msgr2=0x7f42540d4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:46:54.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:54.991+0000 7f4258c00640 1 -- 172.21.15.2:0/1519785122 shutdown_connections 2024-09-10T08:46:54.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:54.991+0000 7f4258c00640 1 -- 172.21.15.2:0/1519785122 wait complete. 2024-09-10T08:46:54.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:54.992+0000 7f4258c00640 1 Processor -- start 2024-09-10T08:46:54.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:54.993+0000 7f4258c00640 1 -- start start 2024-09-10T08:46:54.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:54.993+0000 7f4258c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42540d0b50 0x7f4254155470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:54.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:54.994+0000 7f4258c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42540d4d90 0x7f42541e8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:54.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:54.994+0000 7f4258c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f425415e500 0x7f42541e8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:54.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:54.994+0000 7f4258c00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f42540d2920 con 0x7f42540d4d90 2024-09-10T08:46:54.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:54.994+0000 7f4258c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f42540d2640 con 0x7f425415e500 2024-09-10T08:46:54.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:54.994+0000 7f4258c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f42540cff90 con 0x7f42540d0b50 2024-09-10T08:46:54.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:54.994+0000 7f4252a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42540d4d90 0x7f42541e8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:54.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:54.994+0000 7f4252a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42540d4d90 0x7f42541e8a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53610/0 (socket says 172.21.15.2:53610) 2024-09-10T08:46:54.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:54.994+0000 7f4252a00640 1 -- 172.21.15.2:0/3956786069 learned_addr learned my addr 172.21.15.2:0/3956786069 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:46:54.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:54.994+0000 7f4253400640 1 --2- 172.21.15.2:0/3956786069 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42540d0b50 0x7f4254155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:54.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:54.994+0000 7f4253e00640 1 --2- 172.21.15.2:0/3956786069 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f425415e500 0x7f42541e8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:54.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:54.994+0000 7f4252a00640 1 -- 172.21.15.2:0/3956786069 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42540d0b50 msgr2=0x7f4254155470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:54.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:54.994+0000 7f4252a00640 1 --2- 172.21.15.2:0/3956786069 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42540d0b50 0x7f4254155470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:54.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:54.994+0000 7f4252a00640 1 -- 172.21.15.2:0/3956786069 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f425415e500 msgr2=0x7f42541e8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:54.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:54.994+0000 7f4252a00640 1 --2- 172.21.15.2:0/3956786069 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f425415e500 0x7f42541e8f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:54.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:54.994+0000 7f4252a00640 1 -- 172.21.15.2:0/3956786069 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42541e6cb0 con 0x7f42540d4d90 2024-09-10T08:46:54.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:54.995+0000 7f4252a00640 1 --2- 172.21.15.2:0/3956786069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42540d4d90 0x7f42541e8a50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4240035040 tx=0x7f42400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:54.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:54.995+0000 7f424b400640 1 -- 172.21.15.2:0/3956786069 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4240037040 con 0x7f42540d4d90 2024-09-10T08:46:54.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:54.995+0000 7f424b400640 1 -- 172.21.15.2:0/3956786069 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4240030770 con 0x7f42540d4d90 2024-09-10T08:46:54.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:54.995+0000 7f4258c00640 1 -- 172.21.15.2:0/3956786069 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4254155ea0 con 0x7f42540d4d90 2024-09-10T08:46:54.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:54.995+0000 7f424b400640 1 -- 172.21.15.2:0/3956786069 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4240030b80 con 0x7f42540d4d90 2024-09-10T08:46:54.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:54.995+0000 7f4258c00640 1 -- 172.21.15.2:0/3956786069 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42540cdba0 con 0x7f42540d4d90 2024-09-10T08:46:54.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:54.996+0000 7f4258c00640 1 -- 172.21.15.2:0/3956786069 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42540d0fa0 con 0x7f42540d4d90 2024-09-10T08:46:54.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:54.997+0000 7f424b400640 1 -- 172.21.15.2:0/3956786069 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4240044020 con 0x7f42540d4d90 2024-09-10T08:46:54.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:54.998+0000 7f424b400640 1 --2- 172.21.15.2:0/3956786069 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f423406be60 0x7f423406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:54.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:54.998+0000 7f424b400640 1 -- 172.21.15.2:0/3956786069 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 6500+0+0 (secure 0 0 0) 0x7f42400ab700 con 0x7f42540d4d90 2024-09-10T08:46:54.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:54.999+0000 7f4253400640 1 --2- 172.21.15.2:0/3956786069 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f423406be60 0x7f423406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:54.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:54.999+0000 7f4253400640 1 --2- 172.21.15.2:0/3956786069 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f423406be60 0x7f423406e320 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4244007fd0 tx=0x7f4244007e80 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:55.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:55.003+0000 7f424b400640 1 -- 172.21.15.2:0/3956786069 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4254155ea0 con 0x7f42540d4d90 2024-09-10T08:46:55.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:55.186+0000 7f4258c00640 1 -- 172.21.15.2:0/3956786069 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f42540d1a20 con 0x7f42540d4d90 2024-09-10T08:46:55.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:55.798+0000 7f424b400640 1 -- 172.21.15.2:0/3956786069 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) ==== 169+0+0 (secure 0 0 0) 0x7f4240032e20 con 0x7f42540d4d90 2024-09-10T08:46:55.799 INFO:teuthology.orchestra.run.smithi002.stderr:set pool 4 allow_ec_overwrites to true 2024-09-10T08:46:55.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:55.803+0000 7f4258c00640 1 -- 172.21.15.2:0/3956786069 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f423406be60 msgr2=0x7f423406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:55.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:55.803+0000 7f4258c00640 1 --2- 172.21.15.2:0/3956786069 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f423406be60 0x7f423406e320 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4244007fd0 tx=0x7f4244007e80 comp rx=0 tx=0).stop 2024-09-10T08:46:55.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:55.803+0000 7f4258c00640 1 -- 172.21.15.2:0/3956786069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42540d4d90 msgr2=0x7f42541e8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:55.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:55.803+0000 7f4258c00640 1 --2- 172.21.15.2:0/3956786069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42540d4d90 0x7f42541e8a50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4240035040 tx=0x7f42400046c0 comp rx=0 tx=0).stop 2024-09-10T08:46:55.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:55.804+0000 7f4258c00640 1 -- 172.21.15.2:0/3956786069 shutdown_connections 2024-09-10T08:46:55.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:55.804+0000 7f4258c00640 1 --2- 172.21.15.2:0/3956786069 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f425415e500 0x7f42541e8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:55.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:55.804+0000 7f4258c00640 1 --2- 172.21.15.2:0/3956786069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f42540d4d90 0x7f42541e8a50 secure :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4240035040 tx=0x7f42400046c0 comp rx=0 tx=0).stop 2024-09-10T08:46:55.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:55.804+0000 7f4258c00640 1 --2- 172.21.15.2:0/3956786069 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f423406be60 0x7f423406e320 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:55.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:55.804+0000 7f4258c00640 1 --2- 172.21.15.2:0/3956786069 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42540d0b50 0x7f4254155470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:55.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:55.804+0000 7f4258c00640 1 -- 172.21.15.2:0/3956786069 >> 172.21.15.2:0/3956786069 conn(0x7f425409d720 msgr2=0x7f42540b8e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:46:55.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:55.805+0000 7f4258c00640 1 -- 172.21.15.2:0/3956786069 shutdown_connections 2024-09-10T08:46:55.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:55.805+0000 7f4258c00640 1 -- 172.21.15.2:0/3956786069 wait complete. 2024-09-10T08:46:55.839 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-10T08:46:56.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.004+0000 7f0bcaa00640 1 Processor -- start 2024-09-10T08:46:56.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.004+0000 7f0bcaa00640 1 -- start start 2024-09-10T08:46:56.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.005+0000 7f0bcaa00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0bc4161cb0 0x7f0bc40d0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:56.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.005+0000 7f0bcaa00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0bc40b59e0 0x7f0bc40d1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:56.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.005+0000 7f0bcaa00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bc40d0550 con 0x7f0bc4162090 2024-09-10T08:46:56.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.005+0000 7f0bcaa00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f0bc40d3090 con 0x7f0bc40b59e0 2024-09-10T08:46:56.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.005+0000 7f0bcaa00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f0bc40d2760 con 0x7f0bc4161cb0 2024-09-10T08:46:56.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.005+0000 7f0bca000640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f0bc4162090 0x7f0bc40b3bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:57952/0 (socket says 172.21.15.2:57952) 2024-09-10T08:46:56.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.005+0000 7f0bca000640 1 -- 172.21.15.2:0/1768028541 learned_addr learned my addr 172.21.15.2:0/1768028541 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:46:56.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.005+0000 7f0bc8c00640 1 --2- 172.21.15.2:0/1768028541 >> v2:172.21.15.2:3300/0 conn(0x7f0bc40b59e0 0x7f0bc40d1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:56.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.006+0000 7f0bc9600640 1 --2- 172.21.15.2:0/1768028541 >> v2:172.21.15.155:3300/0 conn(0x7f0bc4161cb0 0x7f0bc40d0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:56.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.006+0000 7f0bc8c00640 1 -- 172.21.15.2:0/1768028541 >> v2:172.21.15.155:3300/0 conn(0x7f0bc4161cb0 msgr2=0x7f0bc40d0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:46:56.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.006+0000 7f0bc8c00640 1 --2- 172.21.15.2:0/1768028541 >> v2:172.21.15.155:3300/0 conn(0x7f0bc4161cb0 0x7f0bc40d0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:56.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.006+0000 7f0bc8c00640 1 -- 172.21.15.2:0/1768028541 >> v1:172.21.15.2:6789/0 conn(0x7f0bc4162090 legacy=0x7f0bc40b3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:56.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.006+0000 7f0bc8c00640 1 -- 172.21.15.2:0/1768028541 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bc40d2a40 con 0x7f0bc40b59e0 2024-09-10T08:46:56.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.006+0000 7f0bc3e00640 1 -- 172.21.15.2:0/1768028541 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3256033300 0 0) 0x7f0bc40d0550 con 0x7f0bc4162090 2024-09-10T08:46:56.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.007+0000 7f0bc8c00640 1 --2- 172.21.15.2:0/1768028541 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bc40b59e0 0x7f0bc40d1340 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0bc408ebf0 tx=0x7f0bb002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=638cf0096593abf5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:56.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.007+0000 7f0bc3e00640 1 -- 172.21.15.2:0/1768028541 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bb0037070 con 0x7f0bc40b59e0 2024-09-10T08:46:56.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.007+0000 7f0bc3e00640 1 -- 172.21.15.2:0/1768028541 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bb0032440 con 0x7f0bc40b59e0 2024-09-10T08:46:56.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.007+0000 7f0bc3e00640 1 -- 172.21.15.2:0/1768028541 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bb0032810 con 0x7f0bc40b59e0 2024-09-10T08:46:56.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.008+0000 7f0bcaa00640 1 -- 172.21.15.2:0/1768028541 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bc40b59e0 msgr2=0x7f0bc40d1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:56.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.008+0000 7f0bcaa00640 1 --2- 172.21.15.2:0/1768028541 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bc40b59e0 0x7f0bc40d1340 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0bc408ebf0 tx=0x7f0bb002a1a0 comp rx=0 tx=0).stop 2024-09-10T08:46:56.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.008+0000 7f0bcaa00640 1 -- 172.21.15.2:0/1768028541 shutdown_connections 2024-09-10T08:46:56.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.008+0000 7f0bcaa00640 1 --2- 172.21.15.2:0/1768028541 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bc40b59e0 0x7f0bc40d1340 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:56.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.008+0000 7f0bcaa00640 1 --2- 172.21.15.2:0/1768028541 >> v2:172.21.15.155:3300/0 conn(0x7f0bc4161cb0 0x7f0bc40d0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:56.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.008+0000 7f0bcaa00640 1 -- 172.21.15.2:0/1768028541 >> 172.21.15.2:0/1768028541 conn(0x7f0bc409d700 msgr2=0x7f0bc40d4430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:46:56.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.008+0000 7f0bcaa00640 1 -- 172.21.15.2:0/1768028541 shutdown_connections 2024-09-10T08:46:56.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.008+0000 7f0bcaa00640 1 -- 172.21.15.2:0/1768028541 wait complete. 2024-09-10T08:46:56.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.009+0000 7f0bcaa00640 1 Processor -- start 2024-09-10T08:46:56.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.010+0000 7f0bcaa00640 1 -- start start 2024-09-10T08:46:56.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.010+0000 7f0bcaa00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bc40b59e0 0x7f0bc40cd290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:56.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.011+0000 7f0bcaa00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bc4161cb0 0x7f0bc415d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:56.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.011+0000 7f0bcaa00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bc4162090 0x7f0bc40b9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:56.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.011+0000 7f0bcaa00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0bc40d01d0 con 0x7f0bc4161cb0 2024-09-10T08:46:56.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.011+0000 7f0bcaa00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0bc40d0050 con 0x7f0bc40b59e0 2024-09-10T08:46:56.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.011+0000 7f0bcaa00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0bc40b3080 con 0x7f0bc4162090 2024-09-10T08:46:56.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.011+0000 7f0bc8c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bc4161cb0 0x7f0bc415d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:56.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.011+0000 7f0bc8c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bc4161cb0 0x7f0bc415d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56038/0 (socket says 172.21.15.2:56038) 2024-09-10T08:46:56.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.011+0000 7f0bc8c00640 1 -- 172.21.15.2:0/2138242686 learned_addr learned my addr 172.21.15.2:0/2138242686 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:46:56.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.011+0000 7f0bc9600640 1 --2- 172.21.15.2:0/2138242686 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bc40b59e0 0x7f0bc40cd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:56.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.011+0000 7f0bca000640 1 --2- 172.21.15.2:0/2138242686 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bc4162090 0x7f0bc40b9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:56.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.011+0000 7f0bc8c00640 1 -- 172.21.15.2:0/2138242686 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bc4162090 msgr2=0x7f0bc40b9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:56.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.011+0000 7f0bc8c00640 1 --2- 172.21.15.2:0/2138242686 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bc4162090 0x7f0bc40b9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:56.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.011+0000 7f0bc8c00640 1 -- 172.21.15.2:0/2138242686 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bc40b59e0 msgr2=0x7f0bc40cd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:56.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.011+0000 7f0bc8c00640 1 --2- 172.21.15.2:0/2138242686 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bc40b59e0 0x7f0bc40cd290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:56.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.011+0000 7f0bc8c00640 1 -- 172.21.15.2:0/2138242686 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bc40b9990 con 0x7f0bc4161cb0 2024-09-10T08:46:56.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.012+0000 7f0bc8c00640 1 --2- 172.21.15.2:0/2138242686 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bc4161cb0 0x7f0bc415d4f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0000c00 tx=0x7f0bb00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:56.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.012+0000 7f0bc1600640 1 -- 172.21.15.2:0/2138242686 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bb0037040 con 0x7f0bc4161cb0 2024-09-10T08:46:56.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.012+0000 7f0bc1600640 1 -- 172.21.15.2:0/2138242686 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bb0042070 con 0x7f0bc4161cb0 2024-09-10T08:46:56.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.012+0000 7f0bc1600640 1 -- 172.21.15.2:0/2138242686 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bb0030960 con 0x7f0bc4161cb0 2024-09-10T08:46:56.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.012+0000 7f0bcaa00640 1 -- 172.21.15.2:0/2138242686 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bc40cc7b0 con 0x7f0bc4161cb0 2024-09-10T08:46:56.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.012+0000 7f0bcaa00640 1 -- 172.21.15.2:0/2138242686 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bc40ccd70 con 0x7f0bc4161cb0 2024-09-10T08:46:56.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.013+0000 7f0bcaa00640 1 -- 172.21.15.2:0/2138242686 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bc40d0e00 con 0x7f0bc4161cb0 2024-09-10T08:46:56.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.014+0000 7f0bc1600640 1 -- 172.21.15.2:0/2138242686 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0bb0030b00 con 0x7f0bc4161cb0 2024-09-10T08:46:56.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.015+0000 7f0bc1600640 1 --2- 172.21.15.2:0/2138242686 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f0ba406be30 0x7f0ba406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:56.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.015+0000 7f0bc1600640 1 -- 172.21.15.2:0/2138242686 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6500+0+0 (secure 0 0 0) 0x7f0bb00aba30 con 0x7f0bc4161cb0 2024-09-10T08:46:56.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.016+0000 7f0bc9600640 1 --2- 172.21.15.2:0/2138242686 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f0ba406be30 0x7f0ba406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:56.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.016+0000 7f0bc9600640 1 --2- 172.21.15.2:0/2138242686 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f0ba406be30 0x7f0ba406e2f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0bb8009b40 tx=0x7f0bb8009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:56.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.020+0000 7f0bc1600640 1 -- 172.21.15.2:0/2138242686 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0bb007a1d0 con 0x7f0bc4161cb0 2024-09-10T08:46:56.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.238+0000 7f0bcaa00640 1 -- 172.21.15.2:0/2138242686 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f0bc415e100 con 0x7f0bc4161cb0 2024-09-10T08:46:56.726 INFO:tasks.ceph.mds.b.smithi155.stderr:2024-09-10T08:46:56.726+0000 7f1257c00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T08:46:56.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.800+0000 7f0bc1600640 1 -- 172.21.15.2:0/2138242686 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) ==== 137+0+0 (secure 0 0 0) 0x7f0bb0079ad0 con 0x7f0bc4161cb0 2024-09-10T08:46:56.801 INFO:teuthology.orchestra.run.smithi002.stderr:added data pool 4 to fsmap 2024-09-10T08:46:56.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.804+0000 7f0bcaa00640 1 -- 172.21.15.2:0/2138242686 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f0ba406be30 msgr2=0x7f0ba406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:56.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.804+0000 7f0bcaa00640 1 --2- 172.21.15.2:0/2138242686 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f0ba406be30 0x7f0ba406e2f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0bb8009b40 tx=0x7f0bb8009190 comp rx=0 tx=0).stop 2024-09-10T08:46:56.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.804+0000 7f0bcaa00640 1 -- 172.21.15.2:0/2138242686 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bc4161cb0 msgr2=0x7f0bc415d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:56.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.804+0000 7f0bcaa00640 1 --2- 172.21.15.2:0/2138242686 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bc4161cb0 0x7f0bc415d4f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0000c00 tx=0x7f0bb00046c0 comp rx=0 tx=0).stop 2024-09-10T08:46:56.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.804+0000 7f0bcaa00640 1 -- 172.21.15.2:0/2138242686 shutdown_connections 2024-09-10T08:46:56.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.804+0000 7f0bcaa00640 1 --2- 172.21.15.2:0/2138242686 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f0ba406be30 0x7f0ba406e2f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:56.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.804+0000 7f0bcaa00640 1 --2- 172.21.15.2:0/2138242686 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0bc4162090 0x7f0bc40b9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:56.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.804+0000 7f0bcaa00640 1 --2- 172.21.15.2:0/2138242686 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0bc4161cb0 0x7f0bc415d4f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:56.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.804+0000 7f0bcaa00640 1 --2- 172.21.15.2:0/2138242686 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0bc40b59e0 0x7f0bc40cd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:56.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.804+0000 7f0bcaa00640 1 -- 172.21.15.2:0/2138242686 >> 172.21.15.2:0/2138242686 conn(0x7f0bc409d700 msgr2=0x7f0bc406ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:46:56.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.804+0000 7f0bcaa00640 1 -- 172.21.15.2:0/2138242686 shutdown_connections 2024-09-10T08:46:56.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.804+0000 7f0bcaa00640 1 -- 172.21.15.2:0/2138242686 wait complete. 2024-09-10T08:46:56.824 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:46:56.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.983+0000 7f46ee000640 1 Processor -- start 2024-09-10T08:46:56.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.983+0000 7f46ee000640 1 -- start start 2024-09-10T08:46:56.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.984+0000 7f46ee000640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f46e80cd460 0x7f46e815c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:56.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.984+0000 7f46ee000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46e806df80 0x7f46e8160980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:56.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.984+0000 7f46ee000640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46e806e4d0 con 0x7f46e8145d20 2024-09-10T08:46:56.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.984+0000 7f46ee000640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f46e8146100 con 0x7f46e80cd460 2024-09-10T08:46:56.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.984+0000 7f46ee000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f46e8160ec0 con 0x7f46e806df80 2024-09-10T08:46:56.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.985+0000 7f46e7e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46e806df80 0x7f46e8160980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:56.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.985+0000 7f46e6a00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f46e80cd460 0x7f46e815c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:56.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.985+0000 7f46e7e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46e806df80 0x7f46e8160980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.2:56186/0 (socket says 172.21.15.2:56186) 2024-09-10T08:46:56.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.985+0000 7f46e7e00640 1 -- 172.21.15.2:0/4190315305 learned_addr learned my addr 172.21.15.2:0/4190315305 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:46:56.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.985+0000 7f46e7400640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f46e8145d20 0x7f46e80ccd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.2:38674/0 (socket says 172.21.15.2:38674) 2024-09-10T08:46:56.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.985+0000 7f46e7e00640 1 -- 172.21.15.2:0/4190315305 >> v2:172.21.15.155:3300/0 conn(0x7f46e80cd460 msgr2=0x7f46e815c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:46:56.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.985+0000 7f46e7e00640 1 --2- 172.21.15.2:0/4190315305 >> v2:172.21.15.155:3300/0 conn(0x7f46e80cd460 0x7f46e815c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:56.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.985+0000 7f46e7e00640 1 -- 172.21.15.2:0/4190315305 >> v1:172.21.15.155:6789/0 conn(0x7f46e8145d20 legacy=0x7f46e80ccd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:56.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.985+0000 7f46e7e00640 1 -- 172.21.15.2:0/4190315305 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46e806e7b0 con 0x7f46e806df80 2024-09-10T08:46:56.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.985+0000 7f46e6a00640 1 --2- 172.21.15.2:0/4190315305 >> v2:172.21.15.155:3300/0 conn(0x7f46e80cd460 0x7f46e815c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:46:56.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.986+0000 7f46e7e00640 1 --2- 172.21.15.2:0/4190315305 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46e806df80 0x7f46e8160980 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f46e0009e50 tx=0x7f46e002a5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c28f6cdba243717 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:56.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.987+0000 7f46e6000640 1 -- 172.21.15.2:0/4190315305 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e0036070 con 0x7f46e806df80 2024-09-10T08:46:56.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.987+0000 7f46e6000640 1 -- 172.21.15.2:0/4190315305 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46e0031600 con 0x7f46e806df80 2024-09-10T08:46:56.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.987+0000 7f46e6000640 1 -- 172.21.15.2:0/4190315305 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e00319d0 con 0x7f46e806df80 2024-09-10T08:46:56.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.987+0000 7f46ee000640 1 -- 172.21.15.2:0/4190315305 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46e806df80 msgr2=0x7f46e8160980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:56.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.987+0000 7f46ee000640 1 --2- 172.21.15.2:0/4190315305 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46e806df80 0x7f46e8160980 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f46e0009e50 tx=0x7f46e002a5f0 comp rx=0 tx=0).stop 2024-09-10T08:46:56.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.987+0000 7f46ee000640 1 -- 172.21.15.2:0/4190315305 shutdown_connections 2024-09-10T08:46:56.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.987+0000 7f46ee000640 1 --2- 172.21.15.2:0/4190315305 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46e806df80 0x7f46e8160980 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:56.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.987+0000 7f46ee000640 1 --2- 172.21.15.2:0/4190315305 >> v2:172.21.15.155:3300/0 conn(0x7f46e80cd460 0x7f46e815c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:56.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.987+0000 7f46ee000640 1 -- 172.21.15.2:0/4190315305 >> 172.21.15.2:0/4190315305 conn(0x7f46e806bc10 msgr2=0x7f46e806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:46:56.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.987+0000 7f46ee000640 1 -- 172.21.15.2:0/4190315305 shutdown_connections 2024-09-10T08:46:56.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.987+0000 7f46ee000640 1 -- 172.21.15.2:0/4190315305 wait complete. 2024-09-10T08:46:56.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.989+0000 7f46ee000640 1 Processor -- start 2024-09-10T08:46:56.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.989+0000 7f46ee000640 1 -- start start 2024-09-10T08:46:56.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.990+0000 7f46ee000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46e806df80 0x7f46e80aef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:56.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.990+0000 7f46ee000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46e80cd460 0x7f46e81f49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:56.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.990+0000 7f46ee000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46e8145d20 0x7f46e80b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:56.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.990+0000 7f46ee000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f46e806ed70 con 0x7f46e80cd460 2024-09-10T08:46:56.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.990+0000 7f46ee000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f46e80ce6b0 con 0x7f46e8145d20 2024-09-10T08:46:56.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.990+0000 7f46ee000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f46e80ceb40 con 0x7f46e806df80 2024-09-10T08:46:56.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.990+0000 7f46e6a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46e80cd460 0x7f46e81f49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:56.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.990+0000 7f46e6a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46e80cd460 0x7f46e81f49e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56042/0 (socket says 172.21.15.2:56042) 2024-09-10T08:46:56.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.990+0000 7f46e6a00640 1 -- 172.21.15.2:0/3863804326 learned_addr learned my addr 172.21.15.2:0/3863804326 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:46:56.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.990+0000 7f46e7400640 1 --2- 172.21.15.2:0/3863804326 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46e806df80 0x7f46e80aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:56.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.990+0000 7f46e7e00640 1 --2- 172.21.15.2:0/3863804326 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46e8145d20 0x7f46e80b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:56.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.991+0000 7f46e6a00640 1 -- 172.21.15.2:0/3863804326 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46e806df80 msgr2=0x7f46e80aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:56.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.991+0000 7f46e6a00640 1 --2- 172.21.15.2:0/3863804326 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46e806df80 0x7f46e80aef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:56.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.991+0000 7f46e6a00640 1 -- 172.21.15.2:0/3863804326 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46e8145d20 msgr2=0x7f46e80b4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:56.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.991+0000 7f46e6a00640 1 --2- 172.21.15.2:0/3863804326 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46e8145d20 0x7f46e80b4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:56.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.991+0000 7f46e6a00640 1 -- 172.21.15.2:0/3863804326 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46e80ade90 con 0x7f46e80cd460 2024-09-10T08:46:56.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.991+0000 7f46e6a00640 1 --2- 172.21.15.2:0/3863804326 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46e80cd460 0x7f46e81f49e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f46d400ebe0 tx=0x7f46d400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:56.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.991+0000 7f46df400640 1 -- 172.21.15.2:0/3863804326 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d4017070 con 0x7f46e80cd460 2024-09-10T08:46:56.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.991+0000 7f46df400640 1 -- 172.21.15.2:0/3863804326 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46d400cc30 con 0x7f46e80cd460 2024-09-10T08:46:56.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.991+0000 7f46df400640 1 -- 172.21.15.2:0/3863804326 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d4013470 con 0x7f46e80cd460 2024-09-10T08:46:56.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.991+0000 7f46ee000640 1 -- 172.21.15.2:0/3863804326 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46e80ae170 con 0x7f46e80cd460 2024-09-10T08:46:56.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.991+0000 7f46ee000640 1 -- 172.21.15.2:0/3863804326 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46e80ae730 con 0x7f46e80cd460 2024-09-10T08:46:56.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.992+0000 7f46ee000640 1 -- 172.21.15.2:0/3863804326 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46e8160980 con 0x7f46e80cd460 2024-09-10T08:46:56.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.993+0000 7f46df400640 1 -- 172.21.15.2:0/3863804326 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f46d401a070 con 0x7f46e80cd460 2024-09-10T08:46:56.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.994+0000 7f46df400640 1 --2- 172.21.15.2:0/3863804326 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f46c806be30 0x7f46c806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:56.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.994+0000 7f46df400640 1 -- 172.21.15.2:0/3863804326 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f46d408b480 con 0x7f46e80cd460 2024-09-10T08:46:56.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.995+0000 7f46e7400640 1 --2- 172.21.15.2:0/3863804326 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f46c806be30 0x7f46c806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:56.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.995+0000 7f46e7400640 1 --2- 172.21.15.2:0/3863804326 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f46c806be30 0x7f46c806e2f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f46d8007fd0 tx=0x7f46d8007e80 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:56.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:56.999+0000 7f46df400640 1 -- 172.21.15.2:0/3863804326 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f46d4059400 con 0x7f46e80cd460 2024-09-10T08:46:57.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.216+0000 7f46ee000640 1 -- 172.21.15.2:0/3863804326 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f46e80cc820 con 0x7f46e80cd460 2024-09-10T08:46:57.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.217+0000 7f46df400640 1 -- 172.21.15.2:0/3863804326 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5216 (secure 0 0 0) 0x7f46d405d700 con 0x7f46e80cd460 2024-09-10T08:46:57.218 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:46:57.218 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":7,"btime":"2024-09-10T08:46:56:799381+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/4081738683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":4081738683},{"type":"v1","addr":"172.21.15.2:6835","nonce":4081738683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1478106484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":1478106484},{"type":"v1","addr":"172.21.15.155:6837","nonce":1478106484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/800933941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":800933941},{"type":"v1","addr":"172.21.15.2:6834","nonce":800933941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:46:51.181258+0000","modified":"2024-09-10T08:46:56.240261+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6836/2996773231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2996773231},{"type":"v1","addr":"172.21.15.155:6836","nonce":2996773231}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4288,"qdb_cluster":[4288]},"id":1}]} 2024-09-10T08:46:57.218 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 7 2024-09-10T08:46:57.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.219+0000 7f46ee000640 1 -- 172.21.15.2:0/3863804326 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f46c806be30 msgr2=0x7f46c806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:57.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.219+0000 7f46ee000640 1 --2- 172.21.15.2:0/3863804326 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f46c806be30 0x7f46c806e2f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f46d8007fd0 tx=0x7f46d8007e80 comp rx=0 tx=0).stop 2024-09-10T08:46:57.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.219+0000 7f46ee000640 1 -- 172.21.15.2:0/3863804326 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46e80cd460 msgr2=0x7f46e81f49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:57.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.219+0000 7f46ee000640 1 --2- 172.21.15.2:0/3863804326 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46e80cd460 0x7f46e81f49e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f46d400ebe0 tx=0x7f46d400c520 comp rx=0 tx=0).stop 2024-09-10T08:46:57.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.219+0000 7f46ee000640 1 -- 172.21.15.2:0/3863804326 shutdown_connections 2024-09-10T08:46:57.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.219+0000 7f46ee000640 1 --2- 172.21.15.2:0/3863804326 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46e8145d20 0x7f46e80b4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:57.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.219+0000 7f46ee000640 1 --2- 172.21.15.2:0/3863804326 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46e80cd460 0x7f46e81f49e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:57.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.219+0000 7f46ee000640 1 --2- 172.21.15.2:0/3863804326 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f46c806be30 0x7f46c806e2f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:57.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.219+0000 7f46ee000640 1 --2- 172.21.15.2:0/3863804326 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46e806df80 0x7f46e80aef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:57.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.219+0000 7f46ee000640 1 -- 172.21.15.2:0/3863804326 >> 172.21.15.2:0/3863804326 conn(0x7f46e806bc10 msgr2=0x7f46e80b0000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:46:57.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.219+0000 7f46ee000640 1 -- 172.21.15.2:0/3863804326 shutdown_connections 2024-09-10T08:46:57.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.219+0000 7f46ee000640 1 -- 172.21.15.2:0/3863804326 wait complete. 2024-09-10T08:46:57.235 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:46:57.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.390+0000 7f3dbbe00640 1 Processor -- start 2024-09-10T08:46:57.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.390+0000 7f3dbbe00640 1 -- start start 2024-09-10T08:46:57.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.391+0000 7f3dbbe00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3db40d06e0 0x7f3db40b16e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:57.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.391+0000 7f3dbbe00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3db415eb60 con 0x7f3db415e780 2024-09-10T08:46:57.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.391+0000 7f3dbbe00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3db40d25b0 con 0x7f3db40b12c0 2024-09-10T08:46:57.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.391+0000 7f3dbbe00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3db40cfb40 con 0x7f3db40d06e0 2024-09-10T08:46:57.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.391+0000 7f3db9400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f3db415e780 0x7f3db40d4da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:57956/0 (socket says 172.21.15.2:57956) 2024-09-10T08:46:57.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.391+0000 7f3db9400640 1 -- 172.21.15.2:0/2305060846 learned_addr learned my addr 172.21.15.2:0/2305060846 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:46:57.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.392+0000 7f3db9e00640 1 --2- 172.21.15.2:0/2305060846 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3db40d06e0 0x7f3db40b16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:57.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.392+0000 7f3db3e00640 1 -- 172.21.15.2:0/2305060846 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2231577703 0 0) 0x7f3db415eb60 con 0x7f3db415e780 2024-09-10T08:46:57.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.392+0000 7f3db3e00640 1 -- 172.21.15.2:0/2305060846 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d9c003520 con 0x7f3db415e780 2024-09-10T08:46:57.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.392+0000 7f3db3e00640 1 -- 172.21.15.2:0/2305060846 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3265853257 0 0) 0x7f3db40d25b0 con 0x7f3db40b12c0 2024-09-10T08:46:57.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.392+0000 7f3db9e00640 1 -- 172.21.15.2:0/2305060846 >> v1:172.21.15.155:6789/0 conn(0x7f3db40b12c0 legacy=0x7f3db40cffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:57.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.392+0000 7f3db9e00640 1 -- 172.21.15.2:0/2305060846 >> v1:172.21.15.2:6789/0 conn(0x7f3db415e780 legacy=0x7f3db40d4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:57.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.392+0000 7f3db9e00640 1 -- 172.21.15.2:0/2305060846 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3db40cf4f0 con 0x7f3db40d06e0 2024-09-10T08:46:57.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.393+0000 7f3db9e00640 1 --2- 172.21.15.2:0/2305060846 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3db40d06e0 0x7f3db40b16e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3dac009dc0 tx=0x7f3dac02a640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4602e23db6c889e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:57.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.394+0000 7f3db3e00640 1 -- 172.21.15.2:0/2305060846 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dac035020 con 0x7f3db40d06e0 2024-09-10T08:46:57.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.394+0000 7f3db3e00640 1 -- 172.21.15.2:0/2305060846 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dac007540 con 0x7f3db40d06e0 2024-09-10T08:46:57.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.394+0000 7f3db3e00640 1 -- 172.21.15.2:0/2305060846 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da8001670 con 0x7f3db40d06e0 2024-09-10T08:46:57.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.394+0000 7f3dbbe00640 1 -- 172.21.15.2:0/2305060846 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3db40d06e0 msgr2=0x7f3db40b16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:57.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.394+0000 7f3dbbe00640 1 --2- 172.21.15.2:0/2305060846 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3db40d06e0 0x7f3db40b16e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3dac009dc0 tx=0x7f3dac02a640 comp rx=0 tx=0).stop 2024-09-10T08:46:57.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.394+0000 7f3dbbe00640 1 -- 172.21.15.2:0/2305060846 shutdown_connections 2024-09-10T08:46:57.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.394+0000 7f3dbbe00640 1 --2- 172.21.15.2:0/2305060846 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3db40d06e0 0x7f3db40b16e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:57.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.394+0000 7f3dbbe00640 1 -- 172.21.15.2:0/2305060846 >> 172.21.15.2:0/2305060846 conn(0x7f3db408bfd0 msgr2=0x7f3db40d4690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:46:57.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.394+0000 7f3dbbe00640 1 -- 172.21.15.2:0/2305060846 shutdown_connections 2024-09-10T08:46:57.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.394+0000 7f3dbbe00640 1 -- 172.21.15.2:0/2305060846 wait complete. 2024-09-10T08:46:57.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.396+0000 7f3dbbe00640 1 Processor -- start 2024-09-10T08:46:57.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.396+0000 7f3dbbe00640 1 -- start start 2024-09-10T08:46:57.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.397+0000 7f3dbbe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3db40b12c0 0x7f3db415c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:57.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.397+0000 7f3dbbe00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3db40d06e0 0x7f3db40b2320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:57.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.397+0000 7f3dbbe00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3db415e780 0x7f3db41519d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:57.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.397+0000 7f3dbbe00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3db40d2890 con 0x7f3db40b12c0 2024-09-10T08:46:57.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.397+0000 7f3dbbe00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3db40b39d0 con 0x7f3db415e780 2024-09-10T08:46:57.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.397+0000 7f3dbbe00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3db40d2260 con 0x7f3db40d06e0 2024-09-10T08:46:57.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.397+0000 7f3db9400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3db40b12c0 0x7f3db415c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:57.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.397+0000 7f3db9400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3db40b12c0 0x7f3db415c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56058/0 (socket says 172.21.15.2:56058) 2024-09-10T08:46:57.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.397+0000 7f3db9400640 1 -- 172.21.15.2:0/3575415645 learned_addr learned my addr 172.21.15.2:0/3575415645 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:46:57.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.397+0000 7f3db9e00640 1 --2- 172.21.15.2:0/3575415645 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3db415e780 0x7f3db41519d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:57.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.397+0000 7f3db8a00640 1 --2- 172.21.15.2:0/3575415645 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3db40d06e0 0x7f3db40b2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:57.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.398+0000 7f3db9400640 1 -- 172.21.15.2:0/3575415645 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3db40d06e0 msgr2=0x7f3db40b2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:57.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.398+0000 7f3db9400640 1 --2- 172.21.15.2:0/3575415645 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3db40d06e0 0x7f3db40b2320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:57.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.398+0000 7f3db9400640 1 -- 172.21.15.2:0/3575415645 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3db415e780 msgr2=0x7f3db41519d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:57.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.398+0000 7f3db9400640 1 --2- 172.21.15.2:0/3575415645 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3db415e780 0x7f3db41519d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:57.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.398+0000 7f3db9400640 1 -- 172.21.15.2:0/3575415645 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3db40b3bf0 con 0x7f3db40b12c0 2024-09-10T08:46:57.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.398+0000 7f3db9400640 1 --2- 172.21.15.2:0/3575415645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3db40b12c0 0x7f3db415c090 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3da800c760 tx=0x7f3da800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:57.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.398+0000 7f3db1600640 1 -- 172.21.15.2:0/3575415645 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da8018070 con 0x7f3db40b12c0 2024-09-10T08:46:57.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.398+0000 7f3db1600640 1 -- 172.21.15.2:0/3575415645 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3da80074e0 con 0x7f3db40b12c0 2024-09-10T08:46:57.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.398+0000 7f3dbbe00640 1 -- 172.21.15.2:0/3575415645 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3db40b2b40 con 0x7f3db40b12c0 2024-09-10T08:46:57.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.398+0000 7f3db1600640 1 -- 172.21.15.2:0/3575415645 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da8004a00 con 0x7f3db40b12c0 2024-09-10T08:46:57.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.398+0000 7f3dbbe00640 1 -- 172.21.15.2:0/3575415645 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3db40b4170 con 0x7f3db40b12c0 2024-09-10T08:46:57.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.399+0000 7f3dbbe00640 1 -- 172.21.15.2:0/3575415645 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3db40b16e0 con 0x7f3db40b12c0 2024-09-10T08:46:57.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.401+0000 7f3db1600640 1 -- 172.21.15.2:0/3575415645 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3da8004ba0 con 0x7f3db40b12c0 2024-09-10T08:46:57.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.402+0000 7f3db1600640 1 --2- 172.21.15.2:0/3575415645 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f3d9406be30 0x7f3d9406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:57.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.402+0000 7f3db1600640 1 -- 172.21.15.2:0/3575415645 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f3da808a7a0 con 0x7f3db40b12c0 2024-09-10T08:46:57.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.402+0000 7f3db8a00640 1 --2- 172.21.15.2:0/3575415645 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f3d9406be30 0x7f3d9406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:57.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.403+0000 7f3db8a00640 1 --2- 172.21.15.2:0/3575415645 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f3d9406be30 0x7f3d9406e2f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3db406cf00 tx=0x7f3da0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:57.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.406+0000 7f3db1600640 1 -- 172.21.15.2:0/3575415645 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3da80586a0 con 0x7f3db40b12c0 2024-09-10T08:46:57.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.594+0000 7f3dbbe00640 1 -- 172.21.15.2:0/3575415645 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3db415dce0 con 0x7f3db40b12c0 2024-09-10T08:46:57.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.595+0000 7f3db1600640 1 -- 172.21.15.2:0/3575415645 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18538 (secure 0 0 0) 0x7f3da805c9a0 con 0x7f3db40b12c0 2024-09-10T08:46:57.596 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:46:57.596 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":24,"fsid":"f20a15a7-d363-4d44-98cb-4f4f466b52b8","created":"2024-09-10T08:46:26.481619+0000","modified":"2024-09-10T08:46:56.240092+0000","last_up_change":"2024-09-10T08:46:39.323912+0000","last_in_change":"2024-09-10T08:46:29.499894+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:46:39.426180+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:46:49.214595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T08:46:50.168313+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T08:46:53.833162+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c90be333-506b-46d1-b00a-10d089a84776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6822","nonce":298678486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6823","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6826","nonce":298678486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6831","nonce":298678486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6829","nonce":298678486}]},"public_addr":"172.21.15.2:6822/298678486","cluster_addr":"172.21.15.2:6826/298678486","heartbeat_back_addr":"172.21.15.2:6831/298678486","heartbeat_front_addr":"172.21.15.2:6829/298678486","state":["exists","up"]},{"osd":1,"uuid":"3f8bdde8-6cd3-4112-8939-a876191c7368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6809","nonce":1619566025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6811","nonce":1619566025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6815","nonce":1619566025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6813","nonce":1619566025}]},"public_addr":"172.21.15.2:6809/1619566025","cluster_addr":"172.21.15.2:6811/1619566025","heartbeat_back_addr":"172.21.15.2:6815/1619566025","heartbeat_front_addr":"172.21.15.2:6813/1619566025","state":["exists","up"]},{"osd":2,"uuid":"3835f5ab-ed3a-4f46-ae6c-f0edf21708d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6801","nonce":3992427579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6803","nonce":3992427579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6807","nonce":3992427579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6805","nonce":3992427579}]},"public_addr":"172.21.15.2:6801/3992427579","cluster_addr":"172.21.15.2:6803/3992427579","heartbeat_back_addr":"172.21.15.2:6807/3992427579","heartbeat_front_addr":"172.21.15.2:6805/3992427579","state":["exists","up"]},{"osd":3,"uuid":"add6ad27-b411-4a82-9622-b0c1c1782cf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6817","nonce":1270626884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6819","nonce":1270626884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6827","nonce":1270626884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6824","nonce":1270626884}]},"public_addr":"172.21.15.2:6817/1270626884","cluster_addr":"172.21.15.2:6819/1270626884","heartbeat_back_addr":"172.21.15.2:6827/1270626884","heartbeat_front_addr":"172.21.15.2:6824/1270626884","state":["exists","up"]},{"osd":4,"uuid":"c7b642f4-8bd2-4262-9a82-ee1061cfab7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6803","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6806","nonce":553254873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6813","nonce":553254873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6822","nonce":553254873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6819","nonce":553254873}]},"public_addr":"172.21.15.155:6806/553254873","cluster_addr":"172.21.15.155:6813/553254873","heartbeat_back_addr":"172.21.15.155:6822/553254873","heartbeat_front_addr":"172.21.15.155:6819/553254873","state":["exists","up"]},{"osd":5,"uuid":"fb53289a-419f-46d8-9e3a-384ac529dc57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6805","nonce":2107688472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6811","nonce":2107688472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6823","nonce":2107688472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6817","nonce":2107688472}]},"public_addr":"172.21.15.155:6805/2107688472","cluster_addr":"172.21.15.155:6811/2107688472","heartbeat_back_addr":"172.21.15.155:6823/2107688472","heartbeat_front_addr":"172.21.15.155:6817/2107688472","state":["exists","up"]},{"osd":6,"uuid":"3f9ddd54-ede4-4565-aff6-ae1c07e7c678","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6825","nonce":944542383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6827","nonce":944542383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6831","nonce":944542383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6829","nonce":944542383}]},"public_addr":"172.21.15.155:6825/944542383","cluster_addr":"172.21.15.155:6827/944542383","heartbeat_back_addr":"172.21.15.155:6831/944542383","heartbeat_front_addr":"172.21.15.155:6829/944542383","state":["exists","up"]},{"osd":7,"uuid":"328d0681-eef4-4556-94e1-9745bd4adbe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6801","nonce":2220093913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6807","nonce":2220093913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6818","nonce":2220093913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6812","nonce":2220093913}]},"public_addr":"172.21.15.155:6801/2220093913","cluster_addr":"172.21.15.155:6807/2220093913","heartbeat_back_addr":"172.21.15.155:6818/2220093913","heartbeat_front_addr":"172.21.15.155:6812/2220093913","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.052980+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.104550+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.025661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:35.784354+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:35.863363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.322312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.100890+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:35.763584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:46:57.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.598+0000 7f3dbbe00640 1 -- 172.21.15.2:0/3575415645 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f3d9406be30 msgr2=0x7f3d9406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:57.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.598+0000 7f3dbbe00640 1 --2- 172.21.15.2:0/3575415645 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f3d9406be30 0x7f3d9406e2f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3db406cf00 tx=0x7f3da0009040 comp rx=0 tx=0).stop 2024-09-10T08:46:57.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.598+0000 7f3dbbe00640 1 -- 172.21.15.2:0/3575415645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3db40b12c0 msgr2=0x7f3db415c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:57.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.598+0000 7f3dbbe00640 1 --2- 172.21.15.2:0/3575415645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3db40b12c0 0x7f3db415c090 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3da800c760 tx=0x7f3da800cc20 comp rx=0 tx=0).stop 2024-09-10T08:46:57.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.598+0000 7f3dbbe00640 1 -- 172.21.15.2:0/3575415645 shutdown_connections 2024-09-10T08:46:57.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.598+0000 7f3dbbe00640 1 --2- 172.21.15.2:0/3575415645 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3db415e780 0x7f3db41519d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:57.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.598+0000 7f3dbbe00640 1 --2- 172.21.15.2:0/3575415645 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f3d9406be30 0x7f3d9406e2f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:57.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.598+0000 7f3dbbe00640 1 --2- 172.21.15.2:0/3575415645 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3db40d06e0 0x7f3db40b2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:57.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.598+0000 7f3dbbe00640 1 --2- 172.21.15.2:0/3575415645 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3db40b12c0 0x7f3db415c090 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:57.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.598+0000 7f3dbbe00640 1 -- 172.21.15.2:0/3575415645 >> 172.21.15.2:0/3575415645 conn(0x7f3db408bfd0 msgr2=0x7f3db40b18f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:46:57.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.598+0000 7f3dbbe00640 1 -- 172.21.15.2:0/3575415645 shutdown_connections 2024-09-10T08:46:57.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.598+0000 7f3dbbe00640 1 -- 172.21.15.2:0/3575415645 wait complete. 2024-09-10T08:46:57.614 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:46:57.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.769+0000 7f74e8400640 1 Processor -- start 2024-09-10T08:46:57.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.770+0000 7f74e8400640 1 -- start start 2024-09-10T08:46:57.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.771+0000 7f74e8400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f74e0145d20 0x7f74e015c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:57.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.771+0000 7f74e8400640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74e006e4d0 con 0x7f74e006df80 2024-09-10T08:46:57.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.771+0000 7f74e8400640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74e006e7b0 con 0x7f74e00cd460 2024-09-10T08:46:57.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.771+0000 7f74e8400640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f74e0146100 con 0x7f74e0145d20 2024-09-10T08:46:57.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.771+0000 7f74e5a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f74e0145d20 0x7f74e015c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:57.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.771+0000 7f74e5000640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f74e006df80 0x7f74e00ccd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:57968/0 (socket says 172.21.15.2:57968) 2024-09-10T08:46:57.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.771+0000 7f74e5000640 1 -- 172.21.15.2:0/3740644751 learned_addr learned my addr 172.21.15.2:0/3740644751 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:46:57.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.772+0000 7f74e5a00640 1 -- 172.21.15.2:0/3740644751 >> v1:172.21.15.155:6789/0 conn(0x7f74e00cd460 legacy=0x7f74e00ceb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:57.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.772+0000 7f74e5a00640 1 -- 172.21.15.2:0/3740644751 >> v1:172.21.15.2:6789/0 conn(0x7f74e006df80 legacy=0x7f74e00ccd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:57.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.772+0000 7f74e5a00640 1 -- 172.21.15.2:0/3740644751 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74e006ea90 con 0x7f74e0145d20 2024-09-10T08:46:57.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.772+0000 7f74dfe00640 1 -- 172.21.15.2:0/3740644751 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2354480777 0 0) 0x7f74e006e4d0 con 0x7f74e006df80 2024-09-10T08:46:57.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.773+0000 7f74e5a00640 1 --2- 172.21.15.2:0/3740644751 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74e0145d20 0x7f74e015c9e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f74d40097d0 tx=0x7f74d402a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7bbceead72f2ca6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:57.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.773+0000 7f74dfe00640 1 -- 172.21.15.2:0/3740644751 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d4037070 con 0x7f74e0145d20 2024-09-10T08:46:57.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.773+0000 7f74dfe00640 1 -- 172.21.15.2:0/3740644751 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74d402ae40 con 0x7f74e0145d20 2024-09-10T08:46:57.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.773+0000 7f74dfe00640 1 -- 172.21.15.2:0/3740644751 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d4032660 con 0x7f74e0145d20 2024-09-10T08:46:57.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.773+0000 7f74e8400640 1 -- 172.21.15.2:0/3740644751 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74e0145d20 msgr2=0x7f74e015c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:57.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.774+0000 7f74e8400640 1 --2- 172.21.15.2:0/3740644751 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74e0145d20 0x7f74e015c9e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f74d40097d0 tx=0x7f74d402a130 comp rx=0 tx=0).stop 2024-09-10T08:46:57.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.774+0000 7f74e8400640 1 -- 172.21.15.2:0/3740644751 shutdown_connections 2024-09-10T08:46:57.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.774+0000 7f74e8400640 1 --2- 172.21.15.2:0/3740644751 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74e0145d20 0x7f74e015c9e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:57.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.774+0000 7f74e8400640 1 -- 172.21.15.2:0/3740644751 >> 172.21.15.2:0/3740644751 conn(0x7f74e006bc10 msgr2=0x7f74e006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:46:57.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.774+0000 7f74e8400640 1 -- 172.21.15.2:0/3740644751 shutdown_connections 2024-09-10T08:46:57.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.774+0000 7f74e8400640 1 -- 172.21.15.2:0/3740644751 wait complete. 2024-09-10T08:46:57.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.775+0000 7f74e8400640 1 Processor -- start 2024-09-10T08:46:57.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.775+0000 7f74e8400640 1 -- start start 2024-09-10T08:46:57.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.776+0000 7f74e8400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74e006df80 0x7f74e01f5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:57.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.776+0000 7f74e8400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74e00cd460 0x7f74e01401c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:57.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.776+0000 7f74e8400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74e0145d20 0x7f74e0140700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:57.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.776+0000 7f74e8400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f74e0160980 con 0x7f74e0145d20 2024-09-10T08:46:57.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.776+0000 7f74e8400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f74e00ce6b0 con 0x7f74e006df80 2024-09-10T08:46:57.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.776+0000 7f74e8400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f74e0160b00 con 0x7f74e00cd460 2024-09-10T08:46:57.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.777+0000 7f74e6400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74e0145d20 0x7f74e0140700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:57.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.777+0000 7f74e6400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74e0145d20 0x7f74e0140700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56070/0 (socket says 172.21.15.2:56070) 2024-09-10T08:46:57.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.777+0000 7f74e6400640 1 -- 172.21.15.2:0/1590129220 learned_addr learned my addr 172.21.15.2:0/1590129220 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:46:57.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.777+0000 7f74e5a00640 1 --2- 172.21.15.2:0/1590129220 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74e006df80 0x7f74e01f5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:57.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.777+0000 7f74e5000640 1 --2- 172.21.15.2:0/1590129220 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74e00cd460 0x7f74e01401c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:57.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.777+0000 7f74e6400640 1 -- 172.21.15.2:0/1590129220 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74e00cd460 msgr2=0x7f74e01401c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:57.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.777+0000 7f74e6400640 1 --2- 172.21.15.2:0/1590129220 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74e00cd460 0x7f74e01401c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:57.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.777+0000 7f74e6400640 1 -- 172.21.15.2:0/1590129220 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74e006df80 msgr2=0x7f74e01f5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:57.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.777+0000 7f74e6400640 1 --2- 172.21.15.2:0/1590129220 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74e006df80 0x7f74e01f5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:57.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.777+0000 7f74e6400640 1 -- 172.21.15.2:0/1590129220 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74e013cb30 con 0x7f74e0145d20 2024-09-10T08:46:57.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.777+0000 7f74e6400640 1 --2- 172.21.15.2:0/1590129220 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74e0145d20 0x7f74e0140700 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f74d800c730 tx=0x7f74d800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:57.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.778+0000 7f74dd600640 1 -- 172.21.15.2:0/1590129220 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d8003b70 con 0x7f74e0145d20 2024-09-10T08:46:57.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.778+0000 7f74dd600640 1 -- 172.21.15.2:0/1590129220 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74d8003d10 con 0x7f74e0145d20 2024-09-10T08:46:57.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.778+0000 7f74dd600640 1 -- 172.21.15.2:0/1590129220 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d800aa90 con 0x7f74e0145d20 2024-09-10T08:46:57.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.778+0000 7f74e8400640 1 -- 172.21.15.2:0/1590129220 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74e013ce10 con 0x7f74e0145d20 2024-09-10T08:46:57.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.778+0000 7f74e8400640 1 -- 172.21.15.2:0/1590129220 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74e013d3d0 con 0x7f74e0145d20 2024-09-10T08:46:57.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.779+0000 7f74e8400640 1 -- 172.21.15.2:0/1590129220 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74e015c9e0 con 0x7f74e0145d20 2024-09-10T08:46:57.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.780+0000 7f74dd600640 1 -- 172.21.15.2:0/1590129220 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f74d800ac30 con 0x7f74e0145d20 2024-09-10T08:46:57.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.781+0000 7f74dd600640 1 --2- 172.21.15.2:0/1590129220 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f74c006be30 0x7f74c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:57.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.781+0000 7f74dd600640 1 -- 172.21.15.2:0/1590129220 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f74d808b040 con 0x7f74e0145d20 2024-09-10T08:46:57.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.781+0000 7f74e5a00640 1 --2- 172.21.15.2:0/1590129220 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f74c006be30 0x7f74c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:57.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.782+0000 7f74e5a00640 1 --2- 172.21.15.2:0/1590129220 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f74c006be30 0x7f74c006e2f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f74d4034000 tx=0x7f74d402e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:57.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.785+0000 7f74dd600640 1 -- 172.21.15.2:0/1590129220 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f74d8058fc0 con 0x7f74e0145d20 2024-09-10T08:46:57.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.972+0000 7f74e8400640 1 -- 172.21.15.2:0/1590129220 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f74e015deb0 con 0x7f74e0145d20 2024-09-10T08:46:57.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.973+0000 7f74dd600640 1 -- 172.21.15.2:0/1590129220 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18538 (secure 0 0 0) 0x7f74d805d2c0 con 0x7f74e0145d20 2024-09-10T08:46:57.973 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:46:57.973 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":24,"fsid":"f20a15a7-d363-4d44-98cb-4f4f466b52b8","created":"2024-09-10T08:46:26.481619+0000","modified":"2024-09-10T08:46:56.240092+0000","last_up_change":"2024-09-10T08:46:39.323912+0000","last_in_change":"2024-09-10T08:46:29.499894+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:46:39.426180+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:46:49.214595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T08:46:50.168313+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T08:46:53.833162+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c90be333-506b-46d1-b00a-10d089a84776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6822","nonce":298678486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6823","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6826","nonce":298678486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6831","nonce":298678486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6829","nonce":298678486}]},"public_addr":"172.21.15.2:6822/298678486","cluster_addr":"172.21.15.2:6826/298678486","heartbeat_back_addr":"172.21.15.2:6831/298678486","heartbeat_front_addr":"172.21.15.2:6829/298678486","state":["exists","up"]},{"osd":1,"uuid":"3f8bdde8-6cd3-4112-8939-a876191c7368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6809","nonce":1619566025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6811","nonce":1619566025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6815","nonce":1619566025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6813","nonce":1619566025}]},"public_addr":"172.21.15.2:6809/1619566025","cluster_addr":"172.21.15.2:6811/1619566025","heartbeat_back_addr":"172.21.15.2:6815/1619566025","heartbeat_front_addr":"172.21.15.2:6813/1619566025","state":["exists","up"]},{"osd":2,"uuid":"3835f5ab-ed3a-4f46-ae6c-f0edf21708d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6801","nonce":3992427579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6803","nonce":3992427579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6807","nonce":3992427579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6805","nonce":3992427579}]},"public_addr":"172.21.15.2:6801/3992427579","cluster_addr":"172.21.15.2:6803/3992427579","heartbeat_back_addr":"172.21.15.2:6807/3992427579","heartbeat_front_addr":"172.21.15.2:6805/3992427579","state":["exists","up"]},{"osd":3,"uuid":"add6ad27-b411-4a82-9622-b0c1c1782cf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6817","nonce":1270626884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6819","nonce":1270626884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6827","nonce":1270626884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6824","nonce":1270626884}]},"public_addr":"172.21.15.2:6817/1270626884","cluster_addr":"172.21.15.2:6819/1270626884","heartbeat_back_addr":"172.21.15.2:6827/1270626884","heartbeat_front_addr":"172.21.15.2:6824/1270626884","state":["exists","up"]},{"osd":4,"uuid":"c7b642f4-8bd2-4262-9a82-ee1061cfab7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6803","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6806","nonce":553254873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6813","nonce":553254873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6822","nonce":553254873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6819","nonce":553254873}]},"public_addr":"172.21.15.155:6806/553254873","cluster_addr":"172.21.15.155:6813/553254873","heartbeat_back_addr":"172.21.15.155:6822/553254873","heartbeat_front_addr":"172.21.15.155:6819/553254873","state":["exists","up"]},{"osd":5,"uuid":"fb53289a-419f-46d8-9e3a-384ac529dc57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6805","nonce":2107688472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6811","nonce":2107688472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6823","nonce":2107688472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6817","nonce":2107688472}]},"public_addr":"172.21.15.155:6805/2107688472","cluster_addr":"172.21.15.155:6811/2107688472","heartbeat_back_addr":"172.21.15.155:6823/2107688472","heartbeat_front_addr":"172.21.15.155:6817/2107688472","state":["exists","up"]},{"osd":6,"uuid":"3f9ddd54-ede4-4565-aff6-ae1c07e7c678","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6825","nonce":944542383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6827","nonce":944542383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6831","nonce":944542383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6829","nonce":944542383}]},"public_addr":"172.21.15.155:6825/944542383","cluster_addr":"172.21.15.155:6827/944542383","heartbeat_back_addr":"172.21.15.155:6831/944542383","heartbeat_front_addr":"172.21.15.155:6829/944542383","state":["exists","up"]},{"osd":7,"uuid":"328d0681-eef4-4556-94e1-9745bd4adbe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6801","nonce":2220093913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6807","nonce":2220093913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6818","nonce":2220093913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6812","nonce":2220093913}]},"public_addr":"172.21.15.155:6801/2220093913","cluster_addr":"172.21.15.155:6807/2220093913","heartbeat_back_addr":"172.21.15.155:6818/2220093913","heartbeat_front_addr":"172.21.15.155:6812/2220093913","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.052980+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.104550+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.025661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:35.784354+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:35.863363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.322312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.100890+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:35.763584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:46:57.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.975+0000 7f74e8400640 1 -- 172.21.15.2:0/1590129220 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f74c006be30 msgr2=0x7f74c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:57.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.975+0000 7f74e8400640 1 --2- 172.21.15.2:0/1590129220 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f74c006be30 0x7f74c006e2f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f74d4034000 tx=0x7f74d402e000 comp rx=0 tx=0).stop 2024-09-10T08:46:57.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.975+0000 7f74e8400640 1 -- 172.21.15.2:0/1590129220 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74e0145d20 msgr2=0x7f74e0140700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:57.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.975+0000 7f74e8400640 1 --2- 172.21.15.2:0/1590129220 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74e0145d20 0x7f74e0140700 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f74d800c730 tx=0x7f74d800cbf0 comp rx=0 tx=0).stop 2024-09-10T08:46:57.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.975+0000 7f74e8400640 1 -- 172.21.15.2:0/1590129220 shutdown_connections 2024-09-10T08:46:57.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.975+0000 7f74e8400640 1 --2- 172.21.15.2:0/1590129220 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74e0145d20 0x7f74e0140700 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:57.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.975+0000 7f74e8400640 1 --2- 172.21.15.2:0/1590129220 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f74c006be30 0x7f74c006e2f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:57.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.975+0000 7f74e8400640 1 --2- 172.21.15.2:0/1590129220 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74e00cd460 0x7f74e01401c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:57.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.975+0000 7f74e8400640 1 --2- 172.21.15.2:0/1590129220 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74e006df80 0x7f74e01f5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:57.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.975+0000 7f74e8400640 1 -- 172.21.15.2:0/1590129220 >> 172.21.15.2:0/1590129220 conn(0x7f74e006bc10 msgr2=0x7f74e00cf390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:46:57.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.975+0000 7f74e8400640 1 -- 172.21.15.2:0/1590129220 shutdown_connections 2024-09-10T08:46:57.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:57.975+0000 7f74e8400640 1 -- 172.21.15.2:0/1590129220 wait complete. 2024-09-10T08:46:58.008 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:46:58.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.166+0000 7fc94b600640 1 Processor -- start 2024-09-10T08:46:58.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.166+0000 7fc94b600640 1 -- start start 2024-09-10T08:46:58.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.168+0000 7fc94b600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc944144c90 0x7fc9440ccd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:58.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.168+0000 7fc94b600640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc9440cd2b0 0x7fc9440ce420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:58.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.168+0000 7fc94b600640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc94406f540 con 0x7fc944144250 2024-09-10T08:46:58.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.168+0000 7fc94b600640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fc94406f820 con 0x7fc9440cd2b0 2024-09-10T08:46:58.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.168+0000 7fc94b600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc94406fb00 con 0x7fc944144c90 2024-09-10T08:46:58.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.168+0000 7fc949600640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc9440cd2b0 0x7fc9440ce420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:58.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.168+0000 7fc949600640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc9440cd2b0 0x7fc9440ce420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56078/0 (socket says 172.21.15.2:56078) 2024-09-10T08:46:58.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.168+0000 7fc949600640 1 -- 172.21.15.2:0/2606462802 learned_addr learned my addr 172.21.15.2:0/2606462802 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:46:58.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.168+0000 7fc943e00640 1 --2- 172.21.15.2:0/2606462802 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc944144c90 0x7fc9440ccd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:58.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.168+0000 7fc949600640 1 -- 172.21.15.2:0/2606462802 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc944144c90 msgr2=0x7fc9440ccd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:46:58.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.168+0000 7fc949600640 1 --2- 172.21.15.2:0/2606462802 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc944144c90 0x7fc9440ccd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:58.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.168+0000 7fc949600640 1 -- 172.21.15.2:0/2606462802 >> v1:172.21.15.155:6789/0 conn(0x7fc944144250 legacy=0x7fc9440cf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:58.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.168+0000 7fc949600640 1 -- 172.21.15.2:0/2606462802 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc94406fde0 con 0x7fc9440cd2b0 2024-09-10T08:46:58.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.168+0000 7fc943400640 1 -- 172.21.15.2:0/2606462802 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1936141753 0 0) 0x7fc94406f540 con 0x7fc944144250 2024-09-10T08:46:58.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.169+0000 7fc949600640 1 --2- 172.21.15.2:0/2606462802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9440cd2b0 0x7fc9440ce420 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc93c00d150 tx=0x7fc93c02c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a56cea6c8d8f702 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:58.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.170+0000 7fc943400640 1 -- 172.21.15.2:0/2606462802 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc93c009600 con 0x7fc9440cd2b0 2024-09-10T08:46:58.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.170+0000 7fc943400640 1 -- 172.21.15.2:0/2606462802 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc93c037070 con 0x7fc9440cd2b0 2024-09-10T08:46:58.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.170+0000 7fc943400640 1 -- 172.21.15.2:0/2606462802 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc93c0099c0 con 0x7fc9440cd2b0 2024-09-10T08:46:58.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.170+0000 7fc94b600640 1 -- 172.21.15.2:0/2606462802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9440cd2b0 msgr2=0x7fc9440ce420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:58.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.170+0000 7fc94b600640 1 --2- 172.21.15.2:0/2606462802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9440cd2b0 0x7fc9440ce420 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc93c00d150 tx=0x7fc93c02c920 comp rx=0 tx=0).stop 2024-09-10T08:46:58.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.170+0000 7fc94b600640 1 -- 172.21.15.2:0/2606462802 shutdown_connections 2024-09-10T08:46:58.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.170+0000 7fc94b600640 1 --2- 172.21.15.2:0/2606462802 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc944144c90 0x7fc9440ccd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:58.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.170+0000 7fc94b600640 1 --2- 172.21.15.2:0/2606462802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9440cd2b0 0x7fc9440ce420 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:58.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.170+0000 7fc94b600640 1 -- 172.21.15.2:0/2606462802 >> 172.21.15.2:0/2606462802 conn(0x7fc94406bc10 msgr2=0x7fc94406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:46:58.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.170+0000 7fc94b600640 1 -- 172.21.15.2:0/2606462802 shutdown_connections 2024-09-10T08:46:58.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.170+0000 7fc94b600640 1 -- 172.21.15.2:0/2606462802 wait complete. 2024-09-10T08:46:58.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.172+0000 7fc94b600640 1 Processor -- start 2024-09-10T08:46:58.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.172+0000 7fc94b600640 1 -- start start 2024-09-10T08:46:58.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.173+0000 7fc94b600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9440cd2b0 0x7fc9440b2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:58.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.173+0000 7fc94b600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc944144250 0x7fc94413c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:58.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.173+0000 7fc94b600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc944144c90 0x7fc94413cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:58.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.173+0000 7fc94b600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc9440ce960 con 0x7fc9440cd2b0 2024-09-10T08:46:58.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.173+0000 7fc94b600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc9440b3390 con 0x7fc944144c90 2024-09-10T08:46:58.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.173+0000 7fc94b600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc9440ceae0 con 0x7fc944144250 2024-09-10T08:46:58.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.173+0000 7fc948c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9440cd2b0 0x7fc9440b2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:58.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.173+0000 7fc948c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9440cd2b0 0x7fc9440b2460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56084/0 (socket says 172.21.15.2:56084) 2024-09-10T08:46:58.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.173+0000 7fc948c00640 1 -- 172.21.15.2:0/3685306548 learned_addr learned my addr 172.21.15.2:0/3685306548 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:46:58.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.174+0000 7fc949600640 1 --2- 172.21.15.2:0/3685306548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc944144c90 0x7fc94413cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:58.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.174+0000 7fc943e00640 1 --2- 172.21.15.2:0/3685306548 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc944144250 0x7fc94413c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:58.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.174+0000 7fc948c00640 1 -- 172.21.15.2:0/3685306548 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc944144250 msgr2=0x7fc94413c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:58.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.174+0000 7fc948c00640 1 --2- 172.21.15.2:0/3685306548 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc944144250 0x7fc94413c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:58.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.174+0000 7fc948c00640 1 -- 172.21.15.2:0/3685306548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc944144c90 msgr2=0x7fc94413cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:58.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.174+0000 7fc948c00640 1 --2- 172.21.15.2:0/3685306548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc944144c90 0x7fc94413cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:58.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.174+0000 7fc948c00640 1 -- 172.21.15.2:0/3685306548 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9440b29a0 con 0x7fc9440cd2b0 2024-09-10T08:46:58.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.174+0000 7fc948c00640 1 --2- 172.21.15.2:0/3685306548 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9440cd2b0 0x7fc9440b2460 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc93800c460 tx=0x7fc93800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:58.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.174+0000 7fc940c00640 1 -- 172.21.15.2:0/3685306548 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc938005480 con 0x7fc9440cd2b0 2024-09-10T08:46:58.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.174+0000 7fc940c00640 1 -- 172.21.15.2:0/3685306548 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9380035f0 con 0x7fc9440cd2b0 2024-09-10T08:46:58.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.174+0000 7fc940c00640 1 -- 172.21.15.2:0/3685306548 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc938003a00 con 0x7fc9440cd2b0 2024-09-10T08:46:58.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.174+0000 7fc94b600640 1 -- 172.21.15.2:0/3685306548 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9440b13c0 con 0x7fc9440cd2b0 2024-09-10T08:46:58.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.175+0000 7fc94b600640 1 -- 172.21.15.2:0/3685306548 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9440b1980 con 0x7fc9440cd2b0 2024-09-10T08:46:58.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.176+0000 7fc94b600640 1 -- 172.21.15.2:0/3685306548 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9440ce420 con 0x7fc9440cd2b0 2024-09-10T08:46:58.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.176+0000 7fc940c00640 1 -- 172.21.15.2:0/3685306548 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc938003ba0 con 0x7fc9440cd2b0 2024-09-10T08:46:58.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.178+0000 7fc940c00640 1 --2- 172.21.15.2:0/3685306548 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fc92406c020 0x7fc92406e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:58.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.178+0000 7fc940c00640 1 -- 172.21.15.2:0/3685306548 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fc93808ae30 con 0x7fc9440cd2b0 2024-09-10T08:46:58.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.178+0000 7fc943e00640 1 --2- 172.21.15.2:0/3685306548 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fc92406c020 0x7fc92406e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:58.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.179+0000 7fc943e00640 1 --2- 172.21.15.2:0/3685306548 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fc92406c020 0x7fc92406e4e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc94413fd90 tx=0x7fc930008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:58.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.182+0000 7fc940c00640 1 -- 172.21.15.2:0/3685306548 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc938059480 con 0x7fc9440cd2b0 2024-09-10T08:46:58.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.404+0000 7fc94b600640 1 -- 172.21.15.2:0/3685306548 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc94406e4a0 con 0x7fc9440cd2b0 2024-09-10T08:46:58.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.405+0000 7fc940c00640 1 -- 172.21.15.2:0/3685306548 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5216 (secure 0 0 0) 0x7fc938058d80 con 0x7fc9440cd2b0 2024-09-10T08:46:58.405 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:46:58.405 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":7,"btime":"2024-09-10T08:46:56:799381+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/4081738683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":4081738683},{"type":"v1","addr":"172.21.15.2:6835","nonce":4081738683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1478106484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":1478106484},{"type":"v1","addr":"172.21.15.155:6837","nonce":1478106484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/800933941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":800933941},{"type":"v1","addr":"172.21.15.2:6834","nonce":800933941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:46:51.181258+0000","modified":"2024-09-10T08:46:56.240261+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6836/2996773231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2996773231},{"type":"v1","addr":"172.21.15.155:6836","nonce":2996773231}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4288,"qdb_cluster":[4288]},"id":1}]} 2024-09-10T08:46:58.406 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 7 2024-09-10T08:46:58.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.407+0000 7fc94b600640 1 -- 172.21.15.2:0/3685306548 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fc92406c020 msgr2=0x7fc92406e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:58.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.407+0000 7fc94b600640 1 --2- 172.21.15.2:0/3685306548 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fc92406c020 0x7fc92406e4e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc94413fd90 tx=0x7fc930008040 comp rx=0 tx=0).stop 2024-09-10T08:46:58.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.407+0000 7fc94b600640 1 -- 172.21.15.2:0/3685306548 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9440cd2b0 msgr2=0x7fc9440b2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:58.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.407+0000 7fc94b600640 1 --2- 172.21.15.2:0/3685306548 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9440cd2b0 0x7fc9440b2460 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc93800c460 tx=0x7fc93800c920 comp rx=0 tx=0).stop 2024-09-10T08:46:58.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.408+0000 7fc94b600640 1 -- 172.21.15.2:0/3685306548 shutdown_connections 2024-09-10T08:46:58.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.408+0000 7fc94b600640 1 --2- 172.21.15.2:0/3685306548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc944144c90 0x7fc94413cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:58.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.408+0000 7fc94b600640 1 --2- 172.21.15.2:0/3685306548 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fc92406c020 0x7fc92406e4e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:58.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.408+0000 7fc94b600640 1 --2- 172.21.15.2:0/3685306548 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc944144250 0x7fc94413c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:58.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.408+0000 7fc94b600640 1 --2- 172.21.15.2:0/3685306548 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9440cd2b0 0x7fc9440b2460 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:58.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.408+0000 7fc94b600640 1 -- 172.21.15.2:0/3685306548 >> 172.21.15.2:0/3685306548 conn(0x7fc94406bc10 msgr2=0x7fc9440b35a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:46:58.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.408+0000 7fc94b600640 1 -- 172.21.15.2:0/3685306548 shutdown_connections 2024-09-10T08:46:58.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.408+0000 7fc94b600640 1 -- 172.21.15.2:0/3685306548 wait complete. 2024-09-10T08:46:58.423 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:46:58.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.579+0000 7fe1a0a00640 1 Processor -- start 2024-09-10T08:46:58.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.579+0000 7fe1a0a00640 1 -- start start 2024-09-10T08:46:58.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.580+0000 7fe1a0a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe19c15e4c0 0x7fe19c0d2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:58.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.580+0000 7fe1a0a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe19c0b64f0 0x7fe19c0b7640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:58.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.580+0000 7fe1a0a00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe19c0d4180 con 0x7fe19c0cebc0 2024-09-10T08:46:58.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.580+0000 7fe1a0a00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fe19c0d30e0 con 0x7fe19c15e4c0 2024-09-10T08:46:58.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.580+0000 7fe1a0a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe19c0d33c0 con 0x7fe19c0b64f0 2024-09-10T08:46:58.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.580+0000 7fe19a800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe19c15e4c0 0x7fe19c0d2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:58.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.580+0000 7fe19a800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe19c15e4c0 0x7fe19c0d2890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56094/0 (socket says 172.21.15.2:56094) 2024-09-10T08:46:58.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.580+0000 7fe19a800640 1 -- 172.21.15.2:0/3894962537 learned_addr learned my addr 172.21.15.2:0/3894962537 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:46:58.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.580+0000 7fe19b200640 1 --2- 172.21.15.2:0/3894962537 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe19c0b64f0 0x7fe19c0b7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:58.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.581+0000 7fe19a800640 1 -- 172.21.15.2:0/3894962537 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe19c0b64f0 msgr2=0x7fe19c0b7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:46:58.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.581+0000 7fe19a800640 1 --2- 172.21.15.2:0/3894962537 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe19c0b64f0 0x7fe19c0b7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:58.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.581+0000 7fe19a800640 1 -- 172.21.15.2:0/3894962537 >> v1:172.21.15.155:6789/0 conn(0x7fe19c0cebc0 legacy=0x7fe19c0b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:58.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.581+0000 7fe19a800640 1 -- 172.21.15.2:0/3894962537 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe19c0d36a0 con 0x7fe19c15e4c0 2024-09-10T08:46:58.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.581+0000 7fe199400640 1 -- 172.21.15.2:0/3894962537 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2215297579 0 0) 0x7fe188001110 con 0x7fe19c0cebc0 2024-09-10T08:46:58.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.582+0000 7fe19a800640 1 --2- 172.21.15.2:0/3894962537 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe19c15e4c0 0x7fe19c0d2890 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe18c009870 tx=0x7fe18c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37de6eac78eefff8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:58.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.582+0000 7fe199400640 1 -- 172.21.15.2:0/3894962537 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe18c037070 con 0x7fe19c15e4c0 2024-09-10T08:46:58.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.582+0000 7fe199400640 1 -- 172.21.15.2:0/3894962537 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe18c032440 con 0x7fe19c15e4c0 2024-09-10T08:46:58.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.582+0000 7fe199400640 1 -- 172.21.15.2:0/3894962537 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe18c032810 con 0x7fe19c15e4c0 2024-09-10T08:46:58.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.583+0000 7fe1a0a00640 1 -- 172.21.15.2:0/3894962537 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe19c15e4c0 msgr2=0x7fe19c0d2890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:58.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.583+0000 7fe1a0a00640 1 --2- 172.21.15.2:0/3894962537 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe19c15e4c0 0x7fe19c0d2890 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe18c009870 tx=0x7fe18c02a1c0 comp rx=0 tx=0).stop 2024-09-10T08:46:58.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.583+0000 7fe1a0a00640 1 -- 172.21.15.2:0/3894962537 shutdown_connections 2024-09-10T08:46:58.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.583+0000 7fe1a0a00640 1 --2- 172.21.15.2:0/3894962537 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe19c0b64f0 0x7fe19c0b7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:58.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.583+0000 7fe1a0a00640 1 --2- 172.21.15.2:0/3894962537 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe19c15e4c0 0x7fe19c0d2890 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:58.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.583+0000 7fe1a0a00640 1 -- 172.21.15.2:0/3894962537 >> 172.21.15.2:0/3894962537 conn(0x7fe19c0d0de0 msgr2=0x7fe19c0d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:46:58.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.583+0000 7fe1a0a00640 1 -- 172.21.15.2:0/3894962537 shutdown_connections 2024-09-10T08:46:58.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.583+0000 7fe1a0a00640 1 -- 172.21.15.2:0/3894962537 wait complete. 2024-09-10T08:46:58.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.584+0000 7fe1a0a00640 1 Processor -- start 2024-09-10T08:46:58.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.585+0000 7fe1a0a00640 1 -- start start 2024-09-10T08:46:58.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.585+0000 7fe1a0a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe19c0b64f0 0x7fe19c0cd010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:58.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.585+0000 7fe1a0a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe19c0cebc0 0x7fe19c0ce2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:58.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.585+0000 7fe1a0a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe19c15e4c0 0x7fe19c154a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:58.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.585+0000 7fe1a0a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe19c0d2dd0 con 0x7fe19c0b64f0 2024-09-10T08:46:58.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.585+0000 7fe1a0a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe19c0d3c60 con 0x7fe19c15e4c0 2024-09-10T08:46:58.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.585+0000 7fe1a0a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe19c15e8a0 con 0x7fe19c0cebc0 2024-09-10T08:46:58.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.586+0000 7fe19a800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe19c0b64f0 0x7fe19c0cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:58.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.586+0000 7fe19a800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe19c0b64f0 0x7fe19c0cd010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56106/0 (socket says 172.21.15.2:56106) 2024-09-10T08:46:58.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.586+0000 7fe19a800640 1 -- 172.21.15.2:0/1326680766 learned_addr learned my addr 172.21.15.2:0/1326680766 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:46:58.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.586+0000 7fe19b200640 1 --2- 172.21.15.2:0/1326680766 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe19c15e4c0 0x7fe19c154a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:58.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.586+0000 7fe199e00640 1 --2- 172.21.15.2:0/1326680766 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe19c0cebc0 0x7fe19c0ce2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:58.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.586+0000 7fe19a800640 1 -- 172.21.15.2:0/1326680766 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe19c0cebc0 msgr2=0x7fe19c0ce2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:58.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.586+0000 7fe19a800640 1 --2- 172.21.15.2:0/1326680766 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe19c0cebc0 0x7fe19c0ce2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:58.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.586+0000 7fe19a800640 1 -- 172.21.15.2:0/1326680766 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe19c15e4c0 msgr2=0x7fe19c154a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:58.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.586+0000 7fe19a800640 1 --2- 172.21.15.2:0/1326680766 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe19c15e4c0 0x7fe19c154a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:58.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.586+0000 7fe19a800640 1 -- 172.21.15.2:0/1326680766 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe19c0cd5f0 con 0x7fe19c0b64f0 2024-09-10T08:46:58.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.586+0000 7fe199e00640 1 --2- 172.21.15.2:0/1326680766 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe19c0cebc0 0x7fe19c0ce2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:46:58.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.586+0000 7fe19a800640 1 --2- 172.21.15.2:0/1326680766 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe19c0b64f0 0x7fe19c0cd010 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe18c02a200 tx=0x7fe18c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:58.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.587+0000 7fe192a00640 1 -- 172.21.15.2:0/1326680766 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe18c037040 con 0x7fe19c0b64f0 2024-09-10T08:46:58.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.587+0000 7fe192a00640 1 -- 172.21.15.2:0/1326680766 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe18c042070 con 0x7fe19c0b64f0 2024-09-10T08:46:58.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.587+0000 7fe192a00640 1 -- 172.21.15.2:0/1326680766 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe18c030880 con 0x7fe19c0b64f0 2024-09-10T08:46:58.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.587+0000 7fe1a0a00640 1 -- 172.21.15.2:0/1326680766 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe19c0cd8d0 con 0x7fe19c0b64f0 2024-09-10T08:46:58.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.587+0000 7fe1a0a00640 1 -- 172.21.15.2:0/1326680766 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe19c158d90 con 0x7fe19c0b64f0 2024-09-10T08:46:58.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.588+0000 7fe187e00640 1 -- 172.21.15.2:0/1326680766 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe170005290 con 0x7fe19c0b64f0 2024-09-10T08:46:58.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.589+0000 7fe192a00640 1 -- 172.21.15.2:0/1326680766 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe18c02ad10 con 0x7fe19c0b64f0 2024-09-10T08:46:58.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.591+0000 7fe192a00640 1 --2- 172.21.15.2:0/1326680766 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fe17c06be30 0x7fe17c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:58.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.591+0000 7fe192a00640 1 -- 172.21.15.2:0/1326680766 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe18c0ab840 con 0x7fe19c0b64f0 2024-09-10T08:46:58.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.591+0000 7fe199e00640 1 --2- 172.21.15.2:0/1326680766 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fe17c06be30 0x7fe17c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:58.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.592+0000 7fe199e00640 1 --2- 172.21.15.2:0/1326680766 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fe17c06be30 0x7fe17c06e2f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe19c0c7d20 tx=0x7fe188009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:58.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.595+0000 7fe192a00640 1 -- 172.21.15.2:0/1326680766 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe18c079e10 con 0x7fe19c0b64f0 2024-09-10T08:46:58.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.781+0000 7fe187e00640 1 -- 172.21.15.2:0/1326680766 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe170005580 con 0x7fe19c0b64f0 2024-09-10T08:46:58.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.782+0000 7fe192a00640 1 -- 172.21.15.2:0/1326680766 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18538 (secure 0 0 0) 0x7fe18c079710 con 0x7fe19c0b64f0 2024-09-10T08:46:58.782 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:46:58.783 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":24,"fsid":"f20a15a7-d363-4d44-98cb-4f4f466b52b8","created":"2024-09-10T08:46:26.481619+0000","modified":"2024-09-10T08:46:56.240092+0000","last_up_change":"2024-09-10T08:46:39.323912+0000","last_in_change":"2024-09-10T08:46:29.499894+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:46:39.426180+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:46:49.214595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T08:46:50.168313+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T08:46:53.833162+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c90be333-506b-46d1-b00a-10d089a84776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6822","nonce":298678486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6823","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6826","nonce":298678486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6831","nonce":298678486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6829","nonce":298678486}]},"public_addr":"172.21.15.2:6822/298678486","cluster_addr":"172.21.15.2:6826/298678486","heartbeat_back_addr":"172.21.15.2:6831/298678486","heartbeat_front_addr":"172.21.15.2:6829/298678486","state":["exists","up"]},{"osd":1,"uuid":"3f8bdde8-6cd3-4112-8939-a876191c7368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6809","nonce":1619566025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6811","nonce":1619566025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6815","nonce":1619566025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6813","nonce":1619566025}]},"public_addr":"172.21.15.2:6809/1619566025","cluster_addr":"172.21.15.2:6811/1619566025","heartbeat_back_addr":"172.21.15.2:6815/1619566025","heartbeat_front_addr":"172.21.15.2:6813/1619566025","state":["exists","up"]},{"osd":2,"uuid":"3835f5ab-ed3a-4f46-ae6c-f0edf21708d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6801","nonce":3992427579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6803","nonce":3992427579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6807","nonce":3992427579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6805","nonce":3992427579}]},"public_addr":"172.21.15.2:6801/3992427579","cluster_addr":"172.21.15.2:6803/3992427579","heartbeat_back_addr":"172.21.15.2:6807/3992427579","heartbeat_front_addr":"172.21.15.2:6805/3992427579","state":["exists","up"]},{"osd":3,"uuid":"add6ad27-b411-4a82-9622-b0c1c1782cf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6817","nonce":1270626884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6819","nonce":1270626884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6827","nonce":1270626884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6824","nonce":1270626884}]},"public_addr":"172.21.15.2:6817/1270626884","cluster_addr":"172.21.15.2:6819/1270626884","heartbeat_back_addr":"172.21.15.2:6827/1270626884","heartbeat_front_addr":"172.21.15.2:6824/1270626884","state":["exists","up"]},{"osd":4,"uuid":"c7b642f4-8bd2-4262-9a82-ee1061cfab7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6803","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6806","nonce":553254873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6813","nonce":553254873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6822","nonce":553254873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6819","nonce":553254873}]},"public_addr":"172.21.15.155:6806/553254873","cluster_addr":"172.21.15.155:6813/553254873","heartbeat_back_addr":"172.21.15.155:6822/553254873","heartbeat_front_addr":"172.21.15.155:6819/553254873","state":["exists","up"]},{"osd":5,"uuid":"fb53289a-419f-46d8-9e3a-384ac529dc57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6805","nonce":2107688472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6811","nonce":2107688472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6823","nonce":2107688472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6817","nonce":2107688472}]},"public_addr":"172.21.15.155:6805/2107688472","cluster_addr":"172.21.15.155:6811/2107688472","heartbeat_back_addr":"172.21.15.155:6823/2107688472","heartbeat_front_addr":"172.21.15.155:6817/2107688472","state":["exists","up"]},{"osd":6,"uuid":"3f9ddd54-ede4-4565-aff6-ae1c07e7c678","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6825","nonce":944542383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6827","nonce":944542383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6831","nonce":944542383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6829","nonce":944542383}]},"public_addr":"172.21.15.155:6825/944542383","cluster_addr":"172.21.15.155:6827/944542383","heartbeat_back_addr":"172.21.15.155:6831/944542383","heartbeat_front_addr":"172.21.15.155:6829/944542383","state":["exists","up"]},{"osd":7,"uuid":"328d0681-eef4-4556-94e1-9745bd4adbe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6801","nonce":2220093913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6807","nonce":2220093913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6818","nonce":2220093913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6812","nonce":2220093913}]},"public_addr":"172.21.15.155:6801/2220093913","cluster_addr":"172.21.15.155:6807/2220093913","heartbeat_back_addr":"172.21.15.155:6818/2220093913","heartbeat_front_addr":"172.21.15.155:6812/2220093913","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.052980+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.104550+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.025661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:35.784354+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:35.863363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.322312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.100890+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:35.763584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:46:58.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.784+0000 7fe187e00640 1 -- 172.21.15.2:0/1326680766 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fe17c06be30 msgr2=0x7fe17c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:58.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.784+0000 7fe187e00640 1 --2- 172.21.15.2:0/1326680766 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fe17c06be30 0x7fe17c06e2f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe19c0c7d20 tx=0x7fe188009040 comp rx=0 tx=0).stop 2024-09-10T08:46:58.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.784+0000 7fe187e00640 1 -- 172.21.15.2:0/1326680766 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe19c0b64f0 msgr2=0x7fe19c0cd010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:58.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.784+0000 7fe187e00640 1 --2- 172.21.15.2:0/1326680766 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe19c0b64f0 0x7fe19c0cd010 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe18c02a200 tx=0x7fe18c0046c0 comp rx=0 tx=0).stop 2024-09-10T08:46:58.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.784+0000 7fe187e00640 1 -- 172.21.15.2:0/1326680766 shutdown_connections 2024-09-10T08:46:58.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.784+0000 7fe187e00640 1 --2- 172.21.15.2:0/1326680766 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe19c15e4c0 0x7fe19c154a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:58.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.784+0000 7fe187e00640 1 --2- 172.21.15.2:0/1326680766 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fe17c06be30 0x7fe17c06e2f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:58.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.784+0000 7fe187e00640 1 --2- 172.21.15.2:0/1326680766 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe19c0cebc0 0x7fe19c0ce2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:58.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.784+0000 7fe187e00640 1 --2- 172.21.15.2:0/1326680766 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe19c0b64f0 0x7fe19c0cd010 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:58.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.784+0000 7fe187e00640 1 -- 172.21.15.2:0/1326680766 >> 172.21.15.2:0/1326680766 conn(0x7fe19c0d0de0 msgr2=0x7fe19c15da70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:46:58.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.785+0000 7fe187e00640 1 -- 172.21.15.2:0/1326680766 shutdown_connections 2024-09-10T08:46:58.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:58.785+0000 7fe187e00640 1 -- 172.21.15.2:0/1326680766 wait complete. 2024-09-10T08:46:59.204 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T08:46:51.181258+0000', 'modified': '2024-09-10T08:46:56.240261+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4288}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4288': {'gid': 4288, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.155:6836/2996773231', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 2996773231}, {'type': 'v1', 'addr': '172.21.15.155:6836', 'nonce': 2996773231}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4288, 'qdb_cluster': [4288]} 2024-09-10T08:46:59.204 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T08:46:59.204 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-10T08:46:59.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.362+0000 7f39c7c00640 1 Processor -- start 2024-09-10T08:46:59.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.362+0000 7f39c7c00640 1 -- start start 2024-09-10T08:46:59.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.364+0000 7f39c7c00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f39c015b4c0 0x7f39c00cf6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:59.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.364+0000 7f39c7c00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f39c006f770 0x7f39c00ae150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:59.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.364+0000 7f39c7c00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39c00ad390 con 0x7f39c00af590 2024-09-10T08:46:59.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.364+0000 7f39c7c00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f39c00afa00 con 0x7f39c015b4c0 2024-09-10T08:46:59.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.364+0000 7f39c7c00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f39c00d1130 con 0x7f39c006f770 2024-09-10T08:46:59.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.364+0000 7f39c5200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f39c015b4c0 0x7f39c00cf6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:59.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.364+0000 7f39bfe00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f39c00af590 0x7f39c006f060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:57976/0 (socket says 172.21.15.2:57976) 2024-09-10T08:46:59.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.364+0000 7f39bfe00640 1 -- 172.21.15.2:0/3184427491 learned_addr learned my addr 172.21.15.2:0/3184427491 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:46:59.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.364+0000 7f39c5c00640 1 --2- 172.21.15.2:0/3184427491 >> v2:172.21.15.155:3300/0 conn(0x7f39c006f770 0x7f39c00ae150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:59.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.364+0000 7f39c5200640 1 -- 172.21.15.2:0/3184427491 >> v2:172.21.15.155:3300/0 conn(0x7f39c006f770 msgr2=0x7f39c00ae150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:46:59.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.364+0000 7f39c5200640 1 --2- 172.21.15.2:0/3184427491 >> v2:172.21.15.155:3300/0 conn(0x7f39c006f770 0x7f39c00ae150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:59.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.364+0000 7f39c5200640 1 -- 172.21.15.2:0/3184427491 >> v1:172.21.15.2:6789/0 conn(0x7f39c00af590 legacy=0x7f39c006f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:59.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.364+0000 7f39c5200640 1 -- 172.21.15.2:0/3184427491 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39c00ad670 con 0x7f39c015b4c0 2024-09-10T08:46:59.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.364+0000 7f39bf400640 1 -- 172.21.15.2:0/3184427491 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1069989941 0 0) 0x7f39c00ad390 con 0x7f39c00af590 2024-09-10T08:46:59.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.364+0000 7f39c5c00640 1 --2- 172.21.15.2:0/3184427491 >> v2:172.21.15.155:3300/0 conn(0x7f39c006f770 0x7f39c00ae150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:46:59.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.366+0000 7f39c5200640 1 --2- 172.21.15.2:0/3184427491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39c015b4c0 0x7f39c00cf6d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f39c0071e80 tx=0x7f39b402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4f7a710ea177944 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:59.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.366+0000 7f39bf400640 1 -- 172.21.15.2:0/3184427491 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b4037070 con 0x7f39c015b4c0 2024-09-10T08:46:59.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.366+0000 7f39bf400640 1 -- 172.21.15.2:0/3184427491 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39b402ae50 con 0x7f39c015b4c0 2024-09-10T08:46:59.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.366+0000 7f39bf400640 1 -- 172.21.15.2:0/3184427491 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b4032660 con 0x7f39c015b4c0 2024-09-10T08:46:59.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.366+0000 7f39c7c00640 1 -- 172.21.15.2:0/3184427491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39c015b4c0 msgr2=0x7f39c00cf6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:59.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.366+0000 7f39c7c00640 1 --2- 172.21.15.2:0/3184427491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39c015b4c0 0x7f39c00cf6d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f39c0071e80 tx=0x7f39b402a140 comp rx=0 tx=0).stop 2024-09-10T08:46:59.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.366+0000 7f39c7c00640 1 -- 172.21.15.2:0/3184427491 shutdown_connections 2024-09-10T08:46:59.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.366+0000 7f39c7c00640 1 --2- 172.21.15.2:0/3184427491 >> v2:172.21.15.155:3300/0 conn(0x7f39c006f770 0x7f39c00ae150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:59.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.366+0000 7f39c7c00640 1 --2- 172.21.15.2:0/3184427491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39c015b4c0 0x7f39c00cf6d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:59.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.366+0000 7f39c7c00640 1 -- 172.21.15.2:0/3184427491 >> 172.21.15.2:0/3184427491 conn(0x7f39c00d02c0 msgr2=0x7f39c00d06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:46:59.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.367+0000 7f39c7c00640 1 -- 172.21.15.2:0/3184427491 shutdown_connections 2024-09-10T08:46:59.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.367+0000 7f39c7c00640 1 -- 172.21.15.2:0/3184427491 wait complete. 2024-09-10T08:46:59.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.368+0000 7f39c7c00640 1 Processor -- start 2024-09-10T08:46:59.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.368+0000 7f39c7c00640 1 -- start start 2024-09-10T08:46:59.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.369+0000 7f39c7c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39c006f770 0x7f39c014c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:59.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.369+0000 7f39c7c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39c00af590 0x7f39c014b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:59.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.369+0000 7f39c7c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39c015b4c0 0x7f39c014b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:59.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.369+0000 7f39c7c00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f39c00adc30 con 0x7f39c00af590 2024-09-10T08:46:59.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.369+0000 7f39c7c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f39c00ad140 con 0x7f39c015b4c0 2024-09-10T08:46:59.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.369+0000 7f39c7c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f39c0071ef0 con 0x7f39c006f770 2024-09-10T08:46:59.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.369+0000 7f39bfe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39c00af590 0x7f39c014b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:59.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.369+0000 7f39bfe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39c00af590 0x7f39c014b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56128/0 (socket says 172.21.15.2:56128) 2024-09-10T08:46:59.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.369+0000 7f39bfe00640 1 -- 172.21.15.2:0/2224406778 learned_addr learned my addr 172.21.15.2:0/2224406778 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:46:59.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.370+0000 7f39c5c00640 1 --2- 172.21.15.2:0/2224406778 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39c015b4c0 0x7f39c014b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:59.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.370+0000 7f39c5200640 1 --2- 172.21.15.2:0/2224406778 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39c006f770 0x7f39c014c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:59.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.370+0000 7f39bfe00640 1 -- 172.21.15.2:0/2224406778 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39c006f770 msgr2=0x7f39c014c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:59.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.370+0000 7f39bfe00640 1 --2- 172.21.15.2:0/2224406778 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39c006f770 0x7f39c014c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:59.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.370+0000 7f39bfe00640 1 -- 172.21.15.2:0/2224406778 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39c015b4c0 msgr2=0x7f39c014b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:59.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.370+0000 7f39bfe00640 1 --2- 172.21.15.2:0/2224406778 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39c015b4c0 0x7f39c014b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:59.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.370+0000 7f39bfe00640 1 -- 172.21.15.2:0/2224406778 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39c0140dc0 con 0x7f39c00af590 2024-09-10T08:46:59.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.370+0000 7f39c5c00640 1 --2- 172.21.15.2:0/2224406778 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39c015b4c0 0x7f39c014b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:46:59.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.370+0000 7f39bfe00640 1 --2- 172.21.15.2:0/2224406778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39c00af590 0x7f39c014b0e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f39ac00c4d0 tx=0x7f39ac00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:59.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.370+0000 7f39bcc00640 1 -- 172.21.15.2:0/2224406778 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39ac018070 con 0x7f39c00af590 2024-09-10T08:46:59.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.370+0000 7f39bcc00640 1 -- 172.21.15.2:0/2224406778 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39ac007500 con 0x7f39c00af590 2024-09-10T08:46:59.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.370+0000 7f39c7c00640 1 -- 172.21.15.2:0/2224406778 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39c00cd840 con 0x7f39c00af590 2024-09-10T08:46:59.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.370+0000 7f39bcc00640 1 -- 172.21.15.2:0/2224406778 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39ac004a20 con 0x7f39c00af590 2024-09-10T08:46:59.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.370+0000 7f39c7c00640 1 -- 172.21.15.2:0/2224406778 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39c0149fd0 con 0x7f39c00af590 2024-09-10T08:46:59.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.372+0000 7f39bcc00640 1 -- 172.21.15.2:0/2224406778 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f39ac01b070 con 0x7f39c00af590 2024-09-10T08:46:59.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.373+0000 7f39bcc00640 1 --2- 172.21.15.2:0/2224406778 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f39a006be30 0x7f39a006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:59.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.373+0000 7f39bcc00640 1 -- 172.21.15.2:0/2224406778 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f39ac08a530 con 0x7f39c00af590 2024-09-10T08:46:59.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.374+0000 7f39c5200640 1 --2- 172.21.15.2:0/2224406778 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f39a006be30 0x7f39a006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:59.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.374+0000 7f39cabbc740 1 Processor -- start 2024-09-10T08:46:59.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.374+0000 7f39cabbc740 1 -- start start 2024-09-10T08:46:59.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.374+0000 7f39c5200640 1 --2- 172.21.15.2:0/2224406778 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f39a006be30 0x7f39a006e2f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f39b4034000 tx=0x7f39b402e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:59.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.375+0000 7f39cabbc740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5577d3273cf0 0x5577d32b9490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:59.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.375+0000 7f39cabbc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5577d32714b0 0x5577d32740d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:59.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.375+0000 7f39cabbc740 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5577d3275480 0x5577d326e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:59.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.375+0000 7f39cabbc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5577d31d23b0 con 0x5577d32714b0 2024-09-10T08:46:59.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.375+0000 7f39cabbc740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5577d31d7410 con 0x5577d3273cf0 2024-09-10T08:46:59.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.375+0000 7f39cabbc740 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x5577d317f620 con 0x5577d3275480 2024-09-10T08:46:59.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.375+0000 7f39bfe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5577d32714b0 0x5577d32740d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:59.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.375+0000 7f39bfe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5577d32714b0 0x5577d32740d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56140/0 (socket says 172.21.15.2:56140) 2024-09-10T08:46:59.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.375+0000 7f39bfe00640 1 -- 172.21.15.2:0/2426378424 learned_addr learned my addr 172.21.15.2:0/2426378424 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:46:59.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.375+0000 7f39c5200640 1 --2- 172.21.15.2:0/2426378424 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5577d3273cf0 0x5577d32b9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:59.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.375+0000 7f39c5c00640 1 --2- 172.21.15.2:0/2426378424 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5577d3275480 0x5577d326e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:59.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.375+0000 7f39bfe00640 1 -- 172.21.15.2:0/2426378424 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5577d3275480 msgr2=0x5577d326e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:46:59.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.375+0000 7f39bfe00640 1 --2- 172.21.15.2:0/2426378424 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5577d3275480 0x5577d326e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:59.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.375+0000 7f39bfe00640 1 -- 172.21.15.2:0/2426378424 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5577d3273cf0 msgr2=0x5577d32b9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:46:59.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.375+0000 7f39bfe00640 1 --2- 172.21.15.2:0/2426378424 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5577d3273cf0 0x5577d32b9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:59.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.375+0000 7f39bfe00640 1 -- 172.21.15.2:0/2426378424 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577d2eea2d0 con 0x5577d32714b0 2024-09-10T08:46:59.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.375+0000 7f39c5200640 1 --2- 172.21.15.2:0/2426378424 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5577d3273cf0 0x5577d32b9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:46:59.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.376+0000 7f39bfe00640 1 --2- 172.21.15.2:0/2426378424 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5577d32714b0 0x5577d32740d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f39ac088680 tx=0x7f39ac058490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95452bce0b6b7834 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:59.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.376+0000 7f39b1600640 1 -- 172.21.15.2:0/2426378424 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39ac061070 con 0x5577d32714b0 2024-09-10T08:46:59.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.376+0000 7f39b1600640 1 -- 172.21.15.2:0/2426378424 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39ac056790 con 0x5577d32714b0 2024-09-10T08:46:59.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.376+0000 7f39b1600640 1 -- 172.21.15.2:0/2426378424 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39ac08a0c0 con 0x5577d32714b0 2024-09-10T08:46:59.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.376+0000 7f39cabbc740 1 -- 172.21.15.2:0/2426378424 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5577d32714b0 msgr2=0x5577d32740d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:59.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.376+0000 7f39cabbc740 1 --2- 172.21.15.2:0/2426378424 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5577d32714b0 0x5577d32740d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f39ac088680 tx=0x7f39ac058490 comp rx=0 tx=0).stop 2024-09-10T08:46:59.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.376+0000 7f39cabbc740 1 -- 172.21.15.2:0/2426378424 shutdown_connections 2024-09-10T08:46:59.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.376+0000 7f39cabbc740 1 --2- 172.21.15.2:0/2426378424 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5577d3275480 0x5577d326e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:59.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.376+0000 7f39cabbc740 1 --2- 172.21.15.2:0/2426378424 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5577d32714b0 0x5577d32740d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:59.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.376+0000 7f39cabbc740 1 --2- 172.21.15.2:0/2426378424 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5577d3273cf0 0x5577d32b9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:59.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.376+0000 7f39cabbc740 1 -- 172.21.15.2:0/2426378424 >> 172.21.15.2:0/2426378424 conn(0x5577d3270740 msgr2=0x5577d32b8960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:46:59.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.377+0000 7f39cabbc740 1 -- 172.21.15.2:0/2426378424 shutdown_connections 2024-09-10T08:46:59.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.377+0000 7f39cabbc740 1 -- 172.21.15.2:0/2426378424 wait complete. 2024-09-10T08:46:59.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.377+0000 7f39cabbc740 1 -- start start 2024-09-10T08:46:59.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.378+0000 7f39cabbc740 1 Processor -- start 2024-09-10T08:46:59.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.378+0000 7f39cabbc740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5577d3273cf0 0x5577d32965b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:59.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.378+0000 7f39cabbc740 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5577d3275480 0x5577d32b2390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:59.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.378+0000 7f39cabbc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5577d3296af0 0x5577d32b28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:59.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.379+0000 7f39cabbc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5577d3192780 con 0x5577d3296af0 2024-09-10T08:46:59.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.379+0000 7f39cabbc740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5577d31d33d0 con 0x5577d3273cf0 2024-09-10T08:46:59.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.379+0000 7f39cabbc740 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x5577d326fbe0 con 0x5577d3275480 2024-09-10T08:46:59.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.379+0000 7f39cabbc740 10 client.0 _ll_register_callbacks cb 0x5577d31d05d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:46:59.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.379+0000 7f39c5c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5577d3296af0 0x5577d32b28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:59.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.379+0000 7f39c5c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5577d3296af0 0x5577d32b28d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56152/0 (socket says 172.21.15.2:56152) 2024-09-10T08:46:59.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.379+0000 7f39c5c00640 1 -- 172.21.15.2:0/3877149707 learned_addr learned my addr 172.21.15.2:0/3877149707 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:46:59.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.379+0000 7f39c5200640 1 --2- 172.21.15.2:0/3877149707 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5577d3273cf0 0x5577d32965b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:59.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.379+0000 7f39bfe00640 1 --2- 172.21.15.2:0/3877149707 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5577d3275480 0x5577d32b2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:59.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.379+0000 7f39c5c00640 1 -- 172.21.15.2:0/3877149707 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5577d3275480 msgr2=0x5577d32b2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:46:59.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.379+0000 7f39c5c00640 1 --2- 172.21.15.2:0/3877149707 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5577d3275480 0x5577d32b2390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:59.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.379+0000 7f39c5c00640 1 -- 172.21.15.2:0/3877149707 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5577d3273cf0 msgr2=0x5577d32965b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:46:59.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.379+0000 7f39c5c00640 1 --2- 172.21.15.2:0/3877149707 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5577d3273cf0 0x5577d32965b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:59.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.379+0000 7f39c5c00640 1 -- 172.21.15.2:0/3877149707 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577d2fb46b0 con 0x5577d3296af0 2024-09-10T08:46:59.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.379+0000 7f39c5c00640 1 --2- 172.21.15.2:0/3877149707 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5577d3296af0 0x5577d32b28d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f39b8004370 tx=0x7f39b8004830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73a21935dfc3aa77 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:59.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.379+0000 7f39a6000640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T08:46:59.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.380+0000 7f39a6000640 1 -- 172.21.15.2:0/3877149707 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b8019020 con 0x5577d3296af0 2024-09-10T08:46:59.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.380+0000 7f39a6000640 1 -- 172.21.15.2:0/3877149707 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f39b8007b20 con 0x5577d3296af0 2024-09-10T08:46:59.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.380+0000 7f39cabbc740 1 -- 172.21.15.2:0/3877149707 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39ac056790 con 0x5577d3296af0 2024-09-10T08:46:59.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.380+0000 7f39a6000640 1 -- 172.21.15.2:0/3877149707 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f39b8023050 con 0x5577d3296af0 2024-09-10T08:46:59.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.380+0000 7f39cabbc740 10 client.4392 fetch_fsmap learned FSMap version 7 2024-09-10T08:46:59.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.380+0000 7f39cabbc740 1 -- 172.21.15.2:0/3877149707 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x5577d3294660 con 0x5577d3296af0 2024-09-10T08:46:59.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.380+0000 7f39a6000640 1 -- 172.21.15.2:0/3877149707 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39ac056790 con 0x5577d3296af0 2024-09-10T08:46:59.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.380+0000 7f39a6000640 1 -- 172.21.15.2:0/3877149707 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 7) ==== 3510+0+0 (secure 0 0 0) 0x7f39b8026020 con 0x5577d3296af0 2024-09-10T08:46:59.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.380+0000 7f39cabbc740 10 client.4392 fetch_fsmap finished waiting for FSMap version 7 2024-09-10T08:46:59.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.380+0000 7f39cabbc740 10 client.4392 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T08:46:59.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.380+0000 7f39cabbc740 20 client.4392 populate_metadata read hostname 'smithi002' 2024-09-10T08:46:59.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.380+0000 7f39cabbc740 1 --2- 172.21.15.2:0/3877149707 >> [v2:172.21.15.155:6834/2996773231,v1:172.21.15.155:6836/2996773231] conn(0x5577d326e020 0x5577d329ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:59.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.380+0000 7f39cabbc740 4 client.4392 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:46:59.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.380+0000 7f39cabbc740 1 -- 172.21.15.2:0/3877149707 --> [v2:172.21.15.155:6834/2996773231,v1:172.21.15.155:6836/2996773231] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5577d31e4b40 con 0x5577d326e020 2024-09-10T08:46:59.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.381+0000 7f39c5200640 1 --2- 172.21.15.2:0/3877149707 >> [v2:172.21.15.155:6834/2996773231,v1:172.21.15.155:6836/2996773231] conn(0x5577d326e020 0x5577d329ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:59.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.381+0000 7f39c5200640 1 --2- 172.21.15.2:0/3877149707 >> [v2:172.21.15.155:6834/2996773231,v1:172.21.15.155:6836/2996773231] conn(0x5577d326e020 0x5577d329ddd0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57ebb637086231ae server_cookie=70edae0944c4e754 in_seq=0 out_seq=0 2024-09-10T08:46:59.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.381+0000 7f39a6000640 10 client.4392 ms_handle_connect on v2:172.21.15.155:6834/2996773231 2024-09-10T08:46:59.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.382+0000 7f39a6000640 1 -- 172.21.15.2:0/3877149707 <== mds.0 v2:172.21.15.155:6834/2996773231 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5577d31e4b40 con 0x5577d326e020 2024-09-10T08:46:59.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.383+0000 7f39a6000640 10 client.4392 handle_command_reply: tid=0 2024-09-10T08:46:59.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.383+0000 7f39cabbc740 1 client.4392 shutdown 2024-09-10T08:46:59.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.383+0000 7f39cabbc740 1 -- 172.21.15.2:0/3877149707 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5577d3296af0 msgr2=0x5577d32b28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:59.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.383+0000 7f39cabbc740 1 --2- 172.21.15.2:0/3877149707 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5577d3296af0 0x5577d32b28d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f39b8004370 tx=0x7f39b8004830 comp rx=0 tx=0).stop 2024-09-10T08:46:59.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.383+0000 7f39cabbc740 1 -- 172.21.15.2:0/3877149707 shutdown_connections 2024-09-10T08:46:59.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.383+0000 7f39cabbc740 1 --2- 172.21.15.2:0/3877149707 >> [v2:172.21.15.155:6834/2996773231,v1:172.21.15.155:6836/2996773231] conn(0x5577d326e020 0x5577d329ddd0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:59.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.383+0000 7f39cabbc740 1 --2- 172.21.15.2:0/3877149707 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5577d3296af0 0x5577d32b28d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:59.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.383+0000 7f39cabbc740 1 --2- 172.21.15.2:0/3877149707 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5577d3275480 0x5577d32b2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:59.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.383+0000 7f39cabbc740 1 --2- 172.21.15.2:0/3877149707 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5577d3273cf0 0x5577d32965b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:59.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.383+0000 7f39cabbc740 1 -- 172.21.15.2:0/3877149707 >> 172.21.15.2:0/3877149707 conn(0x5577d32714b0 msgr2=0x5577d32b7f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:46:59.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.383+0000 7f39a6000640 0 client.4392 ms_handle_reset on v2:172.21.15.155:6834/2996773231 2024-09-10T08:46:59.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.383+0000 7f39cabbc740 1 -- 172.21.15.2:0/3877149707 shutdown_connections 2024-09-10T08:46:59.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.383+0000 7f39cabbc740 1 -- 172.21.15.2:0/3877149707 wait complete. 2024-09-10T08:46:59.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.383+0000 7f39cabbc740 20 client.4392 trim_cache size 0 max 16384 2024-09-10T08:46:59.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.402+0000 7f39cabbc740 1 Processor -- start 2024-09-10T08:46:59.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.402+0000 7f39cabbc740 1 -- start start 2024-09-10T08:46:59.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.403+0000 7f39cabbc740 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5577d3273cf0 0x5577d32ba8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:59.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.403+0000 7f39cabbc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5577d3275480 0x5577d32b6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:59.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.403+0000 7f39cabbc740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5577d3296af0 0x5577d32dc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:59.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.403+0000 7f39cabbc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f39c0200ff0 con 0x5577d3275480 2024-09-10T08:46:59.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.403+0000 7f39cabbc740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f39c0169160 con 0x5577d3296af0 2024-09-10T08:46:59.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.403+0000 7f39cabbc740 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f39c02009a0 con 0x5577d3273cf0 2024-09-10T08:46:59.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.403+0000 7f39bfe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5577d3275480 0x5577d32b6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:59.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.403+0000 7f39bfe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5577d3275480 0x5577d32b6bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56164/0 (socket says 172.21.15.2:56164) 2024-09-10T08:46:59.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.403+0000 7f39bfe00640 1 -- 172.21.15.2:0/3149131269 learned_addr learned my addr 172.21.15.2:0/3149131269 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:46:59.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.403+0000 7f39c5c00640 1 --2- 172.21.15.2:0/3149131269 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5577d3296af0 0x5577d32dc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:59.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.403+0000 7f39c5200640 1 --2- 172.21.15.2:0/3149131269 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5577d3273cf0 0x5577d32ba8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:59.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.403+0000 7f39bfe00640 1 -- 172.21.15.2:0/3149131269 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5577d3273cf0 msgr2=0x5577d32ba8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:46:59.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.403+0000 7f39bfe00640 1 --2- 172.21.15.2:0/3149131269 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5577d3273cf0 0x5577d32ba8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:59.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.403+0000 7f39bfe00640 1 -- 172.21.15.2:0/3149131269 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5577d3296af0 msgr2=0x5577d32dc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:46:59.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.403+0000 7f39bfe00640 1 --2- 172.21.15.2:0/3149131269 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5577d3296af0 0x5577d32dc6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:59.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.403+0000 7f39bfe00640 1 -- 172.21.15.2:0/3149131269 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577d32c86f0 con 0x5577d3275480 2024-09-10T08:46:59.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.404+0000 7f39bfe00640 1 --2- 172.21.15.2:0/3149131269 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5577d3275480 0x5577d32b6bd0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f39ac05ca00 tx=0x7f39ac05c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81e8ea31bd2d579b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:59.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.404+0000 7f39b0c00640 1 -- 172.21.15.2:0/3149131269 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39ac056790 con 0x5577d3275480 2024-09-10T08:46:59.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.404+0000 7f39b0c00640 1 -- 172.21.15.2:0/3149131269 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39ac054b00 con 0x5577d3275480 2024-09-10T08:46:59.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.404+0000 7f39b0c00640 1 -- 172.21.15.2:0/3149131269 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39ac08a2e0 con 0x5577d3275480 2024-09-10T08:46:59.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.404+0000 7f39cabbc740 1 -- 172.21.15.2:0/3149131269 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5577d3275480 msgr2=0x5577d32b6bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:59.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.404+0000 7f39cabbc740 1 --2- 172.21.15.2:0/3149131269 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5577d3275480 0x5577d32b6bd0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f39ac05ca00 tx=0x7f39ac05c000 comp rx=0 tx=0).stop 2024-09-10T08:46:59.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.404+0000 7f39cabbc740 1 -- 172.21.15.2:0/3149131269 shutdown_connections 2024-09-10T08:46:59.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.404+0000 7f39cabbc740 1 --2- 172.21.15.2:0/3149131269 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5577d3296af0 0x5577d32dc6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:59.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.404+0000 7f39cabbc740 1 --2- 172.21.15.2:0/3149131269 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5577d3275480 0x5577d32b6bd0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:59.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.404+0000 7f39cabbc740 1 --2- 172.21.15.2:0/3149131269 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5577d3273cf0 0x5577d32ba8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:59.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.404+0000 7f39cabbc740 1 -- 172.21.15.2:0/3149131269 >> 172.21.15.2:0/3149131269 conn(0x5577d32714b0 msgr2=0x5577d32955b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:46:59.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.405+0000 7f39cabbc740 1 -- 172.21.15.2:0/3149131269 shutdown_connections 2024-09-10T08:46:59.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.405+0000 7f39cabbc740 1 -- 172.21.15.2:0/3149131269 wait complete. 2024-09-10T08:46:59.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.405+0000 7f39cabbc740 1 -- start start 2024-09-10T08:46:59.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.405+0000 7f39cabbc740 1 Processor -- start 2024-09-10T08:46:59.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.406+0000 7f39cabbc740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5577d3273cf0 0x5577d3342410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:59.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.406+0000 7f39cabbc740 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5577d3275480 0x5577d32bbb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:59.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.406+0000 7f39cabbc740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5577d3296af0 0x5577d32bc090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:59.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.406+0000 7f39cabbc740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x5577d326dea0 con 0x5577d3273cf0 2024-09-10T08:46:59.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.406+0000 7f39cabbc740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5577d329e790 con 0x5577d3296af0 2024-09-10T08:46:59.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.406+0000 7f39cabbc740 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x5577d326e4f0 con 0x5577d3275480 2024-09-10T08:46:59.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.406+0000 7f39cabbc740 10 client.0 _ll_register_callbacks cb 0x7f39b8003c10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:46:59.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.406+0000 7f39c5200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5577d3273cf0 0x5577d3342410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:59.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.407+0000 7f39c5200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5577d3273cf0 0x5577d3342410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56176/0 (socket says 172.21.15.2:56176) 2024-09-10T08:46:59.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.407+0000 7f39c5200640 1 -- 172.21.15.2:0/3465108584 learned_addr learned my addr 172.21.15.2:0/3465108584 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:46:59.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.407+0000 7f39c5200640 1 -- 172.21.15.2:0/3465108584 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5577d3275480 msgr2=0x5577d32bbb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:46:59.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.407+0000 7f39bfe00640 1 --2- 172.21.15.2:0/3465108584 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5577d3275480 0x5577d32bbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:59.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.407+0000 7f39c5c00640 1 --2- 172.21.15.2:0/3465108584 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5577d3296af0 0x5577d32bc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:59.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.407+0000 7f39c5200640 1 --2- 172.21.15.2:0/3465108584 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5577d3275480 0x5577d32bbb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:59.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.407+0000 7f39c5200640 1 -- 172.21.15.2:0/3465108584 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5577d3296af0 msgr2=0x5577d32bc090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:46:59.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.407+0000 7f39c5200640 1 --2- 172.21.15.2:0/3465108584 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5577d3296af0 0x5577d32bc090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:59.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.407+0000 7f39c5200640 1 -- 172.21.15.2:0/3465108584 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577d32db460 con 0x5577d3273cf0 2024-09-10T08:46:59.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.407+0000 7f39bfe00640 1 --2- 172.21.15.2:0/3465108584 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5577d3275480 0x5577d32bbb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:46:59.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.407+0000 7f39c5c00640 1 --2- 172.21.15.2:0/3465108584 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5577d3296af0 0x5577d32bc090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:46:59.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.407+0000 7f39c5200640 1 --2- 172.21.15.2:0/3465108584 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5577d3273cf0 0x5577d3342410 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f39b402a730 tx=0x7f39b402c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7de92bb436c5c913 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:59.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.407+0000 7f39a6000640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T08:46:59.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.407+0000 7f39a6000640 1 -- 172.21.15.2:0/3465108584 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b4037040 con 0x5577d3273cf0 2024-09-10T08:46:59.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.407+0000 7f39a6000640 1 -- 172.21.15.2:0/3465108584 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f39b403e720 con 0x5577d3273cf0 2024-09-10T08:46:59.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.407+0000 7f39cabbc740 1 -- 172.21.15.2:0/3465108584 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39ac054b00 con 0x5577d3273cf0 2024-09-10T08:46:59.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.408+0000 7f39a6000640 1 -- 172.21.15.2:0/3465108584 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f39b405c050 con 0x5577d3273cf0 2024-09-10T08:46:59.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.408+0000 7f39cabbc740 10 client.4398 fetch_fsmap learned FSMap version 7 2024-09-10T08:46:59.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.408+0000 7f39cabbc740 1 -- 172.21.15.2:0/3465108584 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x5577d32db670 con 0x5577d3273cf0 2024-09-10T08:46:59.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.408+0000 7f39a6000640 1 -- 172.21.15.2:0/3465108584 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39ac054b00 con 0x5577d3273cf0 2024-09-10T08:46:59.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.408+0000 7f39a6000640 1 -- 172.21.15.2:0/3465108584 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 7) ==== 3510+0+0 (secure 0 0 0) 0x7f39b405f020 con 0x5577d3273cf0 2024-09-10T08:46:59.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.408+0000 7f39cabbc740 10 client.4398 fetch_fsmap finished waiting for FSMap version 7 2024-09-10T08:46:59.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.408+0000 7f39cabbc740 10 client.4398 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T08:46:59.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.408+0000 7f39cabbc740 20 client.4398 populate_metadata read hostname 'smithi002' 2024-09-10T08:46:59.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.408+0000 7f39cabbc740 1 --2- 172.21.15.2:0/3465108584 >> [v2:172.21.15.155:6834/2996773231,v1:172.21.15.155:6836/2996773231] conn(0x5577d32b8be0 0x5577d329b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:59.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.408+0000 7f39cabbc740 4 client.4398 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T08:46:59.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.408+0000 7f39cabbc740 1 -- 172.21.15.2:0/3465108584 --> [v2:172.21.15.155:6834/2996773231,v1:172.21.15.155:6836/2996773231] -- command(tid 0: {"prefix": "status"}) -- 0x5577d32b7d00 con 0x5577d32b8be0 2024-09-10T08:46:59.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.409+0000 7f39bfe00640 1 --2- 172.21.15.2:0/3465108584 >> [v2:172.21.15.155:6834/2996773231,v1:172.21.15.155:6836/2996773231] conn(0x5577d32b8be0 0x5577d329b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:59.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.409+0000 7f39bfe00640 1 --2- 172.21.15.2:0/3465108584 >> [v2:172.21.15.155:6834/2996773231,v1:172.21.15.155:6836/2996773231] conn(0x5577d32b8be0 0x5577d329b930 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=650e03bc61f7f83e server_cookie=bc93176c4784197c in_seq=0 out_seq=0 2024-09-10T08:46:59.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.409+0000 7f39a6000640 10 client.4398 ms_handle_connect on v2:172.21.15.155:6834/2996773231 2024-09-10T08:46:59.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.409+0000 7f39a6000640 1 -- 172.21.15.2:0/3465108584 <== mds.0 v2:172.21.15.155:6834/2996773231 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x5577d32b7d00 con 0x5577d32b8be0 2024-09-10T08:46:59.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.409+0000 7f39a6000640 10 client.4398 handle_command_reply: tid=0 2024-09-10T08:46:59.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.409+0000 7f39cabbc740 1 client.4398 shutdown 2024-09-10T08:46:59.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.409+0000 7f39cabbc740 1 -- 172.21.15.2:0/3465108584 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5577d3273cf0 msgr2=0x5577d3342410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:59.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.409+0000 7f39cabbc740 1 --2- 172.21.15.2:0/3465108584 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5577d3273cf0 0x5577d3342410 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f39b402a730 tx=0x7f39b402c070 comp rx=0 tx=0).stop 2024-09-10T08:46:59.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.410+0000 7f39cabbc740 1 -- 172.21.15.2:0/3465108584 shutdown_connections 2024-09-10T08:46:59.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.410+0000 7f39cabbc740 1 --2- 172.21.15.2:0/3465108584 >> [v2:172.21.15.155:6834/2996773231,v1:172.21.15.155:6836/2996773231] conn(0x5577d32b8be0 0x5577d329b930 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:59.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.410+0000 7f39cabbc740 1 --2- 172.21.15.2:0/3465108584 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5577d3296af0 0x5577d32bc090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:59.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.410+0000 7f39cabbc740 1 --2- 172.21.15.2:0/3465108584 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x5577d3275480 0x5577d32bbb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:59.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.410+0000 7f39a6000640 0 client.4398 ms_handle_reset on v2:172.21.15.155:6834/2996773231 2024-09-10T08:46:59.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.410+0000 7f39cabbc740 1 --2- 172.21.15.2:0/3465108584 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x5577d3273cf0 0x5577d3342410 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:59.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.410+0000 7f39cabbc740 1 -- 172.21.15.2:0/3465108584 >> 172.21.15.2:0/3465108584 conn(0x5577d32714b0 msgr2=0x5577d32ba550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:46:59.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.410+0000 7f39cabbc740 1 -- 172.21.15.2:0/3465108584 shutdown_connections 2024-09-10T08:46:59.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.410+0000 7f39cabbc740 1 -- 172.21.15.2:0/3465108584 wait complete. 2024-09-10T08:46:59.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.410+0000 7f39cabbc740 20 client.4398 trim_cache size 0 max 16384 2024-09-10T08:46:59.415 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T08:46:59.415 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "f20a15a7-d363-4d44-98cb-4f4f466b52b8", 2024-09-10T08:46:59.415 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 0, 2024-09-10T08:46:59.415 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 4288, 2024-09-10T08:46:59.415 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2024-09-10T08:46:59.415 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2024-09-10T08:46:59.415 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2024-09-10T08:46:59.415 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 7.6444119129999999, 2024-09-10T08:46:59.415 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 7, 2024-09-10T08:46:59.415 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 24, 2024-09-10T08:46:59.416 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 23, 2024-09-10T08:46:59.416 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 13.687133979 2024-09-10T08:46:59.416 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T08:46:59.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.410+0000 7f39c7c00640 1 -- 172.21.15.2:0/2224406778 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f39a006be30 msgr2=0x7f39a006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:59.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.410+0000 7f39c7c00640 1 --2- 172.21.15.2:0/2224406778 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f39a006be30 0x7f39a006e2f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f39b4034000 tx=0x7f39b402e000 comp rx=0 tx=0).stop 2024-09-10T08:46:59.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.410+0000 7f39c7c00640 1 -- 172.21.15.2:0/2224406778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39c00af590 msgr2=0x7f39c014b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:59.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.410+0000 7f39c7c00640 1 --2- 172.21.15.2:0/2224406778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39c00af590 0x7f39c014b0e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f39ac00c4d0 tx=0x7f39ac00c990 comp rx=0 tx=0).stop 2024-09-10T08:46:59.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.411+0000 7f39c7c00640 1 -- 172.21.15.2:0/2224406778 shutdown_connections 2024-09-10T08:46:59.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.411+0000 7f39c7c00640 1 --2- 172.21.15.2:0/2224406778 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39c015b4c0 0x7f39c014b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:59.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.411+0000 7f39c7c00640 1 --2- 172.21.15.2:0/2224406778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39c00af590 0x7f39c014b0e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:59.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.411+0000 7f39c7c00640 1 --2- 172.21.15.2:0/2224406778 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f39a006be30 0x7f39a006e2f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:59.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.411+0000 7f39c7c00640 1 --2- 172.21.15.2:0/2224406778 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39c006f770 0x7f39c014c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:59.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.411+0000 7f39c7c00640 1 -- 172.21.15.2:0/2224406778 >> 172.21.15.2:0/2224406778 conn(0x7f39c00d02c0 msgr2=0x7f39c01493c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:46:59.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.411+0000 7f39c7c00640 1 -- 172.21.15.2:0/2224406778 shutdown_connections 2024-09-10T08:46:59.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.411+0000 7f39c7c00640 1 -- 172.21.15.2:0/2224406778 wait complete. 2024-09-10T08:46:59.426 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-10T08:46:59.426 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-10T08:46:59.426 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T08:46:59.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.582+0000 7ff189c00640 1 Processor -- start 2024-09-10T08:46:59.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.582+0000 7ff189c00640 1 -- start start 2024-09-10T08:46:59.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.583+0000 7ff189c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1840b4e00 0x7ff184169110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:59.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.583+0000 7ff189c00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1840d3340 con 0x7ff18415e4d0 2024-09-10T08:46:59.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.583+0000 7ff189c00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1840cf780 con 0x7ff1840d2ed0 2024-09-10T08:46:59.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.583+0000 7ff189c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff1840cfa60 con 0x7ff1840b4e00 2024-09-10T08:46:59.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.583+0000 7ff183e00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ff18415e4d0 0x7ff1840cef10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:57980/0 (socket says 172.21.15.2:57980) 2024-09-10T08:46:59.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.583+0000 7ff183e00640 1 -- 172.21.15.2:0/1118705163 learned_addr learned my addr 172.21.15.2:0/1118705163 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:46:59.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.583+0000 7ff189200640 1 --2- 172.21.15.2:0/1118705163 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1840b4e00 0x7ff184169110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:59.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.584+0000 7ff183400640 1 -- 172.21.15.2:0/1118705163 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2142275157 0 0) 0x7ff1840d3340 con 0x7ff18415e4d0 2024-09-10T08:46:59.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.584+0000 7ff183400640 1 -- 172.21.15.2:0/1118705163 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff168003520 con 0x7ff18415e4d0 2024-09-10T08:46:59.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.584+0000 7ff183400640 1 -- 172.21.15.2:0/1118705163 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3521686279 0 0) 0x7ff1840cf780 con 0x7ff1840d2ed0 2024-09-10T08:46:59.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.584+0000 7ff183400640 1 -- 172.21.15.2:0/1118705163 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff1840d3340 con 0x7ff1840d2ed0 2024-09-10T08:46:59.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.584+0000 7ff189200640 1 -- 172.21.15.2:0/1118705163 >> v1:172.21.15.155:6789/0 conn(0x7ff1840d2ed0 legacy=0x7ff1840d4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:59.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.584+0000 7ff189200640 1 -- 172.21.15.2:0/1118705163 >> v1:172.21.15.2:6789/0 conn(0x7ff18415e4d0 legacy=0x7ff1840cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:59.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.584+0000 7ff183400640 1 -- 172.21.15.2:0/1118705163 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1198765968 0 0) 0x7ff168003520 con 0x7ff18415e4d0 2024-09-10T08:46:59.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.584+0000 7ff189200640 1 -- 172.21.15.2:0/1118705163 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1840cfd40 con 0x7ff1840b4e00 2024-09-10T08:46:59.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.585+0000 7ff189200640 1 --2- 172.21.15.2:0/1118705163 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1840b4e00 0x7ff184169110 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff17c009dc0 tx=0x7ff17c02a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa898e7fafb12b79 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:59.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.585+0000 7ff183400640 1 -- 172.21.15.2:0/1118705163 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff174001670 con 0x7ff1840b4e00 2024-09-10T08:46:59.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.585+0000 7ff183400640 1 -- 172.21.15.2:0/1118705163 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff17c007540 con 0x7ff1840b4e00 2024-09-10T08:46:59.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.585+0000 7ff183400640 1 -- 172.21.15.2:0/1118705163 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff17c007910 con 0x7ff1840b4e00 2024-09-10T08:46:59.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.586+0000 7ff189c00640 1 -- 172.21.15.2:0/1118705163 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1840b4e00 msgr2=0x7ff184169110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:59.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.586+0000 7ff189c00640 1 --2- 172.21.15.2:0/1118705163 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1840b4e00 0x7ff184169110 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff17c009dc0 tx=0x7ff17c02a5d0 comp rx=0 tx=0).stop 2024-09-10T08:46:59.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.586+0000 7ff189c00640 1 -- 172.21.15.2:0/1118705163 shutdown_connections 2024-09-10T08:46:59.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.586+0000 7ff189c00640 1 --2- 172.21.15.2:0/1118705163 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1840b4e00 0x7ff184169110 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:59.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.586+0000 7ff189c00640 1 -- 172.21.15.2:0/1118705163 >> 172.21.15.2:0/1118705163 conn(0x7ff18409d790 msgr2=0x7ff18408bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:46:59.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.586+0000 7ff189c00640 1 -- 172.21.15.2:0/1118705163 shutdown_connections 2024-09-10T08:46:59.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.586+0000 7ff189c00640 1 -- 172.21.15.2:0/1118705163 wait complete. 2024-09-10T08:46:59.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.588+0000 7ff189c00640 1 Processor -- start 2024-09-10T08:46:59.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.588+0000 7ff189c00640 1 -- start start 2024-09-10T08:46:59.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.588+0000 7ff189c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1840b4e00 0x7ff1840cab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:59.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.589+0000 7ff189c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1840d2ed0 0x7ff18415bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:59.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.589+0000 7ff189c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff18415e4d0 0x7ff1841f51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:59.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.589+0000 7ff189c00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff18415ea30 con 0x7ff1840d2ed0 2024-09-10T08:46:59.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.589+0000 7ff189c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff18415e8b0 con 0x7ff1840b4e00 2024-09-10T08:46:59.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.589+0000 7ff189c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff1840d4760 con 0x7ff18415e4d0 2024-09-10T08:46:59.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.589+0000 7ff17b400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1840d2ed0 0x7ff18415bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:59.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.589+0000 7ff17b400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1840d2ed0 0x7ff18415bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56182/0 (socket says 172.21.15.2:56182) 2024-09-10T08:46:59.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.589+0000 7ff17b400640 1 -- 172.21.15.2:0/803710450 learned_addr learned my addr 172.21.15.2:0/803710450 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:46:59.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.589+0000 7ff183e00640 1 --2- 172.21.15.2:0/803710450 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1840b4e00 0x7ff1840cab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:59.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.589+0000 7ff189200640 1 --2- 172.21.15.2:0/803710450 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff18415e4d0 0x7ff1841f51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:59.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.589+0000 7ff17b400640 1 -- 172.21.15.2:0/803710450 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff18415e4d0 msgr2=0x7ff1841f51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:59.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.589+0000 7ff17b400640 1 --2- 172.21.15.2:0/803710450 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff18415e4d0 0x7ff1841f51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:59.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.589+0000 7ff17b400640 1 -- 172.21.15.2:0/803710450 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1840b4e00 msgr2=0x7ff1840cab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:59.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.589+0000 7ff17b400640 1 --2- 172.21.15.2:0/803710450 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1840b4e00 0x7ff1840cab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:59.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.589+0000 7ff17b400640 1 -- 172.21.15.2:0/803710450 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1840cb290 con 0x7ff1840d2ed0 2024-09-10T08:46:59.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.590+0000 7ff17b400640 1 --2- 172.21.15.2:0/803710450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1840d2ed0 0x7ff18415bed0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff16c00c4c0 tx=0x7ff16c00c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:59.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.590+0000 7ff180c00640 1 -- 172.21.15.2:0/803710450 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff16c0052d0 con 0x7ff1840d2ed0 2024-09-10T08:46:59.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.590+0000 7ff180c00640 1 -- 172.21.15.2:0/803710450 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff16c005470 con 0x7ff1840d2ed0 2024-09-10T08:46:59.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.590+0000 7ff180c00640 1 -- 172.21.15.2:0/803710450 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff16c012870 con 0x7ff1840d2ed0 2024-09-10T08:46:59.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.590+0000 7ff189c00640 1 -- 172.21.15.2:0/803710450 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1840b94e0 con 0x7ff1840d2ed0 2024-09-10T08:46:59.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.590+0000 7ff189c00640 1 -- 172.21.15.2:0/803710450 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1840b9aa0 con 0x7ff1840d2ed0 2024-09-10T08:46:59.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.591+0000 7ff189c00640 1 -- 172.21.15.2:0/803710450 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff184073770 con 0x7ff1840d2ed0 2024-09-10T08:46:59.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.592+0000 7ff180c00640 1 -- 172.21.15.2:0/803710450 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff16c012a10 con 0x7ff1840d2ed0 2024-09-10T08:46:59.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.593+0000 7ff180c00640 1 --2- 172.21.15.2:0/803710450 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7ff16006be30 0x7ff16006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:46:59.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.593+0000 7ff180c00640 1 -- 172.21.15.2:0/803710450 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff16c08ad50 con 0x7ff1840d2ed0 2024-09-10T08:46:59.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.593+0000 7ff183e00640 1 --2- 172.21.15.2:0/803710450 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7ff16006be30 0x7ff16006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:46:59.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.594+0000 7ff183e00640 1 --2- 172.21.15.2:0/803710450 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7ff16006be30 0x7ff16006e2f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff1740017e0 tx=0x7ff174001610 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:46:59.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.597+0000 7ff180c00640 1 -- 172.21.15.2:0/803710450 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff184073770 con 0x7ff1840d2ed0 2024-09-10T08:46:59.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.826+0000 7ff189c00640 1 -- 172.21.15.2:0/803710450 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ff1840d4050 con 0x7ff1840d2ed0 2024-09-10T08:46:59.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.827+0000 7ff180c00640 1 -- 172.21.15.2:0/803710450 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+88 (secure 0 0 0) 0x7ff16c058cd0 con 0x7ff1840d2ed0 2024-09-10T08:46:59.827 INFO:teuthology.orchestra.run.smithi002.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-10T08:46:59.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.829+0000 7ff189c00640 1 -- 172.21.15.2:0/803710450 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7ff16006be30 msgr2=0x7ff16006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:59.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.829+0000 7ff189c00640 1 --2- 172.21.15.2:0/803710450 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7ff16006be30 0x7ff16006e2f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff1740017e0 tx=0x7ff174001610 comp rx=0 tx=0).stop 2024-09-10T08:46:59.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.829+0000 7ff189c00640 1 -- 172.21.15.2:0/803710450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1840d2ed0 msgr2=0x7ff18415bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:46:59.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.829+0000 7ff189c00640 1 --2- 172.21.15.2:0/803710450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1840d2ed0 0x7ff18415bed0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff16c00c4c0 tx=0x7ff16c00c980 comp rx=0 tx=0).stop 2024-09-10T08:46:59.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.829+0000 7ff189c00640 1 -- 172.21.15.2:0/803710450 shutdown_connections 2024-09-10T08:46:59.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.829+0000 7ff189c00640 1 --2- 172.21.15.2:0/803710450 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7ff16006be30 0x7ff16006e2f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:59.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.829+0000 7ff189c00640 1 --2- 172.21.15.2:0/803710450 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff18415e4d0 0x7ff1841f51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:59.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.829+0000 7ff189c00640 1 --2- 172.21.15.2:0/803710450 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1840d2ed0 0x7ff18415bed0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:59.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.829+0000 7ff189c00640 1 --2- 172.21.15.2:0/803710450 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1840b4e00 0x7ff1840cab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:46:59.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.829+0000 7ff189c00640 1 -- 172.21.15.2:0/803710450 >> 172.21.15.2:0/803710450 conn(0x7ff18409d790 msgr2=0x7ff18406d990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:46:59.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.829+0000 7ff189c00640 1 -- 172.21.15.2:0/803710450 shutdown_connections 2024-09-10T08:46:59.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:46:59.829+0000 7ff189c00640 1 -- 172.21.15.2:0/803710450 wait complete. 2024-09-10T08:46:59.845 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-10T08:46:59.845 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T08:46:59.845 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi002.front.sepia.ceph.com 2024-09-10T08:46:59.845 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-10T08:46:59.845 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-10T08:46:59.845 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-10T08:46:59.845 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T08:46:59.845 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T08:46:59.845 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-10T08:46:59.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:46:59.846 DEBUG:teuthology.orchestra.run.smithi002:> ip addr 2024-09-10T08:46:59.881 INFO:teuthology.orchestra.run.smithi002.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T08:46:59.881 INFO:teuthology.orchestra.run.smithi002.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T08:46:59.881 INFO:teuthology.orchestra.run.smithi002.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T08:46:59.881 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:46:59.881 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 ::1/128 scope host 2024-09-10T08:46:59.882 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:46:59.882 INFO:teuthology.orchestra.run.smithi002.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:46:59.882 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:02 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:46:59.882 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f0 2024-09-10T08:46:59.882 INFO:teuthology.orchestra.run.smithi002.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:46:59.882 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:03 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:46:59.882 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f1 2024-09-10T08:46:59.882 INFO:teuthology.orchestra.run.smithi002.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T08:46:59.882 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:20 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:46:59.882 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f0 2024-09-10T08:46:59.882 INFO:teuthology.orchestra.run.smithi002.stdout: inet 172.21.15.2/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-10T08:46:59.882 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft 42687sec preferred_lft 42687sec 2024-09-10T08:46:59.882 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::ec4:7aff:febd:1920/64 scope link 2024-09-10T08:46:59.882 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:46:59.883 INFO:teuthology.orchestra.run.smithi002.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:46:59.883 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:21 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:46:59.883 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f1 2024-09-10T08:46:59.883 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-10T08:46:59.884 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T08:46:59.884 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-09-10T08:46:59.884 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link add name ceph-brx type bridge 2024-09-10T08:46:59.884 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip addr flush dev ceph-brx 2024-09-10T08:46:59.884 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set ceph-brx up 2024-09-10T08:46:59.884 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-10T08:46:59.884 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-09-10T08:47:00.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:47:00.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:47:00.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:47:00.302 DEBUG:teuthology.orchestra.run.smithi002:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T08:47:00.356 INFO:teuthology.orchestra.run.smithi002.stdout:1 2024-09-10T08:47:00.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:47:00.360 DEBUG:teuthology.orchestra.run.smithi002:> route 2024-09-10T08:47:00.406 INFO:teuthology.orchestra.run.smithi002.stdout:Kernel IP routing table 2024-09-10T08:47:00.406 INFO:teuthology.orchestra.run.smithi002.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T08:47:00.406 INFO:teuthology.orchestra.run.smithi002.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-10T08:47:00.406 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-10T08:47:00.406 INFO:teuthology.orchestra.run.smithi002.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T08:47:00.407 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T08:47:00.407 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-09-10T08:47:00.407 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-10T08:47:00.407 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-10T08:47:00.407 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-10T08:47:00.407 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-09-10T08:47:00.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:47:00.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:47:00.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:47:00.983 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2024-09-10T08:47:01.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:47:01.019 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list-id 2024-09-10T08:47:01.094 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T08:47:01.094 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-09-10T08:47:01.094 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-10T08:47:01.094 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-10T08:47:01.094 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-09-10T08:47:01.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:47:01.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:47:01.271 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-10T08:47:01.271 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T08:47:01.271 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-09-10T08:47:01.271 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-10T08:47:01.271 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-10T08:47:01.271 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-10T08:47:01.271 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-10T08:47:01.271 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-10T08:47:01.272 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-09-10T08:47:01.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:47:01.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:47:01.728 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T08:47:01.728 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-09-10T08:47:01.728 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set brx.0 up 2024-09-10T08:47:01.728 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set dev brx.0 master ceph-brx 2024-09-10T08:47:01.728 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-09-10T08:47:01.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:47:01.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:47:01.901 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-10T08:47:01.901 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T08:47:01.902 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-10T08:47:01.936 INFO:teuthology.orchestra.run.smithi002.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-10T08:47:01.937 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T08:47:01.937 DEBUG:teuthology.orchestra.run.smithi002:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-10T08:47:02.011 DEBUG:teuthology.orchestra.run.smithi002:> sudo modprobe fuse 2024-09-10T08:47:02.109 DEBUG:teuthology.orchestra.run.smithi002:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T08:47:02.146 INFO:teuthology.orchestra.run.smithi002.stdout:/proc 2024-09-10T08:47:02.146 INFO:teuthology.orchestra.run.smithi002.stdout:/sys 2024-09-10T08:47:02.146 INFO:teuthology.orchestra.run.smithi002.stdout:/dev 2024-09-10T08:47:02.146 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/security 2024-09-10T08:47:02.146 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/shm 2024-09-10T08:47:02.147 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/pts 2024-09-10T08:47:02.147 INFO:teuthology.orchestra.run.smithi002.stdout:/run 2024-09-10T08:47:02.147 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/cgroup 2024-09-10T08:47:02.147 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/pstore 2024-09-10T08:47:02.147 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/bpf 2024-09-10T08:47:02.147 INFO:teuthology.orchestra.run.smithi002.stdout:/ 2024-09-10T08:47:02.147 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/selinux 2024-09-10T08:47:02.147 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T08:47:02.147 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/mqueue 2024-09-10T08:47:02.147 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/hugepages 2024-09-10T08:47:02.147 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/debug 2024-09-10T08:47:02.147 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/tracing 2024-09-10T08:47:02.147 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/fuse/connections 2024-09-10T08:47:02.148 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/config 2024-09-10T08:47:02.148 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysctl.service 2024-09-10T08:47:02.148 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-10T08:47:02.148 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-10T08:47:02.148 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/nfs/rpc_pipefs 2024-09-10T08:47:02.148 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/1000 2024-09-10T08:47:02.148 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph 2024-09-10T08:47:02.148 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T08:47:02.148 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T08:47:02.148 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T08:47:02.148 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T08:47:02.148 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns 2024-09-10T08:47:02.149 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-10T08:47:02.149 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-10T08:47:02.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:47:02.150 DEBUG:teuthology.orchestra.run.smithi002:> ls /sys/fs/fuse/connections 2024-09-10T08:47:02.225 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-10T08:47:02.225 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-10T08:47:02.269 DEBUG:teuthology.orchestra.run.smithi002:> sudo modprobe fuse 2024-09-10T08:47:02.326 DEBUG:teuthology.orchestra.run.smithi002:> cat /proc/self/mounts | awk '{print $2}' 2024-09-10T08:47:02.362 INFO:teuthology.orchestra.run.smithi002.stdout:/proc 2024-09-10T08:47:02.362 INFO:teuthology.orchestra.run.smithi002.stdout:/sys 2024-09-10T08:47:02.362 INFO:teuthology.orchestra.run.smithi002.stdout:/dev 2024-09-10T08:47:02.362 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/security 2024-09-10T08:47:02.362 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/shm 2024-09-10T08:47:02.362 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/pts 2024-09-10T08:47:02.362 INFO:teuthology.orchestra.run.smithi002.stdout:/run 2024-09-10T08:47:02.362 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/cgroup 2024-09-10T08:47:02.362 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/pstore 2024-09-10T08:47:02.362 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/bpf 2024-09-10T08:47:02.362 INFO:teuthology.orchestra.run.smithi002.stdout:/ 2024-09-10T08:47:02.363 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/selinux 2024-09-10T08:47:02.363 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2024-09-10T08:47:02.363 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/mqueue 2024-09-10T08:47:02.363 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/hugepages 2024-09-10T08:47:02.363 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/debug 2024-09-10T08:47:02.363 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/tracing 2024-09-10T08:47:02.363 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/fuse/connections 2024-09-10T08:47:02.363 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/config 2024-09-10T08:47:02.363 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysctl.service 2024-09-10T08:47:02.363 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-10T08:47:02.363 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-10T08:47:02.363 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/nfs/rpc_pipefs 2024-09-10T08:47:02.363 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/1000 2024-09-10T08:47:02.364 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph 2024-09-10T08:47:02.364 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-0 2024-09-10T08:47:02.364 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-1 2024-09-10T08:47:02.364 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-2 2024-09-10T08:47:02.364 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-3 2024-09-10T08:47:02.364 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns 2024-09-10T08:47:02.364 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-10T08:47:02.364 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-10T08:47:02.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:47:02.365 DEBUG:teuthology.orchestra.run.smithi002:> ls /sys/fs/fuse/connections 2024-09-10T08:47:02.422 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi002.stderr:2024-09-10T08:47:02.422+0000 7fc9fd11d480 -1 init, newargv = 0x56431f11e7c0 newargc=15 2024-09-10T08:47:02.423 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi002.stderr:ceph-fuse[41156]: starting ceph client 2024-09-10T08:47:02.434 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi002.stderr:ceph-fuse[41156]: starting fuse 2024-09-10T08:47:02.444 INFO:teuthology.orchestra.run.smithi002.stdout:43 2024-09-10T08:47:02.444 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-09-10T08:47:02.445 DEBUG:teuthology.orchestra.run.smithi002:> sudo stdin-killer -- python3 -c ' 2024-09-10T08:47:02.445 DEBUG:teuthology.orchestra.run.smithi002:> import glob 2024-09-10T08:47:02.445 DEBUG:teuthology.orchestra.run.smithi002:> import re 2024-09-10T08:47:02.445 DEBUG:teuthology.orchestra.run.smithi002:> import os 2024-09-10T08:47:02.445 DEBUG:teuthology.orchestra.run.smithi002:> import subprocess 2024-09-10T08:47:02.445 DEBUG:teuthology.orchestra.run.smithi002:> 2024-09-10T08:47:02.445 DEBUG:teuthology.orchestra.run.smithi002:> def _find_admin_socket(client_name): 2024-09-10T08:47:02.445 DEBUG:teuthology.orchestra.run.smithi002:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-10T08:47:02.445 DEBUG:teuthology.orchestra.run.smithi002:> files = glob.glob(asok_path) 2024-09-10T08:47:02.445 DEBUG:teuthology.orchestra.run.smithi002:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-10T08:47:02.445 DEBUG:teuthology.orchestra.run.smithi002:> 2024-09-10T08:47:02.445 DEBUG:teuthology.orchestra.run.smithi002:> # Given a non-glob path, it better be there 2024-09-10T08:47:02.445 DEBUG:teuthology.orchestra.run.smithi002:> if "*" not in asok_path: 2024-09-10T08:47:02.445 DEBUG:teuthology.orchestra.run.smithi002:> assert(len(files) == 1) 2024-09-10T08:47:02.446 DEBUG:teuthology.orchestra.run.smithi002:> return files[0] 2024-09-10T08:47:02.446 DEBUG:teuthology.orchestra.run.smithi002:> 2024-09-10T08:47:02.446 DEBUG:teuthology.orchestra.run.smithi002:> for f in files: 2024-09-10T08:47:02.446 DEBUG:teuthology.orchestra.run.smithi002:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-10T08:47:02.446 DEBUG:teuthology.orchestra.run.smithi002:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-10T08:47:02.446 DEBUG:teuthology.orchestra.run.smithi002:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-10T08:47:02.446 DEBUG:teuthology.orchestra.run.smithi002:> contents = proc_f.read() 2024-09-10T08:47:02.446 DEBUG:teuthology.orchestra.run.smithi002:> if mountpoint in contents: 2024-09-10T08:47:02.446 DEBUG:teuthology.orchestra.run.smithi002:> return f 2024-09-10T08:47:02.446 DEBUG:teuthology.orchestra.run.smithi002:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-10T08:47:02.446 DEBUG:teuthology.orchestra.run.smithi002:> 2024-09-10T08:47:02.446 DEBUG:teuthology.orchestra.run.smithi002:> print(_find_admin_socket("client.admin")) 2024-09-10T08:47:02.446 DEBUG:teuthology.orchestra.run.smithi002:> ' 2024-09-10T08:47:02.609 INFO:teuthology.orchestra.run.smithi002.stdout:/var/run/ceph/ceph-client.admin.41156.asok 2024-09-10T08:47:02.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:47:02.623 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.41156.asok 2024-09-10T08:47:02.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:47:02.624 DEBUG:teuthology.orchestra.run.smithi002:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.41156.asok status 2024-09-10T08:47:02.810 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T08:47:02.810 INFO:teuthology.orchestra.run.smithi002.stdout: "metadata": { 2024-09-10T08:47:02.810 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_sha1": "1cf819b7212a6048e92fc78c4eff963344f6d56b", 2024-09-10T08:47:02.810 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_version": "ceph version 19.1.1-305-g1cf819b7 (1cf819b7212a6048e92fc78c4eff963344f6d56b) squid (stable)", 2024-09-10T08:47:02.810 INFO:teuthology.orchestra.run.smithi002.stdout: "entity_id": "admin", 2024-09-10T08:47:02.810 INFO:teuthology.orchestra.run.smithi002.stdout: "hostname": "smithi002", 2024-09-10T08:47:02.811 INFO:teuthology.orchestra.run.smithi002.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-10T08:47:02.811 INFO:teuthology.orchestra.run.smithi002.stdout: "pid": "41156", 2024-09-10T08:47:02.811 INFO:teuthology.orchestra.run.smithi002.stdout: "root": "/" 2024-09-10T08:47:02.811 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T08:47:02.811 INFO:teuthology.orchestra.run.smithi002.stdout: "dentry_count": 0, 2024-09-10T08:47:02.811 INFO:teuthology.orchestra.run.smithi002.stdout: "dentry_pinned_count": 0, 2024-09-10T08:47:02.811 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 4414, 2024-09-10T08:47:02.811 INFO:teuthology.orchestra.run.smithi002.stdout: "inst": { 2024-09-10T08:47:02.811 INFO:teuthology.orchestra.run.smithi002.stdout: "name": { 2024-09-10T08:47:02.811 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "client", 2024-09-10T08:47:02.811 INFO:teuthology.orchestra.run.smithi002.stdout: "num": 4414 2024-09-10T08:47:02.811 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T08:47:02.811 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": { 2024-09-10T08:47:02.811 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2024-09-10T08:47:02.812 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:0", 2024-09-10T08:47:02.812 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 2061160438 2024-09-10T08:47:02.812 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T08:47:02.812 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T08:47:02.812 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": { 2024-09-10T08:47:02.812 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2024-09-10T08:47:02.812 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "172.21.15.2:0", 2024-09-10T08:47:02.812 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 2061160438 2024-09-10T08:47:02.812 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T08:47:02.812 INFO:teuthology.orchestra.run.smithi002.stdout: "inst_str": "client.4414 172.21.15.2:0/2061160438", 2024-09-10T08:47:02.812 INFO:teuthology.orchestra.run.smithi002.stdout: "addr_str": "172.21.15.2:0/2061160438", 2024-09-10T08:47:02.812 INFO:teuthology.orchestra.run.smithi002.stdout: "inode_count": 1, 2024-09-10T08:47:02.812 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_epoch": 7, 2024-09-10T08:47:02.812 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_epoch": 24, 2024-09-10T08:47:02.813 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_epoch_barrier": 0, 2024-09-10T08:47:02.813 INFO:teuthology.orchestra.run.smithi002.stdout: "blocklisted": false, 2024-09-10T08:47:02.813 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs" 2024-09-10T08:47:02.813 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T08:47:02.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:47:02.822 DEBUG:teuthology.orchestra.run.smithi002:> stat --file-system '--printf=%T 2024-09-10T08:47:02.822 DEBUG:teuthology.orchestra.run.smithi002:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-10T08:47:02.858 INFO:teuthology.orchestra.run.smithi002.stdout:fuseblk 2024-09-10T08:47:02.858 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-10T08:47:02.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:47:02.859 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-10T08:47:02.956 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-10T08:47:03.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:47:03.201 INFO:teuthology.orchestra.run.smithi002.stdout:# file: . 2024-09-10T08:47:03.201 INFO:teuthology.orchestra.run.smithi002.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-10T08:47:03.201 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:47:03.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:47:03.209 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T08:47:03.210 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:47:03.245 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T08:47:03.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.444+0000 7f3cf3e00640 1 Processor -- start 2024-09-10T08:47:03.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.444+0000 7f3cf3e00640 1 -- start start 2024-09-10T08:47:03.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.445+0000 7f3cf3e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3cf415e500 0x7f3cf40cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:03.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.445+0000 7f3cf3e00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cf40d0350 con 0x7f3cf40d0b50 2024-09-10T08:47:03.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.445+0000 7f3cf3e00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cf40d2080 con 0x7f3cf40d4d90 2024-09-10T08:47:03.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.445+0000 7f3cf3e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3cf415e8e0 con 0x7f3cf415e500 2024-09-10T08:47:03.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.445+0000 7f3cf3400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f3cf40d0b50 0x7f3cf40b7240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:57986/0 (socket says 172.21.15.2:57986) 2024-09-10T08:47:03.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.445+0000 7f3cf3400640 1 -- 172.21.15.2:0/1754465680 learned_addr learned my addr 172.21.15.2:0/1754465680 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:47:03.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.446+0000 7f3cf2a00640 1 --2- 172.21.15.2:0/1754465680 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3cf415e500 0x7f3cf40cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:03.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.446+0000 7f3cf1600640 1 -- 172.21.15.2:0/1754465680 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4020265852 0 0) 0x7f3cf40d0350 con 0x7f3cf40d0b50 2024-09-10T08:47:03.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.446+0000 7f3cf1600640 1 -- 172.21.15.2:0/1754465680 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3cd8003520 con 0x7f3cf40d0b50 2024-09-10T08:47:03.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.446+0000 7f3cf1600640 1 -- 172.21.15.2:0/1754465680 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2140782574 0 0) 0x7f3cf40d2080 con 0x7f3cf40d4d90 2024-09-10T08:47:03.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.446+0000 7f3cf1600640 1 -- 172.21.15.2:0/1754465680 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3cf40d0350 con 0x7f3cf40d4d90 2024-09-10T08:47:03.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.446+0000 7f3cf2a00640 1 -- 172.21.15.2:0/1754465680 >> v1:172.21.15.155:6789/0 conn(0x7f3cf40d4d90 legacy=0x7f3cf40d2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:03.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.446+0000 7f3cf2a00640 1 -- 172.21.15.2:0/1754465680 >> v1:172.21.15.2:6789/0 conn(0x7f3cf40d0b50 legacy=0x7f3cf40b7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:03.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.446+0000 7f3cf2a00640 1 -- 172.21.15.2:0/1754465680 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cf40d2360 con 0x7f3cf415e500 2024-09-10T08:47:03.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.447+0000 7f3cf2a00640 1 --2- 172.21.15.2:0/1754465680 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3cf415e500 0x7f3cf40cefb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3ce40097d0 tx=0x7f3ce402a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a0604845a0dda9e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:03.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.447+0000 7f3cf1600640 1 -- 172.21.15.2:0/1754465680 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce4037070 con 0x7f3cf415e500 2024-09-10T08:47:03.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.447+0000 7f3cf1600640 1 -- 172.21.15.2:0/1754465680 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ce4032440 con 0x7f3cf415e500 2024-09-10T08:47:03.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.447+0000 7f3cf1600640 1 -- 172.21.15.2:0/1754465680 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce4032810 con 0x7f3cf415e500 2024-09-10T08:47:03.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.448+0000 7f3cf3e00640 1 -- 172.21.15.2:0/1754465680 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3cf415e500 msgr2=0x7f3cf40cefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:03.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.448+0000 7f3cf3e00640 1 --2- 172.21.15.2:0/1754465680 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3cf415e500 0x7f3cf40cefb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3ce40097d0 tx=0x7f3ce402a210 comp rx=0 tx=0).stop 2024-09-10T08:47:03.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.448+0000 7f3cf3e00640 1 -- 172.21.15.2:0/1754465680 shutdown_connections 2024-09-10T08:47:03.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.448+0000 7f3cf3e00640 1 --2- 172.21.15.2:0/1754465680 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3cf415e500 0x7f3cf40cefb0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:03.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.448+0000 7f3cf3e00640 1 -- 172.21.15.2:0/1754465680 >> 172.21.15.2:0/1754465680 conn(0x7f3cf409d720 msgr2=0x7f3cf40d4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:03.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.448+0000 7f3cf3e00640 1 -- 172.21.15.2:0/1754465680 shutdown_connections 2024-09-10T08:47:03.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.448+0000 7f3cf3e00640 1 -- 172.21.15.2:0/1754465680 wait complete. 2024-09-10T08:47:03.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.450+0000 7f3cf3e00640 1 Processor -- start 2024-09-10T08:47:03.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.450+0000 7f3cf3e00640 1 -- start start 2024-09-10T08:47:03.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.451+0000 7f3cf3e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3cf40d0b50 0x7f3cf41f7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:03.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.451+0000 7f3cf3e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3cf40d4d90 0x7f3cf40a1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:03.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.451+0000 7f3cf3e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3cf415e500 0x7f3cf4154560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:03.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.451+0000 7f3cf3e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf40cff90 con 0x7f3cf40d4d90 2024-09-10T08:47:03.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.451+0000 7f3cf3e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf40d2920 con 0x7f3cf415e500 2024-09-10T08:47:03.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.451+0000 7f3cf3e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3cf40d0110 con 0x7f3cf40d0b50 2024-09-10T08:47:03.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.451+0000 7f3cf2000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3cf40d4d90 0x7f3cf40a1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:03.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.451+0000 7f3cf2000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3cf40d4d90 0x7f3cf40a1bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56186/0 (socket says 172.21.15.2:56186) 2024-09-10T08:47:03.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.451+0000 7f3cf2000640 1 -- 172.21.15.2:0/2420838586 learned_addr learned my addr 172.21.15.2:0/2420838586 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:03.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.451+0000 7f3cf3400640 1 --2- 172.21.15.2:0/2420838586 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3cf415e500 0x7f3cf4154560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:03.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.451+0000 7f3cf2a00640 1 --2- 172.21.15.2:0/2420838586 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3cf40d0b50 0x7f3cf41f7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:03.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.451+0000 7f3cf2000640 1 -- 172.21.15.2:0/2420838586 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3cf40d0b50 msgr2=0x7f3cf41f7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:03.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.451+0000 7f3cf2000640 1 --2- 172.21.15.2:0/2420838586 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3cf40d0b50 0x7f3cf41f7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:03.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.451+0000 7f3cf2000640 1 -- 172.21.15.2:0/2420838586 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3cf415e500 msgr2=0x7f3cf4154560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:03.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.451+0000 7f3cf2000640 1 --2- 172.21.15.2:0/2420838586 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3cf415e500 0x7f3cf4154560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:03.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.451+0000 7f3cf2000640 1 -- 172.21.15.2:0/2420838586 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cf41f8280 con 0x7f3cf40d4d90 2024-09-10T08:47:03.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.452+0000 7f3cf2000640 1 --2- 172.21.15.2:0/2420838586 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3cf40d4d90 0x7f3cf40a1bf0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3ce000c490 tx=0x7f3ce000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:03.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.452+0000 7f3ceaa00640 1 -- 172.21.15.2:0/2420838586 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce00052d0 con 0x7f3cf40d4d90 2024-09-10T08:47:03.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.452+0000 7f3ceaa00640 1 -- 172.21.15.2:0/2420838586 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ce0005470 con 0x7f3cf40d4d90 2024-09-10T08:47:03.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.452+0000 7f3ceaa00640 1 -- 172.21.15.2:0/2420838586 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce0012850 con 0x7f3cf40d4d90 2024-09-10T08:47:03.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.452+0000 7f3cf3e00640 1 -- 172.21.15.2:0/2420838586 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cf41f8560 con 0x7f3cf40d4d90 2024-09-10T08:47:03.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.452+0000 7f3cf3e00640 1 -- 172.21.15.2:0/2420838586 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cf40cd340 con 0x7f3cf40d4d90 2024-09-10T08:47:03.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.453+0000 7f3cf3e00640 1 -- 172.21.15.2:0/2420838586 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cf41f8a80 con 0x7f3cf40d4d90 2024-09-10T08:47:03.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.454+0000 7f3ceaa00640 1 -- 172.21.15.2:0/2420838586 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3ce00129f0 con 0x7f3cf40d4d90 2024-09-10T08:47:03.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.455+0000 7f3ceaa00640 1 --2- 172.21.15.2:0/2420838586 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f3cd406be30 0x7f3cd406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:03.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.455+0000 7f3ceaa00640 1 -- 172.21.15.2:0/2420838586 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f3ce008af10 con 0x7f3cf40d4d90 2024-09-10T08:47:03.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.455+0000 7f3cf2a00640 1 --2- 172.21.15.2:0/2420838586 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f3cd406be30 0x7f3cd406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:03.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.456+0000 7f3cf2a00640 1 --2- 172.21.15.2:0/2420838586 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f3cd406be30 0x7f3cd406e2f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3ce4034000 tx=0x7f3ce402e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:03.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.460+0000 7f3ceaa00640 1 -- 172.21.15.2:0/2420838586 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3ce00594e0 con 0x7f3cf40d4d90 2024-09-10T08:47:03.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.655+0000 7f3cf3e00640 1 -- 172.21.15.2:0/2420838586 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f3cf40cefb0 con 0x7f3cf40d4d90 2024-09-10T08:47:03.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.655+0000 7f3ceaa00640 1 -- 172.21.15.2:0/2420838586 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f3ce0058de0 con 0x7f3cf40d4d90 2024-09-10T08:47:03.656 INFO:teuthology.orchestra.run.smithi002.stderr:listed 0 entries 2024-09-10T08:47:03.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.657+0000 7f3cf3e00640 1 -- 172.21.15.2:0/2420838586 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f3cd406be30 msgr2=0x7f3cd406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:03.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.657+0000 7f3cf3e00640 1 --2- 172.21.15.2:0/2420838586 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f3cd406be30 0x7f3cd406e2f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3ce4034000 tx=0x7f3ce402e000 comp rx=0 tx=0).stop 2024-09-10T08:47:03.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.657+0000 7f3cf3e00640 1 -- 172.21.15.2:0/2420838586 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3cf40d4d90 msgr2=0x7f3cf40a1bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:03.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.657+0000 7f3cf3e00640 1 --2- 172.21.15.2:0/2420838586 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3cf40d4d90 0x7f3cf40a1bf0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3ce000c490 tx=0x7f3ce000c950 comp rx=0 tx=0).stop 2024-09-10T08:47:03.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.657+0000 7f3cf3e00640 1 -- 172.21.15.2:0/2420838586 shutdown_connections 2024-09-10T08:47:03.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.657+0000 7f3cf3e00640 1 --2- 172.21.15.2:0/2420838586 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3cf415e500 0x7f3cf4154560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:03.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.657+0000 7f3cf3e00640 1 --2- 172.21.15.2:0/2420838586 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3cf40d4d90 0x7f3cf40a1bf0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:03.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.657+0000 7f3cf3e00640 1 --2- 172.21.15.2:0/2420838586 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f3cd406be30 0x7f3cd406e2f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:03.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.657+0000 7f3cf3e00640 1 --2- 172.21.15.2:0/2420838586 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3cf40d0b50 0x7f3cf41f7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:03.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.657+0000 7f3cf3e00640 1 -- 172.21.15.2:0/2420838586 >> 172.21.15.2:0/2420838586 conn(0x7f3cf409d720 msgr2=0x7f3cf40cab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:03.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.658+0000 7f3cf3e00640 1 -- 172.21.15.2:0/2420838586 shutdown_connections 2024-09-10T08:47:03.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.658+0000 7f3cf3e00640 1 -- 172.21.15.2:0/2420838586 wait complete. 2024-09-10T08:47:03.673 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T08:47:03.673 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:47:03.709 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T08:47:03.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.910+0000 7f44c7600640 1 Processor -- start 2024-09-10T08:47:03.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.910+0000 7f44c7600640 1 -- start start 2024-09-10T08:47:03.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.911+0000 7f44c7600640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f44c008c450 0x7f44c00d0f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:03.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.911+0000 7f44c7600640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44c00d4cf0 con 0x7f44c00d1480 2024-09-10T08:47:03.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.911+0000 7f44c7600640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44c00d4fd0 con 0x7f44c0161de0 2024-09-10T08:47:03.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.911+0000 7f44c7600640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f44c00b1520 con 0x7f44c008c450 2024-09-10T08:47:03.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.911+0000 7f44c5600640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f44c00d1480 0x7f44c00b19b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:57996/0 (socket says 172.21.15.2:57996) 2024-09-10T08:47:03.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.911+0000 7f44c5600640 1 -- 172.21.15.2:0/3825225226 learned_addr learned my addr 172.21.15.2:0/3825225226 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:47:03.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.911+0000 7f44bfe00640 1 --2- 172.21.15.2:0/3825225226 >> v2:172.21.15.2:3300/0 conn(0x7f44c008c450 0x7f44c00d0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:03.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.912+0000 7f44bf400640 1 -- 172.21.15.2:0/3825225226 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4118634676 0 0) 0x7f44c00d4cf0 con 0x7f44c00d1480 2024-09-10T08:47:03.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.912+0000 7f44bf400640 1 -- 172.21.15.2:0/3825225226 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44a8003520 con 0x7f44c00d1480 2024-09-10T08:47:03.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.912+0000 7f44bfe00640 1 -- 172.21.15.2:0/3825225226 >> v1:172.21.15.155:6789/0 conn(0x7f44c0161de0 legacy=0x7f44c00b3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:03.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.912+0000 7f44bfe00640 1 -- 172.21.15.2:0/3825225226 >> v1:172.21.15.2:6789/0 conn(0x7f44c00d1480 legacy=0x7f44c00b19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:03.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.912+0000 7f44bfe00640 1 -- 172.21.15.2:0/3825225226 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44c00d52b0 con 0x7f44c008c450 2024-09-10T08:47:03.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.913+0000 7f44bfe00640 1 --2- 172.21.15.2:0/3825225226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44c008c450 0x7f44c00d0f40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f44ac0097a0 tx=0x7f44ac02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=536e55d613d2ae09 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:03.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.913+0000 7f44bf400640 1 -- 172.21.15.2:0/3825225226 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44ac037070 con 0x7f44c008c450 2024-09-10T08:47:03.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.913+0000 7f44bf400640 1 -- 172.21.15.2:0/3825225226 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44ac032440 con 0x7f44c008c450 2024-09-10T08:47:03.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.913+0000 7f44bf400640 1 -- 172.21.15.2:0/3825225226 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44ac0327f0 con 0x7f44c008c450 2024-09-10T08:47:03.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.913+0000 7f44c7600640 1 -- 172.21.15.2:0/3825225226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44c008c450 msgr2=0x7f44c00d0f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:03.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.913+0000 7f44c7600640 1 --2- 172.21.15.2:0/3825225226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44c008c450 0x7f44c00d0f40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f44ac0097a0 tx=0x7f44ac02a1a0 comp rx=0 tx=0).stop 2024-09-10T08:47:03.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.914+0000 7f44c7600640 1 -- 172.21.15.2:0/3825225226 shutdown_connections 2024-09-10T08:47:03.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.914+0000 7f44c7600640 1 --2- 172.21.15.2:0/3825225226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44c008c450 0x7f44c00d0f40 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:03.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.914+0000 7f44c7600640 1 -- 172.21.15.2:0/3825225226 >> 172.21.15.2:0/3825225226 conn(0x7f44c008bfd0 msgr2=0x7f44c00d45e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:03.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.914+0000 7f44c7600640 1 -- 172.21.15.2:0/3825225226 shutdown_connections 2024-09-10T08:47:03.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.914+0000 7f44c7600640 1 -- 172.21.15.2:0/3825225226 wait complete. 2024-09-10T08:47:03.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.915+0000 7f44c7600640 1 Processor -- start 2024-09-10T08:47:03.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.915+0000 7f44c7600640 1 -- start start 2024-09-10T08:47:03.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.916+0000 7f44c7600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f44c008c450 0x7f44c01e7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:03.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.916+0000 7f44c7600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44c00d1480 0x7f44c00b6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:03.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.916+0000 7f44c7600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f44c0161de0 0x7f44c00b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:03.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.916+0000 7f44c7600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f44c00b2240 con 0x7f44c00d1480 2024-09-10T08:47:03.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.916+0000 7f44c7600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f44c00b20c0 con 0x7f44c0161de0 2024-09-10T08:47:03.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.916+0000 7f44c7600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f44c00b23c0 con 0x7f44c008c450 2024-09-10T08:47:03.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.916+0000 7f44bfe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44c00d1480 0x7f44c00b6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:03.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.917+0000 7f44bfe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44c00d1480 0x7f44c00b6690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56204/0 (socket says 172.21.15.2:56204) 2024-09-10T08:47:03.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.917+0000 7f44bfe00640 1 -- 172.21.15.2:0/2924504755 learned_addr learned my addr 172.21.15.2:0/2924504755 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:03.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.917+0000 7f44c5600640 1 --2- 172.21.15.2:0/2924504755 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f44c0161de0 0x7f44c00b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:03.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.917+0000 7f44bfe00640 1 -- 172.21.15.2:0/2924504755 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f44c008c450 msgr2=0x7f44c01e7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:03.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.917+0000 7f44bfe00640 1 --2- 172.21.15.2:0/2924504755 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f44c008c450 0x7f44c01e7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:03.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.917+0000 7f44bfe00640 1 -- 172.21.15.2:0/2924504755 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f44c0161de0 msgr2=0x7f44c00b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:03.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.917+0000 7f44bfe00640 1 --2- 172.21.15.2:0/2924504755 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f44c0161de0 0x7f44c00b4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:03.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.917+0000 7f44bfe00640 1 -- 172.21.15.2:0/2924504755 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44c014bbb0 con 0x7f44c00d1480 2024-09-10T08:47:03.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.917+0000 7f44c5600640 1 --2- 172.21.15.2:0/2924504755 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f44c0161de0 0x7f44c00b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:47:03.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.917+0000 7f44bfe00640 1 --2- 172.21.15.2:0/2924504755 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44c00d1480 0x7f44c00b6690 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f44ac0097a0 tx=0x7f44ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:03.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.918+0000 7f44bcc00640 1 -- 172.21.15.2:0/2924504755 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44ac037050 con 0x7f44c00d1480 2024-09-10T08:47:03.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.918+0000 7f44bcc00640 1 -- 172.21.15.2:0/2924504755 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44ac043070 con 0x7f44c00d1480 2024-09-10T08:47:03.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.918+0000 7f44bcc00640 1 -- 172.21.15.2:0/2924504755 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44ac006e10 con 0x7f44c00d1480 2024-09-10T08:47:03.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.918+0000 7f44c7600640 1 -- 172.21.15.2:0/2924504755 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44c014be90 con 0x7f44c00d1480 2024-09-10T08:47:03.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.918+0000 7f44c7600640 1 -- 172.21.15.2:0/2924504755 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44c014c450 con 0x7f44c00d1480 2024-09-10T08:47:03.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.919+0000 7f44c7600640 1 -- 172.21.15.2:0/2924504755 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44c00d0f40 con 0x7f44c00d1480 2024-09-10T08:47:03.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.920+0000 7f44bcc00640 1 -- 172.21.15.2:0/2924504755 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f44ac032810 con 0x7f44c00d1480 2024-09-10T08:47:03.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.921+0000 7f44bcc00640 1 --2- 172.21.15.2:0/2924504755 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f44a006be30 0x7f44a006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:03.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.921+0000 7f44bcc00640 1 -- 172.21.15.2:0/2924504755 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f44ac0abd00 con 0x7f44c00d1480 2024-09-10T08:47:03.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.921+0000 7f44c4c00640 1 --2- 172.21.15.2:0/2924504755 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f44a006be30 0x7f44a006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:03.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.922+0000 7f44c4c00640 1 --2- 172.21.15.2:0/2924504755 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f44a006be30 0x7f44a006e2f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f44b4000f60 tx=0x7f44b40079b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:03.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:03.925+0000 7f44bcc00640 1 -- 172.21.15.2:0/2924504755 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f44ac07a2d0 con 0x7f44c00d1480 2024-09-10T08:47:04.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:04.121+0000 7f44c7600640 1 -- 172.21.15.2:0/2924504755 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f44c008e090 con 0x7f44c00d1480 2024-09-10T08:47:04.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:04.121+0000 7f44bcc00640 1 -- 172.21.15.2:0/2924504755 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f44ac079bd0 con 0x7f44c00d1480 2024-09-10T08:47:04.122 INFO:teuthology.orchestra.run.smithi002.stderr:listed 0 entries 2024-09-10T08:47:04.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:04.123+0000 7f44c7600640 1 -- 172.21.15.2:0/2924504755 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f44a006be30 msgr2=0x7f44a006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:04.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:04.123+0000 7f44c7600640 1 --2- 172.21.15.2:0/2924504755 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f44a006be30 0x7f44a006e2f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f44b4000f60 tx=0x7f44b40079b0 comp rx=0 tx=0).stop 2024-09-10T08:47:04.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:04.123+0000 7f44c7600640 1 -- 172.21.15.2:0/2924504755 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44c00d1480 msgr2=0x7f44c00b6690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:04.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:04.123+0000 7f44c7600640 1 --2- 172.21.15.2:0/2924504755 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44c00d1480 0x7f44c00b6690 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f44ac0097a0 tx=0x7f44ac0046c0 comp rx=0 tx=0).stop 2024-09-10T08:47:04.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:04.123+0000 7f44c7600640 1 -- 172.21.15.2:0/2924504755 shutdown_connections 2024-09-10T08:47:04.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:04.123+0000 7f44c7600640 1 --2- 172.21.15.2:0/2924504755 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f44c0161de0 0x7f44c00b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:04.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:04.123+0000 7f44c7600640 1 --2- 172.21.15.2:0/2924504755 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44c00d1480 0x7f44c00b6690 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:04.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:04.123+0000 7f44c7600640 1 --2- 172.21.15.2:0/2924504755 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f44a006be30 0x7f44a006e2f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:04.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:04.123+0000 7f44c7600640 1 --2- 172.21.15.2:0/2924504755 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f44c008c450 0x7f44c01e7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:04.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:04.123+0000 7f44c7600640 1 -- 172.21.15.2:0/2924504755 >> 172.21.15.2:0/2924504755 conn(0x7f44c008bfd0 msgr2=0x7f44c015f380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:04.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:04.123+0000 7f44c7600640 1 -- 172.21.15.2:0/2924504755 shutdown_connections 2024-09-10T08:47:04.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:04.123+0000 7f44c7600640 1 -- 172.21.15.2:0/2924504755 wait complete. 2024-09-10T08:47:04.139 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi002.front.sepia.ceph.com... 2024-09-10T08:47:04.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:47:04.140 DEBUG:teuthology.orchestra.run.smithi002:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-10T08:47:04.193 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi002.stderr:ceph-fuse[41156]: fuse finished with error 0 and tester_r 0 2024-09-10T08:47:04.196 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:47:07.993 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:47:07.999 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:47:10.298 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi002.front.sepia.ceph.com 2024-09-10T08:47:10.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:47:10.298 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-10T08:47:10.349 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:47:10.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.507+0000 7f9033800640 1 Processor -- start 2024-09-10T08:47:10.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.507+0000 7f9033800640 1 -- start start 2024-09-10T08:47:10.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.508+0000 7f9033800640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f902c145d20 0x7f902c15c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:10.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.508+0000 7f9033800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f902c06df80 0x7f902c160980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:10.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.508+0000 7f9033800640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f902c06e4d0 con 0x7f902c0ccd50 2024-09-10T08:47:10.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.509+0000 7f9033800640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f902c146100 con 0x7f902c06df80 2024-09-10T08:47:10.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.509+0000 7f9033800640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f902c160ec0 con 0x7f902c145d20 2024-09-10T08:47:10.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.509+0000 7f902be00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f902c06df80 0x7f902c160980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:10.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.509+0000 7f902be00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f902c06df80 0x7f902c160980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40774/0 (socket says 172.21.15.2:40774) 2024-09-10T08:47:10.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.509+0000 7f902be00640 1 -- 172.21.15.2:0/3430492458 learned_addr learned my addr 172.21.15.2:0/3430492458 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:10.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.509+0000 7f9030e00640 1 --2- 172.21.15.2:0/3430492458 >> v2:172.21.15.155:3300/0 conn(0x7f902c145d20 0x7f902c15c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:10.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.509+0000 7f902be00640 1 -- 172.21.15.2:0/3430492458 >> v2:172.21.15.155:3300/0 conn(0x7f902c145d20 msgr2=0x7f902c15c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:10.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.509+0000 7f902be00640 1 --2- 172.21.15.2:0/3430492458 >> v2:172.21.15.155:3300/0 conn(0x7f902c145d20 0x7f902c15c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:10.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.509+0000 7f902be00640 1 -- 172.21.15.2:0/3430492458 >> v1:172.21.15.155:6789/0 conn(0x7f902c0ccd50 legacy=0x7f902c0ceb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:10.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.509+0000 7f902be00640 1 -- 172.21.15.2:0/3430492458 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f902c06e7b0 con 0x7f902c06df80 2024-09-10T08:47:10.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.510+0000 7f902be00640 1 --2- 172.21.15.2:0/3430492458 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f902c06df80 0x7f902c160980 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9018009870 tx=0x7f901802a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90f8e68b45ee6713 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:10.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.511+0000 7f902b400640 1 -- 172.21.15.2:0/3430492458 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9018037070 con 0x7f902c06df80 2024-09-10T08:47:10.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.511+0000 7f902b400640 1 -- 172.21.15.2:0/3430492458 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f901802ae40 con 0x7f902c06df80 2024-09-10T08:47:10.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.511+0000 7f902b400640 1 -- 172.21.15.2:0/3430492458 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9018032660 con 0x7f902c06df80 2024-09-10T08:47:10.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.511+0000 7f9033800640 1 -- 172.21.15.2:0/3430492458 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f902c06df80 msgr2=0x7f902c160980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:10.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.511+0000 7f9033800640 1 --2- 172.21.15.2:0/3430492458 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f902c06df80 0x7f902c160980 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9018009870 tx=0x7f901802a130 comp rx=0 tx=0).stop 2024-09-10T08:47:10.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.511+0000 7f9033800640 1 -- 172.21.15.2:0/3430492458 shutdown_connections 2024-09-10T08:47:10.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.511+0000 7f9033800640 1 --2- 172.21.15.2:0/3430492458 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f902c06df80 0x7f902c160980 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:10.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.511+0000 7f9033800640 1 --2- 172.21.15.2:0/3430492458 >> v2:172.21.15.155:3300/0 conn(0x7f902c145d20 0x7f902c15c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:10.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.511+0000 7f9033800640 1 -- 172.21.15.2:0/3430492458 >> 172.21.15.2:0/3430492458 conn(0x7f902c06bc10 msgr2=0x7f902c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:10.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.511+0000 7f9033800640 1 -- 172.21.15.2:0/3430492458 shutdown_connections 2024-09-10T08:47:10.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.511+0000 7f9033800640 1 -- 172.21.15.2:0/3430492458 wait complete. 2024-09-10T08:47:10.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.513+0000 7f9033800640 1 Processor -- start 2024-09-10T08:47:10.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.513+0000 7f9033800640 1 -- start start 2024-09-10T08:47:10.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.514+0000 7f9033800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f902c06df80 0x7f902c158aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:10.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.514+0000 7f9033800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f902c0ccd50 0x7f902c15a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:10.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.514+0000 7f9033800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f902c145d20 0x7f902c13c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:10.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.514+0000 7f9033800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f902c06ed70 con 0x7f902c145d20 2024-09-10T08:47:10.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.514+0000 7f9033800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f902c0ce6b0 con 0x7f902c06df80 2024-09-10T08:47:10.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.514+0000 7f9033800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f902c0cd1c0 con 0x7f902c0ccd50 2024-09-10T08:47:10.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.514+0000 7f9031800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f902c145d20 0x7f902c13c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:10.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.514+0000 7f9031800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f902c145d20 0x7f902c13c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40782/0 (socket says 172.21.15.2:40782) 2024-09-10T08:47:10.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.514+0000 7f9031800640 1 -- 172.21.15.2:0/2130948460 learned_addr learned my addr 172.21.15.2:0/2130948460 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:10.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.514+0000 7f902be00640 1 --2- 172.21.15.2:0/2130948460 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f902c0ccd50 0x7f902c15a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:10.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.515+0000 7f9030e00640 1 --2- 172.21.15.2:0/2130948460 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f902c06df80 0x7f902c158aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:10.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.515+0000 7f9031800640 1 -- 172.21.15.2:0/2130948460 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f902c0ccd50 msgr2=0x7f902c15a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:10.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.515+0000 7f9031800640 1 --2- 172.21.15.2:0/2130948460 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f902c0ccd50 0x7f902c15a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:10.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.515+0000 7f9031800640 1 -- 172.21.15.2:0/2130948460 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f902c06df80 msgr2=0x7f902c158aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:10.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.515+0000 7f9031800640 1 --2- 172.21.15.2:0/2130948460 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f902c06df80 0x7f902c158aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:10.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.515+0000 7f9031800640 1 -- 172.21.15.2:0/2130948460 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f902c1593a0 con 0x7f902c145d20 2024-09-10T08:47:10.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.515+0000 7f9031800640 1 --2- 172.21.15.2:0/2130948460 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f902c145d20 0x7f902c13c780 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f902400c7b0 tx=0x7f902400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:10.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.515+0000 7f9028c00640 1 -- 172.21.15.2:0/2130948460 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9024004b60 con 0x7f902c145d20 2024-09-10T08:47:10.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.515+0000 7f9028c00640 1 -- 172.21.15.2:0/2130948460 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9024004d00 con 0x7f902c145d20 2024-09-10T08:47:10.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.515+0000 7f9028c00640 1 -- 172.21.15.2:0/2130948460 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f902400aa30 con 0x7f902c145d20 2024-09-10T08:47:10.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.515+0000 7f9033800640 1 -- 172.21.15.2:0/2130948460 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f902c159680 con 0x7f902c145d20 2024-09-10T08:47:10.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.515+0000 7f9033800640 1 -- 172.21.15.2:0/2130948460 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f902c159c40 con 0x7f902c145d20 2024-09-10T08:47:10.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.517+0000 7f9033800640 1 -- 172.21.15.2:0/2130948460 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f902c0cd550 con 0x7f902c145d20 2024-09-10T08:47:10.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.517+0000 7f9028c00640 1 -- 172.21.15.2:0/2130948460 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f902400abd0 con 0x7f902c145d20 2024-09-10T08:47:10.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.518+0000 7f9028c00640 1 --2- 172.21.15.2:0/2130948460 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f900c06be30 0x7f900c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:10.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.518+0000 7f9028c00640 1 -- 172.21.15.2:0/2130948460 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f902408b360 con 0x7f902c145d20 2024-09-10T08:47:10.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.519+0000 7f9030e00640 1 --2- 172.21.15.2:0/2130948460 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f900c06be30 0x7f900c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:10.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.521+0000 7f9030e00640 1 --2- 172.21.15.2:0/2130948460 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f900c06be30 0x7f900c06e2f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9020006fd0 tx=0x7f9020008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:10.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.523+0000 7f9028c00640 1 -- 172.21.15.2:0/2130948460 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9024020070 con 0x7f902c145d20 2024-09-10T08:47:10.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.707+0000 7f9033800640 1 -- 172.21.15.2:0/2130948460 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f902c0cf5f0 con 0x7f902c145d20 2024-09-10T08:47:10.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.709+0000 7f9028c00640 1 -- 172.21.15.2:0/2130948460 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18538 (secure 0 0 0) 0x7f90240599c0 con 0x7f902c145d20 2024-09-10T08:47:10.709 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:47:10.710 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":24,"fsid":"f20a15a7-d363-4d44-98cb-4f4f466b52b8","created":"2024-09-10T08:46:26.481619+0000","modified":"2024-09-10T08:46:56.240092+0000","last_up_change":"2024-09-10T08:46:39.323912+0000","last_in_change":"2024-09-10T08:46:29.499894+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:46:39.426180+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:46:49.214595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T08:46:50.168313+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T08:46:53.833162+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c90be333-506b-46d1-b00a-10d089a84776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6822","nonce":298678486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6823","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6826","nonce":298678486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6831","nonce":298678486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6829","nonce":298678486}]},"public_addr":"172.21.15.2:6822/298678486","cluster_addr":"172.21.15.2:6826/298678486","heartbeat_back_addr":"172.21.15.2:6831/298678486","heartbeat_front_addr":"172.21.15.2:6829/298678486","state":["exists","up"]},{"osd":1,"uuid":"3f8bdde8-6cd3-4112-8939-a876191c7368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6809","nonce":1619566025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6811","nonce":1619566025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6815","nonce":1619566025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6813","nonce":1619566025}]},"public_addr":"172.21.15.2:6809/1619566025","cluster_addr":"172.21.15.2:6811/1619566025","heartbeat_back_addr":"172.21.15.2:6815/1619566025","heartbeat_front_addr":"172.21.15.2:6813/1619566025","state":["exists","up"]},{"osd":2,"uuid":"3835f5ab-ed3a-4f46-ae6c-f0edf21708d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6801","nonce":3992427579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6803","nonce":3992427579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6807","nonce":3992427579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6805","nonce":3992427579}]},"public_addr":"172.21.15.2:6801/3992427579","cluster_addr":"172.21.15.2:6803/3992427579","heartbeat_back_addr":"172.21.15.2:6807/3992427579","heartbeat_front_addr":"172.21.15.2:6805/3992427579","state":["exists","up"]},{"osd":3,"uuid":"add6ad27-b411-4a82-9622-b0c1c1782cf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6817","nonce":1270626884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6819","nonce":1270626884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6827","nonce":1270626884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6824","nonce":1270626884}]},"public_addr":"172.21.15.2:6817/1270626884","cluster_addr":"172.21.15.2:6819/1270626884","heartbeat_back_addr":"172.21.15.2:6827/1270626884","heartbeat_front_addr":"172.21.15.2:6824/1270626884","state":["exists","up"]},{"osd":4,"uuid":"c7b642f4-8bd2-4262-9a82-ee1061cfab7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6803","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6806","nonce":553254873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6813","nonce":553254873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6822","nonce":553254873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6819","nonce":553254873}]},"public_addr":"172.21.15.155:6806/553254873","cluster_addr":"172.21.15.155:6813/553254873","heartbeat_back_addr":"172.21.15.155:6822/553254873","heartbeat_front_addr":"172.21.15.155:6819/553254873","state":["exists","up"]},{"osd":5,"uuid":"fb53289a-419f-46d8-9e3a-384ac529dc57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6805","nonce":2107688472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6811","nonce":2107688472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6823","nonce":2107688472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6817","nonce":2107688472}]},"public_addr":"172.21.15.155:6805/2107688472","cluster_addr":"172.21.15.155:6811/2107688472","heartbeat_back_addr":"172.21.15.155:6823/2107688472","heartbeat_front_addr":"172.21.15.155:6817/2107688472","state":["exists","up"]},{"osd":6,"uuid":"3f9ddd54-ede4-4565-aff6-ae1c07e7c678","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6825","nonce":944542383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6827","nonce":944542383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6831","nonce":944542383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6829","nonce":944542383}]},"public_addr":"172.21.15.155:6825/944542383","cluster_addr":"172.21.15.155:6827/944542383","heartbeat_back_addr":"172.21.15.155:6831/944542383","heartbeat_front_addr":"172.21.15.155:6829/944542383","state":["exists","up"]},{"osd":7,"uuid":"328d0681-eef4-4556-94e1-9745bd4adbe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6801","nonce":2220093913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6807","nonce":2220093913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6818","nonce":2220093913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6812","nonce":2220093913}]},"public_addr":"172.21.15.155:6801/2220093913","cluster_addr":"172.21.15.155:6807/2220093913","heartbeat_back_addr":"172.21.15.155:6818/2220093913","heartbeat_front_addr":"172.21.15.155:6812/2220093913","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.052980+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.104550+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.025661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:35.784354+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:35.863363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.322312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.100890+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:35.763584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:47:10.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.711+0000 7f9033800640 1 -- 172.21.15.2:0/2130948460 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f900c06be30 msgr2=0x7f900c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:10.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.711+0000 7f9033800640 1 --2- 172.21.15.2:0/2130948460 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f900c06be30 0x7f900c06e2f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9020006fd0 tx=0x7f9020008040 comp rx=0 tx=0).stop 2024-09-10T08:47:10.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.711+0000 7f9033800640 1 -- 172.21.15.2:0/2130948460 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f902c145d20 msgr2=0x7f902c13c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:10.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.711+0000 7f9033800640 1 --2- 172.21.15.2:0/2130948460 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f902c145d20 0x7f902c13c780 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f902400c7b0 tx=0x7f902400cc70 comp rx=0 tx=0).stop 2024-09-10T08:47:10.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.711+0000 7f9033800640 1 -- 172.21.15.2:0/2130948460 shutdown_connections 2024-09-10T08:47:10.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.711+0000 7f9033800640 1 --2- 172.21.15.2:0/2130948460 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f902c145d20 0x7f902c13c780 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:10.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.711+0000 7f9033800640 1 --2- 172.21.15.2:0/2130948460 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f900c06be30 0x7f900c06e2f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:10.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.711+0000 7f9033800640 1 --2- 172.21.15.2:0/2130948460 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f902c0ccd50 0x7f902c15a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:10.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.711+0000 7f9033800640 1 --2- 172.21.15.2:0/2130948460 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f902c06df80 0x7f902c158aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:10.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.711+0000 7f9033800640 1 -- 172.21.15.2:0/2130948460 >> 172.21.15.2:0/2130948460 conn(0x7f902c06bc10 msgr2=0x7f902c0ad940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:10.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.711+0000 7f9033800640 1 -- 172.21.15.2:0/2130948460 shutdown_connections 2024-09-10T08:47:10.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.711+0000 7f9033800640 1 -- 172.21.15.2:0/2130948460 wait complete. 2024-09-10T08:47:10.728 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:47:10.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.883+0000 7fd8b7c00640 1 Processor -- start 2024-09-10T08:47:10.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.884+0000 7fd8b7c00640 1 -- start start 2024-09-10T08:47:10.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.885+0000 7fd8b7c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd8b0144250 0x7fd8b00cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:10.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.885+0000 7fd8b7c00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd8b0144c90 0x7fd8b00ccd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:10.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.885+0000 7fd8b7c00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd8b00cd2b0 0x7fd8b015ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:10.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.885+0000 7fd8b7c00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fd8b006f540 con 0x7fd8b0144c90 2024-09-10T08:47:10.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.885+0000 7fd8b7c00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fd8b006f820 con 0x7fd8b00cd2b0 2024-09-10T08:47:10.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.885+0000 7fd8b7c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd8b006fb00 con 0x7fd8b0144250 2024-09-10T08:47:10.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.885+0000 7fd8afe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd8b0144c90 0x7fd8b00ccd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:10.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.885+0000 7fd8afe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd8b0144c90 0x7fd8b00ccd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40790/0 (socket says 172.21.15.2:40790) 2024-09-10T08:47:10.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.885+0000 7fd8afe00640 1 -- 172.21.15.2:0/3764470740 learned_addr learned my addr 172.21.15.2:0/3764470740 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:10.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.885+0000 7fd8b5c00640 1 --2- 172.21.15.2:0/3764470740 >> v2:172.21.15.155:3300/0 conn(0x7fd8b00cd2b0 0x7fd8b015ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:10.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.885+0000 7fd8b5200640 1 --2- 172.21.15.2:0/3764470740 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd8b0144250 0x7fd8b00cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:10.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.886+0000 7fd8afe00640 1 -- 172.21.15.2:0/3764470740 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd8b0144250 msgr2=0x7fd8b00cf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:10.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.886+0000 7fd8afe00640 1 --2- 172.21.15.2:0/3764470740 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd8b0144250 0x7fd8b00cf8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:10.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.886+0000 7fd8afe00640 1 -- 172.21.15.2:0/3764470740 >> v2:172.21.15.155:3300/0 conn(0x7fd8b00cd2b0 msgr2=0x7fd8b015ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:10.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.886+0000 7fd8afe00640 1 --2- 172.21.15.2:0/3764470740 >> v2:172.21.15.155:3300/0 conn(0x7fd8b00cd2b0 0x7fd8b015ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:10.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.886+0000 7fd8afe00640 1 -- 172.21.15.2:0/3764470740 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8b006fde0 con 0x7fd8b0144c90 2024-09-10T08:47:10.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.886+0000 7fd8b5200640 1 --2- 172.21.15.2:0/3764470740 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd8b0144250 0x7fd8b00cf8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:47:10.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.887+0000 7fd8afe00640 1 --2- 172.21.15.2:0/3764470740 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8b0144c90 0x7fd8b00ccd70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd8b006e010 tx=0x7fd89c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=640c3fef304376f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:10.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.887+0000 7fd8af400640 1 -- 172.21.15.2:0/3764470740 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd89c037070 con 0x7fd8b0144c90 2024-09-10T08:47:10.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.887+0000 7fd8af400640 1 -- 172.21.15.2:0/3764470740 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd89c032440 con 0x7fd8b0144c90 2024-09-10T08:47:10.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.887+0000 7fd8af400640 1 -- 172.21.15.2:0/3764470740 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd89c032810 con 0x7fd8b0144c90 2024-09-10T08:47:10.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.887+0000 7fd8b7c00640 1 -- 172.21.15.2:0/3764470740 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8b0144c90 msgr2=0x7fd8b00ccd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:10.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.887+0000 7fd8b7c00640 1 --2- 172.21.15.2:0/3764470740 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8b0144c90 0x7fd8b00ccd70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd8b006e010 tx=0x7fd89c02a1e0 comp rx=0 tx=0).stop 2024-09-10T08:47:10.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.888+0000 7fd8b7c00640 1 -- 172.21.15.2:0/3764470740 shutdown_connections 2024-09-10T08:47:10.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.888+0000 7fd8b7c00640 1 --2- 172.21.15.2:0/3764470740 >> v2:172.21.15.155:3300/0 conn(0x7fd8b00cd2b0 0x7fd8b015ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:10.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.888+0000 7fd8b7c00640 1 --2- 172.21.15.2:0/3764470740 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8b0144c90 0x7fd8b00ccd70 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:10.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.888+0000 7fd8b7c00640 1 --2- 172.21.15.2:0/3764470740 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd8b0144250 0x7fd8b00cf8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:10.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.888+0000 7fd8b7c00640 1 -- 172.21.15.2:0/3764470740 >> 172.21.15.2:0/3764470740 conn(0x7fd8b006bc10 msgr2=0x7fd8b006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:10.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.888+0000 7fd8b7c00640 1 -- 172.21.15.2:0/3764470740 shutdown_connections 2024-09-10T08:47:10.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.888+0000 7fd8b7c00640 1 -- 172.21.15.2:0/3764470740 wait complete. 2024-09-10T08:47:10.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.889+0000 7fd8b7c00640 1 Processor -- start 2024-09-10T08:47:10.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.889+0000 7fd8b7c00640 1 -- start start 2024-09-10T08:47:10.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.890+0000 7fd8b7c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd8b00cd2b0 0x7fd8b00b1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:10.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.890+0000 7fd8b7c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8b0144250 0x7fd8b014fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:10.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.890+0000 7fd8b7c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8b0144c90 0x7fd8b0150320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:10.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.890+0000 7fd8b7c00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd8b00b3390 con 0x7fd8b0144c90 2024-09-10T08:47:10.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.890+0000 7fd8b7c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd8b00cfe10 con 0x7fd8b0144250 2024-09-10T08:47:10.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.890+0000 7fd8b7c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd8b015f4b0 con 0x7fd8b00cd2b0 2024-09-10T08:47:10.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.891+0000 7fd8b5c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8b0144c90 0x7fd8b0150320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:10.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.891+0000 7fd8b5200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd8b00cd2b0 0x7fd8b00b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:10.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.891+0000 7fd8b5200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd8b00cd2b0 0x7fd8b00b1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.2:40810/0 (socket says 172.21.15.2:40810) 2024-09-10T08:47:10.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.891+0000 7fd8b5200640 1 -- 172.21.15.2:0/2941291678 learned_addr learned my addr 172.21.15.2:0/2941291678 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:10.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.891+0000 7fd8afe00640 1 --2- 172.21.15.2:0/2941291678 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8b0144250 0x7fd8b014fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:10.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.891+0000 7fd8b5200640 1 -- 172.21.15.2:0/2941291678 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8b0144250 msgr2=0x7fd8b014fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:10.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.891+0000 7fd8b5200640 1 --2- 172.21.15.2:0/2941291678 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8b0144250 0x7fd8b014fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:10.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.891+0000 7fd8b5200640 1 -- 172.21.15.2:0/2941291678 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8b0144c90 msgr2=0x7fd8b0150320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:10.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.891+0000 7fd8b5200640 1 --2- 172.21.15.2:0/2941291678 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8b0144c90 0x7fd8b0150320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:10.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.891+0000 7fd8b5200640 1 -- 172.21.15.2:0/2941291678 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8b00b1af0 con 0x7fd8b00cd2b0 2024-09-10T08:47:10.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.891+0000 7fd8b5c00640 1 --2- 172.21.15.2:0/2941291678 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8b0144c90 0x7fd8b0150320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:47:10.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.891+0000 7fd8b5200640 1 --2- 172.21.15.2:0/2941291678 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd8b00cd2b0 0x7fd8b00b1050 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd8a400e7e0 tx=0x7fd8a400eca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:10.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.892+0000 7fd8acc00640 1 -- 172.21.15.2:0/2941291678 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8a400f040 con 0x7fd8b00cd2b0 2024-09-10T08:47:10.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.892+0000 7fd8acc00640 1 -- 172.21.15.2:0/2941291678 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8a4004030 con 0x7fd8b00cd2b0 2024-09-10T08:47:10.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.892+0000 7fd8acc00640 1 -- 172.21.15.2:0/2941291678 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8a4004400 con 0x7fd8b00cd2b0 2024-09-10T08:47:10.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.892+0000 7fd8b7c00640 1 -- 172.21.15.2:0/2941291678 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8b00b1dd0 con 0x7fd8b00cd2b0 2024-09-10T08:47:10.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.892+0000 7fd8b7c00640 1 -- 172.21.15.2:0/2941291678 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8b00b2390 con 0x7fd8b00cd2b0 2024-09-10T08:47:10.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.893+0000 7fd8b7c00640 1 -- 172.21.15.2:0/2941291678 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8b00cf8d0 con 0x7fd8b00cd2b0 2024-09-10T08:47:10.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.894+0000 7fd8acc00640 1 -- 172.21.15.2:0/2941291678 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd8a400c6d0 con 0x7fd8b00cd2b0 2024-09-10T08:47:10.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.895+0000 7fd8acc00640 1 --2- 172.21.15.2:0/2941291678 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fd89006be30 0x7fd89006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:10.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.895+0000 7fd8acc00640 1 -- 172.21.15.2:0/2941291678 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd8a408afc0 con 0x7fd8b00cd2b0 2024-09-10T08:47:10.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.895+0000 7fd8afe00640 1 --2- 172.21.15.2:0/2941291678 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fd89006be30 0x7fd89006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:10.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.896+0000 7fd8afe00640 1 --2- 172.21.15.2:0/2941291678 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fd89006be30 0x7fd89006e2f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd89c034000 tx=0x7fd89c02e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:10.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:10.901+0000 7fd8acc00640 1 -- 172.21.15.2:0/2941291678 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd8a4017020 con 0x7fd8b00cd2b0 2024-09-10T08:47:11.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.086+0000 7fd8b7c00640 1 -- 172.21.15.2:0/2941291678 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd8b015ee50 con 0x7fd8b00cd2b0 2024-09-10T08:47:11.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.088+0000 7fd8acc00640 1 -- 172.21.15.2:0/2941291678 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18538 (secure 0 0 0) 0x7fd8a4058f40 con 0x7fd8b00cd2b0 2024-09-10T08:47:11.089 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:47:11.089 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":24,"fsid":"f20a15a7-d363-4d44-98cb-4f4f466b52b8","created":"2024-09-10T08:46:26.481619+0000","modified":"2024-09-10T08:46:56.240092+0000","last_up_change":"2024-09-10T08:46:39.323912+0000","last_in_change":"2024-09-10T08:46:29.499894+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:46:39.426180+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:46:49.214595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T08:46:50.168313+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T08:46:53.833162+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c90be333-506b-46d1-b00a-10d089a84776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6822","nonce":298678486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6823","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6826","nonce":298678486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6831","nonce":298678486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6829","nonce":298678486}]},"public_addr":"172.21.15.2:6822/298678486","cluster_addr":"172.21.15.2:6826/298678486","heartbeat_back_addr":"172.21.15.2:6831/298678486","heartbeat_front_addr":"172.21.15.2:6829/298678486","state":["exists","up"]},{"osd":1,"uuid":"3f8bdde8-6cd3-4112-8939-a876191c7368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6809","nonce":1619566025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6811","nonce":1619566025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6815","nonce":1619566025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6813","nonce":1619566025}]},"public_addr":"172.21.15.2:6809/1619566025","cluster_addr":"172.21.15.2:6811/1619566025","heartbeat_back_addr":"172.21.15.2:6815/1619566025","heartbeat_front_addr":"172.21.15.2:6813/1619566025","state":["exists","up"]},{"osd":2,"uuid":"3835f5ab-ed3a-4f46-ae6c-f0edf21708d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6801","nonce":3992427579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6803","nonce":3992427579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6807","nonce":3992427579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6805","nonce":3992427579}]},"public_addr":"172.21.15.2:6801/3992427579","cluster_addr":"172.21.15.2:6803/3992427579","heartbeat_back_addr":"172.21.15.2:6807/3992427579","heartbeat_front_addr":"172.21.15.2:6805/3992427579","state":["exists","up"]},{"osd":3,"uuid":"add6ad27-b411-4a82-9622-b0c1c1782cf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6817","nonce":1270626884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6819","nonce":1270626884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6827","nonce":1270626884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6824","nonce":1270626884}]},"public_addr":"172.21.15.2:6817/1270626884","cluster_addr":"172.21.15.2:6819/1270626884","heartbeat_back_addr":"172.21.15.2:6827/1270626884","heartbeat_front_addr":"172.21.15.2:6824/1270626884","state":["exists","up"]},{"osd":4,"uuid":"c7b642f4-8bd2-4262-9a82-ee1061cfab7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6803","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6806","nonce":553254873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6813","nonce":553254873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6822","nonce":553254873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6819","nonce":553254873}]},"public_addr":"172.21.15.155:6806/553254873","cluster_addr":"172.21.15.155:6813/553254873","heartbeat_back_addr":"172.21.15.155:6822/553254873","heartbeat_front_addr":"172.21.15.155:6819/553254873","state":["exists","up"]},{"osd":5,"uuid":"fb53289a-419f-46d8-9e3a-384ac529dc57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6805","nonce":2107688472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6811","nonce":2107688472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6823","nonce":2107688472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6817","nonce":2107688472}]},"public_addr":"172.21.15.155:6805/2107688472","cluster_addr":"172.21.15.155:6811/2107688472","heartbeat_back_addr":"172.21.15.155:6823/2107688472","heartbeat_front_addr":"172.21.15.155:6817/2107688472","state":["exists","up"]},{"osd":6,"uuid":"3f9ddd54-ede4-4565-aff6-ae1c07e7c678","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6825","nonce":944542383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6827","nonce":944542383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6831","nonce":944542383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6829","nonce":944542383}]},"public_addr":"172.21.15.155:6825/944542383","cluster_addr":"172.21.15.155:6827/944542383","heartbeat_back_addr":"172.21.15.155:6831/944542383","heartbeat_front_addr":"172.21.15.155:6829/944542383","state":["exists","up"]},{"osd":7,"uuid":"328d0681-eef4-4556-94e1-9745bd4adbe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6801","nonce":2220093913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6807","nonce":2220093913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6818","nonce":2220093913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6812","nonce":2220093913}]},"public_addr":"172.21.15.155:6801/2220093913","cluster_addr":"172.21.15.155:6807/2220093913","heartbeat_back_addr":"172.21.15.155:6818/2220093913","heartbeat_front_addr":"172.21.15.155:6812/2220093913","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.052980+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.104550+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.025661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:35.784354+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:35.863363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.322312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.100890+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:35.763584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:47:11.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.090+0000 7fd8b7c00640 1 -- 172.21.15.2:0/2941291678 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fd89006be30 msgr2=0x7fd89006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:11.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.090+0000 7fd8b7c00640 1 --2- 172.21.15.2:0/2941291678 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fd89006be30 0x7fd89006e2f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd89c034000 tx=0x7fd89c02e000 comp rx=0 tx=0).stop 2024-09-10T08:47:11.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.090+0000 7fd8b7c00640 1 -- 172.21.15.2:0/2941291678 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd8b00cd2b0 msgr2=0x7fd8b00b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:11.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.090+0000 7fd8b7c00640 1 --2- 172.21.15.2:0/2941291678 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd8b00cd2b0 0x7fd8b00b1050 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd8a400e7e0 tx=0x7fd8a400eca0 comp rx=0 tx=0).stop 2024-09-10T08:47:11.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.090+0000 7fd8b7c00640 1 -- 172.21.15.2:0/2941291678 shutdown_connections 2024-09-10T08:47:11.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.090+0000 7fd8b7c00640 1 --2- 172.21.15.2:0/2941291678 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8b0144c90 0x7fd8b0150320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:11.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.090+0000 7fd8b7c00640 1 --2- 172.21.15.2:0/2941291678 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd8b0144250 0x7fd8b014fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:11.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.090+0000 7fd8b7c00640 1 --2- 172.21.15.2:0/2941291678 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fd89006be30 0x7fd89006e2f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:11.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.090+0000 7fd8b7c00640 1 --2- 172.21.15.2:0/2941291678 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd8b00cd2b0 0x7fd8b00b1050 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:11.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.090+0000 7fd8b7c00640 1 -- 172.21.15.2:0/2941291678 >> 172.21.15.2:0/2941291678 conn(0x7fd8b006bc10 msgr2=0x7fd8b00b3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:11.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.090+0000 7fd8b7c00640 1 -- 172.21.15.2:0/2941291678 shutdown_connections 2024-09-10T08:47:11.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.091+0000 7fd8b7c00640 1 -- 172.21.15.2:0/2941291678 wait complete. 2024-09-10T08:47:11.106 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-10T08:47:11.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.265+0000 7f2e43200640 1 Processor -- start 2024-09-10T08:47:11.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.265+0000 7f2e43200640 1 -- start start 2024-09-10T08:47:11.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.266+0000 7f2e43200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e44161bb0 0x7f2e440d2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:11.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.266+0000 7f2e43200640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2e44161f90 0x7f2e440d2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:11.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.267+0000 7f2e43200640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e440cfbf0 con 0x7f2e440d2db0 2024-09-10T08:47:11.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.267+0000 7f2e43200640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f2e440cfed0 con 0x7f2e44161f90 2024-09-10T08:47:11.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.267+0000 7f2e43200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2e440d01b0 con 0x7f2e44161bb0 2024-09-10T08:47:11.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.267+0000 7f2e42800640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f2e440d2db0 0x7f2e440d0d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:43302/0 (socket says 172.21.15.2:43302) 2024-09-10T08:47:11.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.267+0000 7f2e42800640 1 -- 172.21.15.2:0/1223432001 learned_addr learned my addr 172.21.15.2:0/1223432001 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:47:11.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.267+0000 7f2e41e00640 1 --2- 172.21.15.2:0/1223432001 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e44161bb0 0x7f2e440d2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:11.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.267+0000 7f2e3be00640 1 --2- 172.21.15.2:0/1223432001 >> v2:172.21.15.155:3300/0 conn(0x7f2e44161f90 0x7f2e440d2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:11.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.267+0000 7f2e41400640 1 -- 172.21.15.2:0/1223432001 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1123772109 0 0) 0x7f2e440cfbf0 con 0x7f2e440d2db0 2024-09-10T08:47:11.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.267+0000 7f2e41400640 1 -- 172.21.15.2:0/1223432001 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e28003520 con 0x7f2e440d2db0 2024-09-10T08:47:11.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.268+0000 7f2e41400640 1 -- 172.21.15.2:0/1223432001 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1626180632 0 0) 0x7f2e28003520 con 0x7f2e440d2db0 2024-09-10T08:47:11.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.268+0000 7f2e41400640 1 -- 172.21.15.2:0/1223432001 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e44161bb0 msgr2=0x7f2e440d2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:11.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.268+0000 7f2e41400640 1 --2- 172.21.15.2:0/1223432001 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e44161bb0 0x7f2e440d2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:11.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.268+0000 7f2e41400640 1 -- 172.21.15.2:0/1223432001 >> v2:172.21.15.155:3300/0 conn(0x7f2e44161f90 msgr2=0x7f2e440d2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:11.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.268+0000 7f2e41400640 1 --2- 172.21.15.2:0/1223432001 >> v2:172.21.15.155:3300/0 conn(0x7f2e44161f90 0x7f2e440d2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:11.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.268+0000 7f2e41400640 1 -- 172.21.15.2:0/1223432001 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e440d0490 con 0x7f2e440d2db0 2024-09-10T08:47:11.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.268+0000 7f2e41400640 1 -- 172.21.15.2:0/1223432001 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2345211856 0 0) 0x7f2e3c0019f0 con 0x7f2e440d2db0 2024-09-10T08:47:11.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.268+0000 7f2e41e00640 1 --2- 172.21.15.2:0/1223432001 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e44161bb0 0x7f2e440d2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:47:11.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.268+0000 7f2e41400640 1 -- 172.21.15.2:0/1223432001 >> v1:172.21.15.2:6789/0 conn(0x7f2e440d2db0 legacy=0x7f2e440d0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:11.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.268+0000 7f2e41400640 1 --2- 172.21.15.2:0/1223432001 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e280039b0 0x7f2e28003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:11.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.268+0000 7f2e41400640 1 --2- 172.21.15.2:0/1223432001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e280043a0 0x7f2e28004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:11.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.268+0000 7f2e41400640 1 --2- 172.21.15.2:0/1223432001 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e28004ef0 0x7f2e2800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:11.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.268+0000 7f2e41400640 1 -- 172.21.15.2:0/1223432001 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2e440cfed0 con 0x7f2e280043a0 2024-09-10T08:47:11.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.268+0000 7f2e41400640 1 -- 172.21.15.2:0/1223432001 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2e440d01b0 con 0x7f2e28004ef0 2024-09-10T08:47:11.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.268+0000 7f2e41400640 1 -- 172.21.15.2:0/1223432001 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2e2800bf00 con 0x7f2e280039b0 2024-09-10T08:47:11.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.268+0000 7f2e3be00640 1 --2- 172.21.15.2:0/1223432001 >> v2:172.21.15.155:3300/0 conn(0x7f2e44161f90 0x7f2e440d2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:47:11.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.268+0000 7f2e41e00640 1 --2- 172.21.15.2:0/1223432001 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e280039b0 0x7f2e28003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:11.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.268+0000 7f2e3be00640 1 --2- 172.21.15.2:0/1223432001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e280043a0 0x7f2e28004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:11.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.268+0000 7f2e42800640 1 --2- 172.21.15.2:0/1223432001 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e28004ef0 0x7f2e2800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:11.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.268+0000 7f2e41e00640 1 -- 172.21.15.2:0/1223432001 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e28004ef0 msgr2=0x7f2e2800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:11.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.268+0000 7f2e41e00640 1 --2- 172.21.15.2:0/1223432001 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e28004ef0 0x7f2e2800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:11.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.268+0000 7f2e41e00640 1 -- 172.21.15.2:0/1223432001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e280043a0 msgr2=0x7f2e28004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:11.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.268+0000 7f2e41e00640 1 --2- 172.21.15.2:0/1223432001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e280043a0 0x7f2e28004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:11.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.268+0000 7f2e41e00640 1 -- 172.21.15.2:0/1223432001 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e28003520 con 0x7f2e280039b0 2024-09-10T08:47:11.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.268+0000 7f2e3be00640 1 --2- 172.21.15.2:0/1223432001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e280043a0 0x7f2e28004880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:47:11.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.269+0000 7f2e41e00640 1 --2- 172.21.15.2:0/1223432001 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e280039b0 0x7f2e28003dd0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2e4408d030 tx=0x7f2e28005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ac39001cf3bd5e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:11.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.270+0000 7f2e41400640 1 -- 172.21.15.2:0/1223432001 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e34036070 con 0x7f2e280039b0 2024-09-10T08:47:11.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.270+0000 7f2e41400640 1 -- 172.21.15.2:0/1223432001 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e34004030 con 0x7f2e280039b0 2024-09-10T08:47:11.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.270+0000 7f2e41400640 1 -- 172.21.15.2:0/1223432001 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e340097f0 con 0x7f2e280039b0 2024-09-10T08:47:11.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.270+0000 7f2e43200640 1 -- 172.21.15.2:0/1223432001 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e280039b0 msgr2=0x7f2e28003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:11.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.270+0000 7f2e43200640 1 --2- 172.21.15.2:0/1223432001 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e280039b0 0x7f2e28003dd0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2e4408d030 tx=0x7f2e28005830 comp rx=0 tx=0).stop 2024-09-10T08:47:11.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.270+0000 7f2e42800640 1 -- 172.21.15.2:0/1223432001 reap_dead start 2024-09-10T08:47:11.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.270+0000 7f2e43200640 1 -- 172.21.15.2:0/1223432001 shutdown_connections 2024-09-10T08:47:11.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.270+0000 7f2e43200640 1 -- 172.21.15.2:0/1223432001 >> 172.21.15.2:0/1223432001 conn(0x7f2e4409d700 msgr2=0x7f2e440d4430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:11.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.270+0000 7f2e43200640 1 -- 172.21.15.2:0/1223432001 shutdown_connections 2024-09-10T08:47:11.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.270+0000 7f2e43200640 1 -- 172.21.15.2:0/1223432001 wait complete. 2024-09-10T08:47:11.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.272+0000 7f2e43200640 1 Processor -- start 2024-09-10T08:47:11.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.272+0000 7f2e43200640 1 -- start start 2024-09-10T08:47:11.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.273+0000 7f2e43200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e280039b0 0x7f2e44160520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:11.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.273+0000 7f2e43200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e440c7e20 0x7f2e441f4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:11.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.273+0000 7f2e43200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e441f48c0 0x7f2e440cd680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:11.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.273+0000 7f2e43200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2e440d4e70 con 0x7f2e440c7e20 2024-09-10T08:47:11.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.273+0000 7f2e43200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2e440d52c0 con 0x7f2e441f48c0 2024-09-10T08:47:11.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.273+0000 7f2e43200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2e440d4ff0 con 0x7f2e280039b0 2024-09-10T08:47:11.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.273+0000 7f2e3be00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e440c7e20 0x7f2e441f4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:11.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.273+0000 7f2e3be00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e440c7e20 0x7f2e441f4380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40830/0 (socket says 172.21.15.2:40830) 2024-09-10T08:47:11.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.273+0000 7f2e3be00640 1 -- 172.21.15.2:0/2217283852 learned_addr learned my addr 172.21.15.2:0/2217283852 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:11.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.274+0000 7f2e41e00640 1 --2- 172.21.15.2:0/2217283852 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e280039b0 0x7f2e44160520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:11.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.274+0000 7f2e42800640 1 --2- 172.21.15.2:0/2217283852 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e441f48c0 0x7f2e440cd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:11.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.274+0000 7f2e3be00640 1 -- 172.21.15.2:0/2217283852 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e280039b0 msgr2=0x7f2e44160520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:11.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.274+0000 7f2e3be00640 1 --2- 172.21.15.2:0/2217283852 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e280039b0 0x7f2e44160520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:11.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.274+0000 7f2e3be00640 1 -- 172.21.15.2:0/2217283852 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e441f48c0 msgr2=0x7f2e440cd680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:11.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.274+0000 7f2e3be00640 1 --2- 172.21.15.2:0/2217283852 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e441f48c0 0x7f2e440cd680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:11.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.274+0000 7f2e3be00640 1 -- 172.21.15.2:0/2217283852 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e441f4e40 con 0x7f2e440c7e20 2024-09-10T08:47:11.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.274+0000 7f2e41e00640 1 --2- 172.21.15.2:0/2217283852 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e280039b0 0x7f2e44160520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:47:11.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.274+0000 7f2e42800640 1 --2- 172.21.15.2:0/2217283852 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e441f48c0 0x7f2e440cd680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:47:11.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.274+0000 7f2e3be00640 1 --2- 172.21.15.2:0/2217283852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e440c7e20 0x7f2e441f4380 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c011d00 tx=0x7f2e2c00f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:11.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.274+0000 7f2e3a000640 1 -- 172.21.15.2:0/2217283852 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e2c019070 con 0x7f2e440c7e20 2024-09-10T08:47:11.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.274+0000 7f2e3a000640 1 -- 172.21.15.2:0/2217283852 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e2c004030 con 0x7f2e440c7e20 2024-09-10T08:47:11.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.274+0000 7f2e3a000640 1 -- 172.21.15.2:0/2217283852 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e2c0043e0 con 0x7f2e440c7e20 2024-09-10T08:47:11.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.274+0000 7f2e43200640 1 -- 172.21.15.2:0/2217283852 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e441f5120 con 0x7f2e440c7e20 2024-09-10T08:47:11.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.275+0000 7f2e43200640 1 -- 172.21.15.2:0/2217283852 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e440c82a0 con 0x7f2e440c7e20 2024-09-10T08:47:11.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.276+0000 7f2e43200640 1 -- 172.21.15.2:0/2217283852 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e440ba320 con 0x7f2e440c7e20 2024-09-10T08:47:11.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.277+0000 7f2e3a000640 1 -- 172.21.15.2:0/2217283852 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2e2c01c070 con 0x7f2e440c7e20 2024-09-10T08:47:11.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.278+0000 7f2e3a000640 1 --2- 172.21.15.2:0/2217283852 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f2e2006be60 0x7f2e2006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:11.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.278+0000 7f2e3a000640 1 -- 172.21.15.2:0/2217283852 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f2e2c08b800 con 0x7f2e440c7e20 2024-09-10T08:47:11.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.278+0000 7f2e41e00640 1 --2- 172.21.15.2:0/2217283852 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f2e2006be60 0x7f2e2006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:11.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.279+0000 7f2e41e00640 1 --2- 172.21.15.2:0/2217283852 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f2e2006be60 0x7f2e2006e320 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2e34033000 tx=0x7f2e34008030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:11.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.282+0000 7f2e3a000640 1 -- 172.21.15.2:0/2217283852 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2e2c059f00 con 0x7f2e440c7e20 2024-09-10T08:47:11.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:11.505+0000 7f2e43200640 1 -- 172.21.15.2:0/2217283852 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f2e440d2330 con 0x7f2e440c7e20 2024-09-10T08:47:12.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:12.448+0000 7f2e3a000640 1 -- 172.21.15.2:0/2217283852 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) ==== 118+0+0 (secure 0 0 0) 0x7f2e2c059800 con 0x7f2e440c7e20 2024-09-10T08:47:12.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:12.452+0000 7f2e43200640 1 -- 172.21.15.2:0/2217283852 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f2e2006be60 msgr2=0x7f2e2006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:12.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:12.452+0000 7f2e43200640 1 --2- 172.21.15.2:0/2217283852 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f2e2006be60 0x7f2e2006e320 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2e34033000 tx=0x7f2e34008030 comp rx=0 tx=0).stop 2024-09-10T08:47:12.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:12.452+0000 7f2e43200640 1 -- 172.21.15.2:0/2217283852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e440c7e20 msgr2=0x7f2e441f4380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:12.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:12.452+0000 7f2e43200640 1 --2- 172.21.15.2:0/2217283852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e440c7e20 0x7f2e441f4380 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c011d00 tx=0x7f2e2c00f610 comp rx=0 tx=0).stop 2024-09-10T08:47:12.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:12.452+0000 7f2e43200640 1 -- 172.21.15.2:0/2217283852 shutdown_connections 2024-09-10T08:47:12.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:12.452+0000 7f2e43200640 1 --2- 172.21.15.2:0/2217283852 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e441f48c0 0x7f2e440cd680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:12.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:12.452+0000 7f2e43200640 1 --2- 172.21.15.2:0/2217283852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2e440c7e20 0x7f2e441f4380 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:12.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:12.452+0000 7f2e43200640 1 --2- 172.21.15.2:0/2217283852 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f2e2006be60 0x7f2e2006e320 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:12.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:12.452+0000 7f2e43200640 1 --2- 172.21.15.2:0/2217283852 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2e280039b0 0x7f2e44160520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:12.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:12.452+0000 7f2e43200640 1 -- 172.21.15.2:0/2217283852 >> 172.21.15.2:0/2217283852 conn(0x7f2e4409d700 msgr2=0x7f2e440d43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:12.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:12.452+0000 7f2e43200640 1 -- 172.21.15.2:0/2217283852 shutdown_connections 2024-09-10T08:47:12.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:12.452+0000 7f2e43200640 1 -- 172.21.15.2:0/2217283852 wait complete. 2024-09-10T08:47:12.471 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-09-10T08:47:12.471 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-10T08:47:12.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:12.633+0000 7f3541e00640 1 Processor -- start 2024-09-10T08:47:12.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:12.634+0000 7f3541e00640 1 -- start start 2024-09-10T08:47:12.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:12.635+0000 7f3541e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f353c161b20 0x7f353c0adb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:12.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:12.635+0000 7f3541e00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f353c06ea00 con 0x7f353c0b4c00 2024-09-10T08:47:12.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:12.635+0000 7f3541e00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f353c06ece0 con 0x7f353c073340 2024-09-10T08:47:12.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:12.635+0000 7f3541e00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f353c161f00 con 0x7f353c161b20 2024-09-10T08:47:12.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:12.635+0000 7f353b400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f353c0b4c00 0x7f353c06faa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:43310/0 (socket says 172.21.15.2:43310) 2024-09-10T08:47:12.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:12.635+0000 7f353b400640 1 -- 172.21.15.2:0/1859903626 learned_addr learned my addr 172.21.15.2:0/1859903626 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:47:12.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:12.635+0000 7f353aa00640 1 --2- 172.21.15.2:0/1859903626 >> v2:172.21.15.2:3300/0 conn(0x7f353c161b20 0x7f353c0adb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:12.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:12.636+0000 7f3539600640 1 -- 172.21.15.2:0/1859903626 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2123920896 0 0) 0x7f353c06ea00 con 0x7f353c0b4c00 2024-09-10T08:47:12.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:12.636+0000 7f3539600640 1 -- 172.21.15.2:0/1859903626 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3520003520 con 0x7f353c0b4c00 2024-09-10T08:47:12.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:12.636+0000 7f353aa00640 1 -- 172.21.15.2:0/1859903626 >> v1:172.21.15.155:6789/0 conn(0x7f353c073340 legacy=0x7f353c0b44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:12.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:12.636+0000 7f353aa00640 1 -- 172.21.15.2:0/1859903626 >> v1:172.21.15.2:6789/0 conn(0x7f353c0b4c00 legacy=0x7f353c06faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:12.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:12.636+0000 7f353aa00640 1 -- 172.21.15.2:0/1859903626 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f353c06efc0 con 0x7f353c161b20 2024-09-10T08:47:12.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:12.637+0000 7f353aa00640 1 --2- 172.21.15.2:0/1859903626 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f353c161b20 0x7f353c0adb00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f352c0097a0 tx=0x7f352c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a47a96b4469582f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:12.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:12.637+0000 7f3539600640 1 -- 172.21.15.2:0/1859903626 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f352c037070 con 0x7f353c161b20 2024-09-10T08:47:12.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:12.637+0000 7f3539600640 1 -- 172.21.15.2:0/1859903626 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f352c032440 con 0x7f353c161b20 2024-09-10T08:47:12.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:12.637+0000 7f3539600640 1 -- 172.21.15.2:0/1859903626 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f352c032810 con 0x7f353c161b20 2024-09-10T08:47:12.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:12.637+0000 7f3541e00640 1 -- 172.21.15.2:0/1859903626 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f353c161b20 msgr2=0x7f353c0adb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:12.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:12.637+0000 7f3541e00640 1 --2- 172.21.15.2:0/1859903626 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f353c161b20 0x7f353c0adb00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f352c0097a0 tx=0x7f352c02a230 comp rx=0 tx=0).stop 2024-09-10T08:47:12.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:12.637+0000 7f3541e00640 1 -- 172.21.15.2:0/1859903626 shutdown_connections 2024-09-10T08:47:12.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:12.637+0000 7f3541e00640 1 --2- 172.21.15.2:0/1859903626 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f353c161b20 0x7f353c0adb00 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:12.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:12.637+0000 7f3541e00640 1 -- 172.21.15.2:0/1859903626 >> 172.21.15.2:0/1859903626 conn(0x7f353c072820 msgr2=0x7f353c072c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:12.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:12.638+0000 7f3541e00640 1 -- 172.21.15.2:0/1859903626 shutdown_connections 2024-09-10T08:47:12.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:12.638+0000 7f3541e00640 1 -- 172.21.15.2:0/1859903626 wait complete. 2024-09-10T08:47:12.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:12.639+0000 7f3541e00640 1 Processor -- start 2024-09-10T08:47:12.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:12.639+0000 7f3541e00640 1 -- start start 2024-09-10T08:47:12.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:12.640+0000 7f3541e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f353c073340 0x7f353c160f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:12.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:12.640+0000 7f3541e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f353c0b4c00 0x7f353c1e8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:12.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:12.640+0000 7f3541e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f353c161b20 0x7f353c1484f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:12.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:12.640+0000 7f3541e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f353c06f580 con 0x7f353c0b4c00 2024-09-10T08:47:12.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:12.640+0000 7f3541e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f353c0ae040 con 0x7f353c073340 2024-09-10T08:47:12.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:12.640+0000 7f3541e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f353c0b3d30 con 0x7f353c161b20 2024-09-10T08:47:12.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:12.641+0000 7f353aa00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f353c073340 0x7f353c160f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:12.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:12.641+0000 7f353a000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f353c0b4c00 0x7f353c1e8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:12.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:12.641+0000 7f353aa00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f353c073340 0x7f353c160f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.2:59534/0 (socket says 172.21.15.2:59534) 2024-09-10T08:47:12.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:12.641+0000 7f353aa00640 1 -- 172.21.15.2:0/2285416387 learned_addr learned my addr 172.21.15.2:0/2285416387 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:12.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:12.641+0000 7f353b400640 1 --2- 172.21.15.2:0/2285416387 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f353c161b20 0x7f353c1484f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:12.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:12.641+0000 7f353aa00640 1 -- 172.21.15.2:0/2285416387 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f353c161b20 msgr2=0x7f353c1484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:12.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:12.641+0000 7f353aa00640 1 --2- 172.21.15.2:0/2285416387 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f353c161b20 0x7f353c1484f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:12.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:12.641+0000 7f353aa00640 1 -- 172.21.15.2:0/2285416387 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f353c0b4c00 msgr2=0x7f353c1e8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:12.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:12.641+0000 7f353aa00640 1 --2- 172.21.15.2:0/2285416387 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f353c0b4c00 0x7f353c1e8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:12.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:12.641+0000 7f353aa00640 1 -- 172.21.15.2:0/2285416387 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f353c1e90e0 con 0x7f353c073340 2024-09-10T08:47:12.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:12.641+0000 7f353a000640 1 --2- 172.21.15.2:0/2285416387 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f353c0b4c00 0x7f353c1e8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:47:12.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:12.641+0000 7f353aa00640 1 --2- 172.21.15.2:0/2285416387 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f353c073340 0x7f353c160f20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f352c0098c0 tx=0x7f352c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:12.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:12.642+0000 7f3533400640 1 -- 172.21.15.2:0/2285416387 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f352c037040 con 0x7f353c073340 2024-09-10T08:47:12.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:12.642+0000 7f3533400640 1 -- 172.21.15.2:0/2285416387 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f352c030500 con 0x7f353c073340 2024-09-10T08:47:12.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:12.642+0000 7f3541e00640 1 -- 172.21.15.2:0/2285416387 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f353c1e93c0 con 0x7f353c073340 2024-09-10T08:47:12.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:12.642+0000 7f3533400640 1 -- 172.21.15.2:0/2285416387 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f352c0308d0 con 0x7f353c073340 2024-09-10T08:47:12.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:12.642+0000 7f3541e00640 1 -- 172.21.15.2:0/2285416387 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f353c15e3b0 con 0x7f353c073340 2024-09-10T08:47:12.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:12.643+0000 7f3541e00640 1 -- 172.21.15.2:0/2285416387 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f353c1e9590 con 0x7f353c073340 2024-09-10T08:47:12.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:12.644+0000 7f3533400640 1 -- 172.21.15.2:0/2285416387 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f352c044020 con 0x7f353c073340 2024-09-10T08:47:12.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:12.645+0000 7f3533400640 1 --2- 172.21.15.2:0/2285416387 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f351c06be30 0x7f351c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:12.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:12.645+0000 7f3533400640 1 -- 172.21.15.2:0/2285416387 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f352c0ab5a0 con 0x7f353c073340 2024-09-10T08:47:12.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:12.645+0000 7f353a000640 1 --2- 172.21.15.2:0/2285416387 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f351c06be30 0x7f351c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:12.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:12.646+0000 7f353a000640 1 --2- 172.21.15.2:0/2285416387 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f351c06be30 0x7f351c06e2f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f353c15fbd0 tx=0x7f3528009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:12.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:12.650+0000 7f3533400640 1 -- 172.21.15.2:0/2285416387 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f352c0796c0 con 0x7f353c073340 2024-09-10T08:47:12.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:12.874+0000 7f3541e00640 1 -- 172.21.15.2:0/2285416387 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f353c15e5f0 con 0x7f353c073340 2024-09-10T08:47:13.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.461+0000 7f3533400640 1 -- 172.21.15.2:0/2285416387 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) ==== 122+0+0 (secure 0 0 0) 0x7f353c15e5f0 con 0x7f353c073340 2024-09-10T08:47:13.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.464+0000 7f3541e00640 1 -- 172.21.15.2:0/2285416387 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f351c06be30 msgr2=0x7f351c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:13.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.464+0000 7f3541e00640 1 --2- 172.21.15.2:0/2285416387 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f351c06be30 0x7f351c06e2f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f353c15fbd0 tx=0x7f3528009040 comp rx=0 tx=0).stop 2024-09-10T08:47:13.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.464+0000 7f3541e00640 1 -- 172.21.15.2:0/2285416387 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f353c073340 msgr2=0x7f353c160f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:13.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.464+0000 7f3541e00640 1 --2- 172.21.15.2:0/2285416387 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f353c073340 0x7f353c160f20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f352c0098c0 tx=0x7f352c0046c0 comp rx=0 tx=0).stop 2024-09-10T08:47:13.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.464+0000 7f3541e00640 1 -- 172.21.15.2:0/2285416387 shutdown_connections 2024-09-10T08:47:13.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.464+0000 7f3541e00640 1 --2- 172.21.15.2:0/2285416387 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f351c06be30 0x7f351c06e2f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:13.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.464+0000 7f3541e00640 1 --2- 172.21.15.2:0/2285416387 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f353c161b20 0x7f353c1484f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:13.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.464+0000 7f3541e00640 1 --2- 172.21.15.2:0/2285416387 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f353c0b4c00 0x7f353c1e8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:13.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.464+0000 7f3541e00640 1 --2- 172.21.15.2:0/2285416387 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f353c073340 0x7f353c160f20 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:13.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.464+0000 7f3541e00640 1 -- 172.21.15.2:0/2285416387 >> 172.21.15.2:0/2285416387 conn(0x7f353c072820 msgr2=0x7f353c0ae2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:13.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.464+0000 7f3541e00640 1 -- 172.21.15.2:0/2285416387 shutdown_connections 2024-09-10T08:47:13.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.464+0000 7f3541e00640 1 -- 172.21.15.2:0/2285416387 wait complete. 2024-09-10T08:47:13.483 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-10T08:47:13.483 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:47:13.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.642+0000 7f7872600640 1 Processor -- start 2024-09-10T08:47:13.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.642+0000 7f7872600640 1 -- start start 2024-09-10T08:47:13.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.643+0000 7f7872600640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f786c06ce60 0x7f786c0d2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:13.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.643+0000 7f7872600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f786c0d30e0 0x7f786c0cf7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:13.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.643+0000 7f7872600640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f786c0d1120 con 0x7f786c15e6b0 2024-09-10T08:47:13.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.643+0000 7f7872600640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f786c0d1a50 con 0x7f786c06ce60 2024-09-10T08:47:13.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.643+0000 7f7872600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f786c0d1400 con 0x7f786c0d30e0 2024-09-10T08:47:13.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.643+0000 7f786b400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f786c15e6b0 0x7f786c0d4cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:43324/0 (socket says 172.21.15.2:43324) 2024-09-10T08:47:13.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.643+0000 7f786b400640 1 -- 172.21.15.2:0/2101033977 learned_addr learned my addr 172.21.15.2:0/2101033977 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:47:13.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.644+0000 7f786aa00640 1 --2- 172.21.15.2:0/2101033977 >> v2:172.21.15.2:3300/0 conn(0x7f786c06ce60 0x7f786c0d2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:13.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.644+0000 7f786be00640 1 --2- 172.21.15.2:0/2101033977 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f786c0d30e0 0x7f786c0cf7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:13.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.644+0000 7f786a000640 1 -- 172.21.15.2:0/2101033977 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 796829532 0 0) 0x7f786c0d1120 con 0x7f786c15e6b0 2024-09-10T08:47:13.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.644+0000 7f786a000640 1 -- 172.21.15.2:0/2101033977 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7850003520 con 0x7f786c15e6b0 2024-09-10T08:47:13.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.644+0000 7f786aa00640 1 -- 172.21.15.2:0/2101033977 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f786c0d30e0 msgr2=0x7f786c0cf7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:13.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.644+0000 7f786aa00640 1 --2- 172.21.15.2:0/2101033977 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f786c0d30e0 0x7f786c0cf7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:13.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.644+0000 7f786aa00640 1 -- 172.21.15.2:0/2101033977 >> v1:172.21.15.2:6789/0 conn(0x7f786c15e6b0 legacy=0x7f786c0d4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:13.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.644+0000 7f786aa00640 1 -- 172.21.15.2:0/2101033977 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f786c0d16e0 con 0x7f786c06ce60 2024-09-10T08:47:13.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.645+0000 7f786aa00640 1 --2- 172.21.15.2:0/2101033977 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f786c06ce60 0x7f786c0d2ba0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f78580097a0 tx=0x7f785802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ae98af8499fb297 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:13.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.645+0000 7f786a000640 1 -- 172.21.15.2:0/2101033977 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7858037070 con 0x7f786c06ce60 2024-09-10T08:47:13.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.645+0000 7f786a000640 1 -- 172.21.15.2:0/2101033977 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f785802ae50 con 0x7f786c06ce60 2024-09-10T08:47:13.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.645+0000 7f786a000640 1 -- 172.21.15.2:0/2101033977 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7858032660 con 0x7f786c06ce60 2024-09-10T08:47:13.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.646+0000 7f7872600640 1 -- 172.21.15.2:0/2101033977 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f786c06ce60 msgr2=0x7f786c0d2ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:13.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.646+0000 7f7872600640 1 --2- 172.21.15.2:0/2101033977 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f786c06ce60 0x7f786c0d2ba0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f78580097a0 tx=0x7f785802a100 comp rx=0 tx=0).stop 2024-09-10T08:47:13.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.646+0000 7f7872600640 1 -- 172.21.15.2:0/2101033977 shutdown_connections 2024-09-10T08:47:13.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.646+0000 7f7872600640 1 --2- 172.21.15.2:0/2101033977 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f786c0d30e0 0x7f786c0cf7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:13.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.646+0000 7f7872600640 1 --2- 172.21.15.2:0/2101033977 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f786c06ce60 0x7f786c0d2ba0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:13.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.646+0000 7f7872600640 1 -- 172.21.15.2:0/2101033977 >> 172.21.15.2:0/2101033977 conn(0x7f786c08bfd0 msgr2=0x7f786c0d45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:13.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.646+0000 7f7872600640 1 -- 172.21.15.2:0/2101033977 shutdown_connections 2024-09-10T08:47:13.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.646+0000 7f7872600640 1 -- 172.21.15.2:0/2101033977 wait complete. 2024-09-10T08:47:13.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.648+0000 7f7872600640 1 Processor -- start 2024-09-10T08:47:13.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.648+0000 7f7872600640 1 -- start start 2024-09-10T08:47:13.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.649+0000 7f7872600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f786c06ce60 0x7f786c157cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:13.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.649+0000 7f7872600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f786c0d30e0 0x7f786c158600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:13.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.649+0000 7f7872600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f786c15e6b0 0x7f786c160150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:13.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.649+0000 7f7872600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f786c0d53e0 con 0x7f786c06ce60 2024-09-10T08:47:13.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.649+0000 7f7872600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f786c0cf210 con 0x7f786c15e6b0 2024-09-10T08:47:13.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.649+0000 7f7872600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f786c0d0db0 con 0x7f786c0d30e0 2024-09-10T08:47:13.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.649+0000 7f786b400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f786c06ce60 0x7f786c157cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:13.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.649+0000 7f786b400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f786c06ce60 0x7f786c157cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40872/0 (socket says 172.21.15.2:40872) 2024-09-10T08:47:13.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.649+0000 7f786b400640 1 -- 172.21.15.2:0/1861827660 learned_addr learned my addr 172.21.15.2:0/1861827660 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:13.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.649+0000 7f786b400640 1 -- 172.21.15.2:0/1861827660 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f786c0d30e0 msgr2=0x7f786c158600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:13.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.649+0000 7f786b400640 1 --2- 172.21.15.2:0/1861827660 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f786c0d30e0 0x7f786c158600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:13.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.649+0000 7f786b400640 1 -- 172.21.15.2:0/1861827660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f786c15e6b0 msgr2=0x7f786c160150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:13.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.649+0000 7f786b400640 1 --2- 172.21.15.2:0/1861827660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f786c15e6b0 0x7f786c160150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:13.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.649+0000 7f786b400640 1 -- 172.21.15.2:0/1861827660 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f786c0b5070 con 0x7f786c06ce60 2024-09-10T08:47:13.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.650+0000 7f786b400640 1 --2- 172.21.15.2:0/1861827660 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f786c06ce60 0x7f786c157cb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f785c00c430 tx=0x7f785c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:13.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.650+0000 7f7863400640 1 -- 172.21.15.2:0/1861827660 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f785c017070 con 0x7f786c06ce60 2024-09-10T08:47:13.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.650+0000 7f7863400640 1 -- 172.21.15.2:0/1861827660 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f785c005ce0 con 0x7f786c06ce60 2024-09-10T08:47:13.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.650+0000 7f7863400640 1 -- 172.21.15.2:0/1861827660 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f785c007310 con 0x7f786c06ce60 2024-09-10T08:47:13.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.650+0000 7f7872600640 1 -- 172.21.15.2:0/1861827660 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f786c0b5350 con 0x7f786c06ce60 2024-09-10T08:47:13.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.650+0000 7f7872600640 1 -- 172.21.15.2:0/1861827660 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f786c0b5910 con 0x7f786c06ce60 2024-09-10T08:47:13.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.651+0000 7f7872600640 1 -- 172.21.15.2:0/1861827660 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f786c0d1d20 con 0x7f786c06ce60 2024-09-10T08:47:13.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.652+0000 7f7863400640 1 -- 172.21.15.2:0/1861827660 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f785c01a070 con 0x7f786c06ce60 2024-09-10T08:47:13.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.653+0000 7f7863400640 1 --2- 172.21.15.2:0/1861827660 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f784c06be30 0x7f784c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:13.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.653+0000 7f7863400640 1 -- 172.21.15.2:0/1861827660 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f785c08a6a0 con 0x7f786c06ce60 2024-09-10T08:47:13.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.653+0000 7f786aa00640 1 --2- 172.21.15.2:0/1861827660 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f784c06be30 0x7f784c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:13.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.654+0000 7f786aa00640 1 --2- 172.21.15.2:0/1861827660 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f784c06be30 0x7f784c06e2f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7858034000 tx=0x7f785802c000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:13.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.657+0000 7f7863400640 1 -- 172.21.15.2:0/1861827660 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f785c058d30 con 0x7f786c06ce60 2024-09-10T08:47:13.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.880+0000 7f7872600640 1 -- 172.21.15.2:0/1861827660 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f786c0b2c90 con 0x7f786c06ce60 2024-09-10T08:47:13.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.880+0000 7f7863400640 1 -- 172.21.15.2:0/1861827660 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5216 (secure 0 0 0) 0x7f785c058630 con 0x7f786c06ce60 2024-09-10T08:47:13.882 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:47:13.882 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":9,"btime":"2024-09-10T08:47:13:450812+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/4081738683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":4081738683},{"type":"v1","addr":"172.21.15.2:6835","nonce":4081738683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1478106484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":1478106484},{"type":"v1","addr":"172.21.15.155:6837","nonce":1478106484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/800933941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":800933941},{"type":"v1","addr":"172.21.15.2:6834","nonce":800933941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:46:51.181258+0000","modified":"2024-09-10T08:47:12.877562+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6836/2996773231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2996773231},{"type":"v1","addr":"172.21.15.155:6836","nonce":2996773231}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":1}]} 2024-09-10T08:47:13.882 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 9 2024-09-10T08:47:13.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.882+0000 7f7872600640 1 -- 172.21.15.2:0/1861827660 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f784c06be30 msgr2=0x7f784c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:13.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.882+0000 7f7872600640 1 --2- 172.21.15.2:0/1861827660 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f784c06be30 0x7f784c06e2f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7858034000 tx=0x7f785802c000 comp rx=0 tx=0).stop 2024-09-10T08:47:13.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.883+0000 7f7872600640 1 -- 172.21.15.2:0/1861827660 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f786c06ce60 msgr2=0x7f786c157cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:13.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.883+0000 7f7872600640 1 --2- 172.21.15.2:0/1861827660 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f786c06ce60 0x7f786c157cb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f785c00c430 tx=0x7f785c00c8f0 comp rx=0 tx=0).stop 2024-09-10T08:47:13.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.883+0000 7f7872600640 1 -- 172.21.15.2:0/1861827660 shutdown_connections 2024-09-10T08:47:13.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.883+0000 7f7872600640 1 --2- 172.21.15.2:0/1861827660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f786c15e6b0 0x7f786c160150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:13.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.883+0000 7f7872600640 1 --2- 172.21.15.2:0/1861827660 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f784c06be30 0x7f784c06e2f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:13.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.883+0000 7f7872600640 1 --2- 172.21.15.2:0/1861827660 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f786c0d30e0 0x7f786c158600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:13.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.883+0000 7f7872600640 1 --2- 172.21.15.2:0/1861827660 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f786c06ce60 0x7f786c157cb0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:13.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.883+0000 7f7872600640 1 -- 172.21.15.2:0/1861827660 >> 172.21.15.2:0/1861827660 conn(0x7f786c08bfd0 msgr2=0x7f786c0b73f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:13.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.883+0000 7f7872600640 1 -- 172.21.15.2:0/1861827660 shutdown_connections 2024-09-10T08:47:13.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:13.883+0000 7f7872600640 1 -- 172.21.15.2:0/1861827660 wait complete. 2024-09-10T08:47:13.900 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:47:14.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.055+0000 7fa613e00640 1 Processor -- start 2024-09-10T08:47:14.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.055+0000 7fa613e00640 1 -- start start 2024-09-10T08:47:14.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.057+0000 7fa613e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa60c144250 0x7fa60c0cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:14.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.057+0000 7fa613e00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa60c06f540 con 0x7fa60c0cd480 2024-09-10T08:47:14.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.057+0000 7fa613e00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa60c06f820 con 0x7fa60c144c90 2024-09-10T08:47:14.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.057+0000 7fa613e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa60c06fb00 con 0x7fa60c144250 2024-09-10T08:47:14.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.057+0000 7fa611e00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fa60c0cd480 0x7fa60c0ce420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:43332/0 (socket says 172.21.15.2:43332) 2024-09-10T08:47:14.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.057+0000 7fa611e00640 1 -- 172.21.15.2:0/4039903160 learned_addr learned my addr 172.21.15.2:0/4039903160 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:47:14.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.057+0000 7fa611400640 1 --2- 172.21.15.2:0/4039903160 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa60c144250 0x7fa60c0cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:14.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.057+0000 7fa60be00640 1 -- 172.21.15.2:0/4039903160 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1116091661 0 0) 0x7fa60c06f540 con 0x7fa60c0cd480 2024-09-10T08:47:14.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.057+0000 7fa60be00640 1 -- 172.21.15.2:0/4039903160 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa5f4003520 con 0x7fa60c0cd480 2024-09-10T08:47:14.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.057+0000 7fa60be00640 1 -- 172.21.15.2:0/4039903160 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 72905810 0 0) 0x7fa60c06f820 con 0x7fa60c144c90 2024-09-10T08:47:14.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.058+0000 7fa60be00640 1 -- 172.21.15.2:0/4039903160 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa60c06f540 con 0x7fa60c144c90 2024-09-10T08:47:14.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.058+0000 7fa611400640 1 -- 172.21.15.2:0/4039903160 >> v1:172.21.15.155:6789/0 conn(0x7fa60c144c90 legacy=0x7fa60c0ccd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:14.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.058+0000 7fa611400640 1 -- 172.21.15.2:0/4039903160 >> v1:172.21.15.2:6789/0 conn(0x7fa60c0cd480 legacy=0x7fa60c0ce420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:14.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.058+0000 7fa611400640 1 -- 172.21.15.2:0/4039903160 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa60c06fde0 con 0x7fa60c144250 2024-09-10T08:47:14.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.059+0000 7fa611400640 1 --2- 172.21.15.2:0/4039903160 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa60c144250 0x7fa60c0cf8d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa6000097d0 tx=0x7fa60002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55068a71ecbdb8c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:14.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.059+0000 7fa60be00640 1 -- 172.21.15.2:0/4039903160 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa600037070 con 0x7fa60c144250 2024-09-10T08:47:14.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.059+0000 7fa60be00640 1 -- 172.21.15.2:0/4039903160 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa600032440 con 0x7fa60c144250 2024-09-10T08:47:14.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.059+0000 7fa60be00640 1 -- 172.21.15.2:0/4039903160 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa600032810 con 0x7fa60c144250 2024-09-10T08:47:14.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.060+0000 7fa613e00640 1 -- 172.21.15.2:0/4039903160 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa60c144250 msgr2=0x7fa60c0cf8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:14.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.060+0000 7fa613e00640 1 --2- 172.21.15.2:0/4039903160 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa60c144250 0x7fa60c0cf8d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa6000097d0 tx=0x7fa60002a210 comp rx=0 tx=0).stop 2024-09-10T08:47:14.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.060+0000 7fa613e00640 1 -- 172.21.15.2:0/4039903160 shutdown_connections 2024-09-10T08:47:14.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.060+0000 7fa613e00640 1 --2- 172.21.15.2:0/4039903160 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa60c144250 0x7fa60c0cf8d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:14.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.060+0000 7fa613e00640 1 -- 172.21.15.2:0/4039903160 >> 172.21.15.2:0/4039903160 conn(0x7fa60c06bc10 msgr2=0x7fa60c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:14.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.060+0000 7fa613e00640 1 -- 172.21.15.2:0/4039903160 shutdown_connections 2024-09-10T08:47:14.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.060+0000 7fa613e00640 1 -- 172.21.15.2:0/4039903160 wait complete. 2024-09-10T08:47:14.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.061+0000 7fa613e00640 1 Processor -- start 2024-09-10T08:47:14.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.062+0000 7fa613e00640 1 -- start start 2024-09-10T08:47:14.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.062+0000 7fa613e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa60c0cd480 0x7fa60c0b1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:14.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.062+0000 7fa613e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa60c144250 0x7fa60c15b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:14.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.063+0000 7fa613e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa60c144c90 0x7fa60c0b0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:14.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.063+0000 7fa613e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa60c0b3390 con 0x7fa60c144250 2024-09-10T08:47:14.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.063+0000 7fa613e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa60c0cfe10 con 0x7fa60c144c90 2024-09-10T08:47:14.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.063+0000 7fa613e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa60c0ceb30 con 0x7fa60c0cd480 2024-09-10T08:47:14.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.063+0000 7fa610a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa60c144250 0x7fa60c15b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:14.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.063+0000 7fa610a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa60c144250 0x7fa60c15b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40876/0 (socket says 172.21.15.2:40876) 2024-09-10T08:47:14.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.063+0000 7fa610a00640 1 -- 172.21.15.2:0/3300412500 learned_addr learned my addr 172.21.15.2:0/3300412500 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:14.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.063+0000 7fa611400640 1 --2- 172.21.15.2:0/3300412500 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa60c0cd480 0x7fa60c0b1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:14.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.063+0000 7fa611e00640 1 --2- 172.21.15.2:0/3300412500 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa60c144c90 0x7fa60c0b0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:14.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.063+0000 7fa610a00640 1 -- 172.21.15.2:0/3300412500 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa60c0cd480 msgr2=0x7fa60c0b1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:14.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.063+0000 7fa610a00640 1 --2- 172.21.15.2:0/3300412500 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa60c0cd480 0x7fa60c0b1730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:14.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.063+0000 7fa610a00640 1 -- 172.21.15.2:0/3300412500 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa60c144c90 msgr2=0x7fa60c0b0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:14.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.063+0000 7fa610a00640 1 --2- 172.21.15.2:0/3300412500 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa60c144c90 0x7fa60c0b0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:14.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.063+0000 7fa610a00640 1 -- 172.21.15.2:0/3300412500 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa60c0b1d10 con 0x7fa60c144250 2024-09-10T08:47:14.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.064+0000 7fa610a00640 1 --2- 172.21.15.2:0/3300412500 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa60c144250 0x7fa60c15b000 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa5f8001eb0 tx=0x7fa5f800c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:14.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.064+0000 7fa609600640 1 -- 172.21.15.2:0/3300412500 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f8017070 con 0x7fa60c144250 2024-09-10T08:47:14.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.064+0000 7fa609600640 1 -- 172.21.15.2:0/3300412500 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5f80052d0 con 0x7fa60c144250 2024-09-10T08:47:14.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.064+0000 7fa609600640 1 -- 172.21.15.2:0/3300412500 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f8003810 con 0x7fa60c144250 2024-09-10T08:47:14.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.064+0000 7fa613e00640 1 -- 172.21.15.2:0/3300412500 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa60c0b1ff0 con 0x7fa60c144250 2024-09-10T08:47:14.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.064+0000 7fa613e00640 1 -- 172.21.15.2:0/3300412500 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa60c0b25b0 con 0x7fa60c144250 2024-09-10T08:47:14.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.065+0000 7fa613e00640 1 -- 172.21.15.2:0/3300412500 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa60c0cf8d0 con 0x7fa60c144250 2024-09-10T08:47:14.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.066+0000 7fa609600640 1 -- 172.21.15.2:0/3300412500 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa5f801a070 con 0x7fa60c144250 2024-09-10T08:47:14.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.067+0000 7fa609600640 1 --2- 172.21.15.2:0/3300412500 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fa5ec06be30 0x7fa5ec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:14.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.067+0000 7fa609600640 1 -- 172.21.15.2:0/3300412500 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fa5f808a580 con 0x7fa60c144250 2024-09-10T08:47:14.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.067+0000 7fa611400640 1 --2- 172.21.15.2:0/3300412500 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fa5ec06be30 0x7fa5ec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:14.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.068+0000 7fa611400640 1 --2- 172.21.15.2:0/3300412500 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fa5ec06be30 0x7fa5ec06e2f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa600034000 tx=0x7fa60002e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:14.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.071+0000 7fa609600640 1 -- 172.21.15.2:0/3300412500 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa5f8058470 con 0x7fa60c144250 2024-09-10T08:47:14.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.255+0000 7fa613e00640 1 -- 172.21.15.2:0/3300412500 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa60c0cc970 con 0x7fa60c144250 2024-09-10T08:47:14.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.257+0000 7fa609600640 1 -- 172.21.15.2:0/3300412500 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18538 (secure 0 0 0) 0x7fa5f805c770 con 0x7fa60c144250 2024-09-10T08:47:14.258 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:47:14.258 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":24,"fsid":"f20a15a7-d363-4d44-98cb-4f4f466b52b8","created":"2024-09-10T08:46:26.481619+0000","modified":"2024-09-10T08:46:56.240092+0000","last_up_change":"2024-09-10T08:46:39.323912+0000","last_in_change":"2024-09-10T08:46:29.499894+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:46:39.426180+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:46:49.214595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T08:46:50.168313+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T08:46:53.833162+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c90be333-506b-46d1-b00a-10d089a84776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6822","nonce":298678486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6823","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6826","nonce":298678486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6831","nonce":298678486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6829","nonce":298678486}]},"public_addr":"172.21.15.2:6822/298678486","cluster_addr":"172.21.15.2:6826/298678486","heartbeat_back_addr":"172.21.15.2:6831/298678486","heartbeat_front_addr":"172.21.15.2:6829/298678486","state":["exists","up"]},{"osd":1,"uuid":"3f8bdde8-6cd3-4112-8939-a876191c7368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6809","nonce":1619566025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6811","nonce":1619566025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6815","nonce":1619566025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6813","nonce":1619566025}]},"public_addr":"172.21.15.2:6809/1619566025","cluster_addr":"172.21.15.2:6811/1619566025","heartbeat_back_addr":"172.21.15.2:6815/1619566025","heartbeat_front_addr":"172.21.15.2:6813/1619566025","state":["exists","up"]},{"osd":2,"uuid":"3835f5ab-ed3a-4f46-ae6c-f0edf21708d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6801","nonce":3992427579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6803","nonce":3992427579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6807","nonce":3992427579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6805","nonce":3992427579}]},"public_addr":"172.21.15.2:6801/3992427579","cluster_addr":"172.21.15.2:6803/3992427579","heartbeat_back_addr":"172.21.15.2:6807/3992427579","heartbeat_front_addr":"172.21.15.2:6805/3992427579","state":["exists","up"]},{"osd":3,"uuid":"add6ad27-b411-4a82-9622-b0c1c1782cf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6817","nonce":1270626884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6819","nonce":1270626884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6827","nonce":1270626884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6824","nonce":1270626884}]},"public_addr":"172.21.15.2:6817/1270626884","cluster_addr":"172.21.15.2:6819/1270626884","heartbeat_back_addr":"172.21.15.2:6827/1270626884","heartbeat_front_addr":"172.21.15.2:6824/1270626884","state":["exists","up"]},{"osd":4,"uuid":"c7b642f4-8bd2-4262-9a82-ee1061cfab7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6803","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6806","nonce":553254873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6813","nonce":553254873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6822","nonce":553254873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6819","nonce":553254873}]},"public_addr":"172.21.15.155:6806/553254873","cluster_addr":"172.21.15.155:6813/553254873","heartbeat_back_addr":"172.21.15.155:6822/553254873","heartbeat_front_addr":"172.21.15.155:6819/553254873","state":["exists","up"]},{"osd":5,"uuid":"fb53289a-419f-46d8-9e3a-384ac529dc57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6805","nonce":2107688472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6811","nonce":2107688472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6823","nonce":2107688472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6817","nonce":2107688472}]},"public_addr":"172.21.15.155:6805/2107688472","cluster_addr":"172.21.15.155:6811/2107688472","heartbeat_back_addr":"172.21.15.155:6823/2107688472","heartbeat_front_addr":"172.21.15.155:6817/2107688472","state":["exists","up"]},{"osd":6,"uuid":"3f9ddd54-ede4-4565-aff6-ae1c07e7c678","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6825","nonce":944542383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6827","nonce":944542383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6831","nonce":944542383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6829","nonce":944542383}]},"public_addr":"172.21.15.155:6825/944542383","cluster_addr":"172.21.15.155:6827/944542383","heartbeat_back_addr":"172.21.15.155:6831/944542383","heartbeat_front_addr":"172.21.15.155:6829/944542383","state":["exists","up"]},{"osd":7,"uuid":"328d0681-eef4-4556-94e1-9745bd4adbe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6801","nonce":2220093913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6807","nonce":2220093913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6818","nonce":2220093913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6812","nonce":2220093913}]},"public_addr":"172.21.15.155:6801/2220093913","cluster_addr":"172.21.15.155:6807/2220093913","heartbeat_back_addr":"172.21.15.155:6818/2220093913","heartbeat_front_addr":"172.21.15.155:6812/2220093913","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.052980+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.104550+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.025661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:35.784354+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:35.863363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.322312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.100890+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:35.763584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:47:14.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.259+0000 7fa613e00640 1 -- 172.21.15.2:0/3300412500 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fa5ec06be30 msgr2=0x7fa5ec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:14.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.259+0000 7fa613e00640 1 --2- 172.21.15.2:0/3300412500 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fa5ec06be30 0x7fa5ec06e2f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa600034000 tx=0x7fa60002e000 comp rx=0 tx=0).stop 2024-09-10T08:47:14.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.259+0000 7fa613e00640 1 -- 172.21.15.2:0/3300412500 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa60c144250 msgr2=0x7fa60c15b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:14.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.259+0000 7fa613e00640 1 --2- 172.21.15.2:0/3300412500 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa60c144250 0x7fa60c15b000 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa5f8001eb0 tx=0x7fa5f800c820 comp rx=0 tx=0).stop 2024-09-10T08:47:14.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.259+0000 7fa613e00640 1 -- 172.21.15.2:0/3300412500 shutdown_connections 2024-09-10T08:47:14.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.259+0000 7fa613e00640 1 --2- 172.21.15.2:0/3300412500 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa60c144c90 0x7fa60c0b0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:14.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.259+0000 7fa613e00640 1 --2- 172.21.15.2:0/3300412500 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa60c144250 0x7fa60c15b000 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:14.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.259+0000 7fa613e00640 1 --2- 172.21.15.2:0/3300412500 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fa5ec06be30 0x7fa5ec06e2f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:14.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.259+0000 7fa613e00640 1 --2- 172.21.15.2:0/3300412500 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa60c0cd480 0x7fa60c0b1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:14.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.259+0000 7fa613e00640 1 -- 172.21.15.2:0/3300412500 >> 172.21.15.2:0/3300412500 conn(0x7fa60c06bc10 msgr2=0x7fa60c1406a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:14.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.259+0000 7fa613e00640 1 -- 172.21.15.2:0/3300412500 shutdown_connections 2024-09-10T08:47:14.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.259+0000 7fa613e00640 1 -- 172.21.15.2:0/3300412500 wait complete. 2024-09-10T08:47:14.276 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T08:47:14.276 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:47:14.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.432+0000 7f8487e00640 1 Processor -- start 2024-09-10T08:47:14.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.432+0000 7f8487e00640 1 -- start start 2024-09-10T08:47:14.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.433+0000 7f8487e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f848815e4c0 0x7f84880d2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:14.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.433+0000 7f8487e00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84880d4180 con 0x7f84880cebc0 2024-09-10T08:47:14.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.433+0000 7f8487e00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84880d30e0 con 0x7f84880b64f0 2024-09-10T08:47:14.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.433+0000 7f8487e00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f84880d33c0 con 0x7f848815e4c0 2024-09-10T08:47:14.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.433+0000 7f8486a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f848815e4c0 0x7f84880d2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:14.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.433+0000 7f8486000640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f84880cebc0 0x7f84880b5de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:43340/0 (socket says 172.21.15.2:43340) 2024-09-10T08:47:14.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.433+0000 7f8486000640 1 -- 172.21.15.2:0/704826191 learned_addr learned my addr 172.21.15.2:0/704826191 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:47:14.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.434+0000 7f8486a00640 1 -- 172.21.15.2:0/704826191 >> v1:172.21.15.155:6789/0 conn(0x7f84880b64f0 legacy=0x7f84880b7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:14.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.434+0000 7f8486a00640 1 -- 172.21.15.2:0/704826191 >> v1:172.21.15.2:6789/0 conn(0x7f84880cebc0 legacy=0x7f84880b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:14.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.434+0000 7f8486a00640 1 -- 172.21.15.2:0/704826191 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84880d36a0 con 0x7f848815e4c0 2024-09-10T08:47:14.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.434+0000 7f8485600640 1 -- 172.21.15.2:0/704826191 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1223263663 0 0) 0x7f8474001110 con 0x7f84880cebc0 2024-09-10T08:47:14.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.435+0000 7f8486a00640 1 --2- 172.21.15.2:0/704826191 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f848815e4c0 0x7f84880d2890 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f84780097a0 tx=0x7f847802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9173ba3643fb967 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:14.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.435+0000 7f8485600640 1 -- 172.21.15.2:0/704826191 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8478037070 con 0x7f848815e4c0 2024-09-10T08:47:14.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.435+0000 7f8485600640 1 -- 172.21.15.2:0/704826191 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8478032440 con 0x7f848815e4c0 2024-09-10T08:47:14.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.435+0000 7f8485600640 1 -- 172.21.15.2:0/704826191 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8478032810 con 0x7f848815e4c0 2024-09-10T08:47:14.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.436+0000 7f8487e00640 1 -- 172.21.15.2:0/704826191 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f848815e4c0 msgr2=0x7f84880d2890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:14.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.436+0000 7f8487e00640 1 --2- 172.21.15.2:0/704826191 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f848815e4c0 0x7f84880d2890 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f84780097a0 tx=0x7f847802a1a0 comp rx=0 tx=0).stop 2024-09-10T08:47:14.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.436+0000 7f8487e00640 1 -- 172.21.15.2:0/704826191 shutdown_connections 2024-09-10T08:47:14.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.436+0000 7f8487e00640 1 --2- 172.21.15.2:0/704826191 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f848815e4c0 0x7f84880d2890 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:14.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.436+0000 7f8487e00640 1 -- 172.21.15.2:0/704826191 >> 172.21.15.2:0/704826191 conn(0x7f84880d0de0 msgr2=0x7f84880d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:14.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.436+0000 7f8487e00640 1 -- 172.21.15.2:0/704826191 shutdown_connections 2024-09-10T08:47:14.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.436+0000 7f8487e00640 1 -- 172.21.15.2:0/704826191 wait complete. 2024-09-10T08:47:14.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.437+0000 7f8487e00640 1 Processor -- start 2024-09-10T08:47:14.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.438+0000 7f8487e00640 1 -- start start 2024-09-10T08:47:14.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.438+0000 7f8487e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84880b64f0 0x7f84880b8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:14.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.438+0000 7f8487e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84880cebc0 0x7f848815ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:14.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.438+0000 7f8487e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f848815e4c0 0x7f848815b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:14.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.438+0000 7f8487e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f84880d2dd0 con 0x7f848815e4c0 2024-09-10T08:47:14.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.438+0000 7f8487e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f84880d3c60 con 0x7f84880cebc0 2024-09-10T08:47:14.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.438+0000 7f8487e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f848815e8a0 con 0x7f84880b64f0 2024-09-10T08:47:14.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.439+0000 7f8487400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f848815e4c0 0x7f848815b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:14.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.439+0000 7f8487400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f848815e4c0 0x7f848815b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40894/0 (socket says 172.21.15.2:40894) 2024-09-10T08:47:14.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.439+0000 7f8487400640 1 -- 172.21.15.2:0/3357759314 learned_addr learned my addr 172.21.15.2:0/3357759314 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:14.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.439+0000 7f8486a00640 1 --2- 172.21.15.2:0/3357759314 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84880b64f0 0x7f84880b8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:14.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.439+0000 7f8487400640 1 -- 172.21.15.2:0/3357759314 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84880b64f0 msgr2=0x7f84880b8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:14.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.439+0000 7f8486000640 1 --2- 172.21.15.2:0/3357759314 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84880cebc0 0x7f848815ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:14.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.439+0000 7f8487400640 1 --2- 172.21.15.2:0/3357759314 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84880b64f0 0x7f84880b8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:14.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.439+0000 7f8487400640 1 -- 172.21.15.2:0/3357759314 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84880cebc0 msgr2=0x7f848815ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:14.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.439+0000 7f8487400640 1 --2- 172.21.15.2:0/3357759314 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84880cebc0 0x7f848815ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:14.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.439+0000 7f8487400640 1 -- 172.21.15.2:0/3357759314 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84880c9080 con 0x7f848815e4c0 2024-09-10T08:47:14.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.439+0000 7f8486a00640 1 --2- 172.21.15.2:0/3357759314 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84880b64f0 0x7f84880b8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:47:14.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.439+0000 7f8487400640 1 --2- 172.21.15.2:0/3357759314 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f848815e4c0 0x7f848815b1b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f848000c730 tx=0x7f848000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:14.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.440+0000 7f847ea00640 1 -- 172.21.15.2:0/3357759314 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8480003b70 con 0x7f848815e4c0 2024-09-10T08:47:14.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.440+0000 7f847ea00640 1 -- 172.21.15.2:0/3357759314 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8480003d30 con 0x7f848815e4c0 2024-09-10T08:47:14.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.440+0000 7f847ea00640 1 -- 172.21.15.2:0/3357759314 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8480005310 con 0x7f848815e4c0 2024-09-10T08:47:14.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.440+0000 7f8487e00640 1 -- 172.21.15.2:0/3357759314 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84880c9360 con 0x7f848815e4c0 2024-09-10T08:47:14.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.440+0000 7f8487e00640 1 -- 172.21.15.2:0/3357759314 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84880c9920 con 0x7f848815e4c0 2024-09-10T08:47:14.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.441+0000 7f8487e00640 1 -- 172.21.15.2:0/3357759314 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84880d2890 con 0x7f848815e4c0 2024-09-10T08:47:14.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.442+0000 7f847ea00640 1 -- 172.21.15.2:0/3357759314 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f84800056c0 con 0x7f848815e4c0 2024-09-10T08:47:14.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.443+0000 7f847ea00640 1 --2- 172.21.15.2:0/3357759314 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f846806be30 0x7f846806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:14.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.443+0000 7f847ea00640 1 -- 172.21.15.2:0/3357759314 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f848008b260 con 0x7f848815e4c0 2024-09-10T08:47:14.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.443+0000 7f8486a00640 1 --2- 172.21.15.2:0/3357759314 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f846806be30 0x7f846806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:14.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.444+0000 7f8486a00640 1 --2- 172.21.15.2:0/3357759314 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f846806be30 0x7f846806e2f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8478034000 tx=0x7f847802e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:14.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.448+0000 7f847ea00640 1 -- 172.21.15.2:0/3357759314 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f84800598c0 con 0x7f848815e4c0 2024-09-10T08:47:14.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.629+0000 7f8487e00640 1 -- 172.21.15.2:0/3357759314 --> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f84880b7240 con 0x7f846806be30 2024-09-10T08:47:14.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.640+0000 7f847ea00640 1 -- 172.21.15.2:0/3357759314 <== mgr.4099 v2:172.21.15.155:6832/2611418382 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f84880b7240 con 0x7f846806be30 2024-09-10T08:47:14.645 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:47:14.647 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-10T08:47:14.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.644+0000 7f8487e00640 1 -- 172.21.15.2:0/3357759314 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f846806be30 msgr2=0x7f846806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:14.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.644+0000 7f8487e00640 1 --2- 172.21.15.2:0/3357759314 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f846806be30 0x7f846806e2f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8478034000 tx=0x7f847802e000 comp rx=0 tx=0).stop 2024-09-10T08:47:14.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.644+0000 7f8487e00640 1 -- 172.21.15.2:0/3357759314 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f848815e4c0 msgr2=0x7f848815b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:14.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.644+0000 7f8487e00640 1 --2- 172.21.15.2:0/3357759314 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f848815e4c0 0x7f848815b1b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f848000c730 tx=0x7f848000cbf0 comp rx=0 tx=0).stop 2024-09-10T08:47:14.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.644+0000 7f8487e00640 1 -- 172.21.15.2:0/3357759314 shutdown_connections 2024-09-10T08:47:14.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.644+0000 7f8487e00640 1 --2- 172.21.15.2:0/3357759314 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f848815e4c0 0x7f848815b1b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:14.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.644+0000 7f8487e00640 1 --2- 172.21.15.2:0/3357759314 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f84880cebc0 0x7f848815ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:14.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.644+0000 7f8487e00640 1 --2- 172.21.15.2:0/3357759314 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f846806be30 0x7f846806e2f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:14.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.644+0000 7f8487e00640 1 --2- 172.21.15.2:0/3357759314 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f84880b64f0 0x7f84880b8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:14.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.644+0000 7f8487e00640 1 -- 172.21.15.2:0/3357759314 >> 172.21.15.2:0/3357759314 conn(0x7f84880d0de0 msgr2=0x7f848815bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:14.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.644+0000 7f8487e00640 1 -- 172.21.15.2:0/3357759314 shutdown_connections 2024-09-10T08:47:14.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.645+0000 7f8487e00640 1 -- 172.21.15.2:0/3357759314 wait complete. 2024-09-10T08:47:14.661 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-09-10T08:47:13.376830+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595010,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231916,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754742804,"statfs":{"total":773094113280,"available":772856631296,"internally_reserved":0,"allocated":3284992,"data_stored":1992068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":234016304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2232,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003934"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.569663+0000","last_change":"2024-09-10T08:46:50.757068+0000","last_active":"2024-09-10T08:46:57.569663+0000","last_peered":"2024-09-10T08:46:57.569663+0000","last_clean":"2024-09-10T08:46:57.569663+0000","last_became_active":"2024-09-10T08:46:50.754880+0000","last_became_peered":"2024-09-10T08:46:50.754880+0000","last_unstale":"2024-09-10T08:46:57.569663+0000","last_undegraded":"2024-09-10T08:46:57.569663+0000","last_fullsized":"2024-09-10T08:46:57.569663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:56:12.627990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.084163+0000","last_change":"2024-09-10T08:46:51.773476+0000","last_active":"2024-09-10T08:46:58.084163+0000","last_peered":"2024-09-10T08:46:58.084163+0000","last_clean":"2024-09-10T08:46:58.084163+0000","last_became_active":"2024-09-10T08:46:51.773221+0000","last_became_peered":"2024-09-10T08:46:51.773221+0000","last_unstale":"2024-09-10T08:46:58.084163+0000","last_undegraded":"2024-09-10T08:46:58.084163+0000","last_fullsized":"2024-09-10T08:46:58.084163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:24.242861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082454+0000","last_change":"2024-09-10T08:46:55.882294+0000","last_active":"2024-09-10T08:46:58.082454+0000","last_peered":"2024-09-10T08:46:58.082454+0000","last_clean":"2024-09-10T08:46:58.082454+0000","last_became_active":"2024-09-10T08:46:55.881924+0000","last_became_peered":"2024-09-10T08:46:55.881924+0000","last_unstale":"2024-09-10T08:46:58.082454+0000","last_undegraded":"2024-09-10T08:46:58.082454+0000","last_fullsized":"2024-09-10T08:46:58.082454+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:09:55.956737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.084247+0000","last_change":"2024-09-10T08:46:50.763493+0000","last_active":"2024-09-10T08:46:58.084247+0000","last_peered":"2024-09-10T08:46:58.084247+0000","last_clean":"2024-09-10T08:46:58.084247+0000","last_became_active":"2024-09-10T08:46:50.761280+0000","last_became_peered":"2024-09-10T08:46:50.761280+0000","last_unstale":"2024-09-10T08:46:58.084247+0000","last_undegraded":"2024-09-10T08:46:58.084247+0000","last_fullsized":"2024-09-10T08:46:58.084247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:38:26.709117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.569396+0000","last_change":"2024-09-10T08:46:51.794099+0000","last_active":"2024-09-10T08:46:57.569396+0000","last_peered":"2024-09-10T08:46:57.569396+0000","last_clean":"2024-09-10T08:46:57.569396+0000","last_became_active":"2024-09-10T08:46:51.793831+0000","last_became_peered":"2024-09-10T08:46:51.793831+0000","last_unstale":"2024-09-10T08:46:57.569396+0000","last_undegraded":"2024-09-10T08:46:57.569396+0000","last_fullsized":"2024-09-10T08:46:57.569396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:17:48.493127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.805298+0000","last_change":"2024-09-10T08:46:55.835850+0000","last_active":"2024-09-10T08:46:56.805298+0000","last_peered":"2024-09-10T08:46:56.805298+0000","last_clean":"2024-09-10T08:46:56.805298+0000","last_became_active":"2024-09-10T08:46:55.834778+0000","last_became_peered":"2024-09-10T08:46:55.834778+0000","last_unstale":"2024-09-10T08:46:56.805298+0000","last_undegraded":"2024-09-10T08:46:56.805298+0000","last_fullsized":"2024-09-10T08:46:56.805298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:17:52.547720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.962530+0000","last_change":"2024-09-10T08:46:50.762150+0000","last_active":"2024-09-10T08:46:57.962530+0000","last_peered":"2024-09-10T08:46:57.962530+0000","last_clean":"2024-09-10T08:46:57.962530+0000","last_became_active":"2024-09-10T08:46:50.761706+0000","last_became_peered":"2024-09-10T08:46:50.761706+0000","last_unstale":"2024-09-10T08:46:57.962530+0000","last_undegraded":"2024-09-10T08:46:57.962530+0000","last_fullsized":"2024-09-10T08:46:57.962530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:23:06.043116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082889+0000","last_change":"2024-09-10T08:46:51.795776+0000","last_active":"2024-09-10T08:46:58.082889+0000","last_peered":"2024-09-10T08:46:58.082889+0000","last_clean":"2024-09-10T08:46:58.082889+0000","last_became_active":"2024-09-10T08:46:51.795503+0000","last_became_peered":"2024-09-10T08:46:51.795503+0000","last_unstale":"2024-09-10T08:46:58.082889+0000","last_undegraded":"2024-09-10T08:46:58.082889+0000","last_fullsized":"2024-09-10T08:46:58.082889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:17:50.559065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.806427+0000","last_change":"2024-09-10T08:46:55.836120+0000","last_active":"2024-09-10T08:46:56.806427+0000","last_peered":"2024-09-10T08:46:56.806427+0000","last_clean":"2024-09-10T08:46:56.806427+0000","last_became_active":"2024-09-10T08:46:55.834616+0000","last_became_peered":"2024-09-10T08:46:55.834616+0000","last_unstale":"2024-09-10T08:46:56.806427+0000","last_undegraded":"2024-09-10T08:46:56.806427+0000","last_fullsized":"2024-09-10T08:46:56.806427+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:02.411540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.962107+0000","last_change":"2024-09-10T08:46:50.775708+0000","last_active":"2024-09-10T08:46:57.962107+0000","last_peered":"2024-09-10T08:46:57.962107+0000","last_clean":"2024-09-10T08:46:57.962107+0000","last_became_active":"2024-09-10T08:46:50.775448+0000","last_became_peered":"2024-09-10T08:46:50.775448+0000","last_unstale":"2024-09-10T08:46:57.962107+0000","last_undegraded":"2024-09-10T08:46:57.962107+0000","last_fullsized":"2024-09-10T08:46:57.962107+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:27:43.187268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083129+0000","last_change":"2024-09-10T08:46:51.791061+0000","last_active":"2024-09-10T08:46:58.083129+0000","last_peered":"2024-09-10T08:46:58.083129+0000","last_clean":"2024-09-10T08:46:58.083129+0000","last_became_active":"2024-09-10T08:46:51.790526+0000","last_became_peered":"2024-09-10T08:46:51.790526+0000","last_unstale":"2024-09-10T08:46:58.083129+0000","last_undegraded":"2024-09-10T08:46:58.083129+0000","last_fullsized":"2024-09-10T08:46:58.083129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:48:03.814114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.805699+0000","last_change":"2024-09-10T08:46:55.823814+0000","last_active":"2024-09-10T08:46:56.805699+0000","last_peered":"2024-09-10T08:46:56.805699+0000","last_clean":"2024-09-10T08:46:56.805699+0000","last_became_active":"2024-09-10T08:46:55.823335+0000","last_became_peered":"2024-09-10T08:46:55.823335+0000","last_unstale":"2024-09-10T08:46:56.805699+0000","last_undegraded":"2024-09-10T08:46:56.805699+0000","last_fullsized":"2024-09-10T08:46:56.805699+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:41:12.315749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.805058+0000","last_change":"2024-09-10T08:46:51.781024+0000","last_active":"2024-09-10T08:46:56.805058+0000","last_peered":"2024-09-10T08:46:56.805058+0000","last_clean":"2024-09-10T08:46:56.805058+0000","last_became_active":"2024-09-10T08:46:51.780735+0000","last_became_peered":"2024-09-10T08:46:51.780735+0000","last_unstale":"2024-09-10T08:46:56.805058+0000","last_undegraded":"2024-09-10T08:46:56.805058+0000","last_fullsized":"2024-09-10T08:46:56.805058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:49:28.950554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.962318+0000","last_change":"2024-09-10T08:46:50.772598+0000","last_active":"2024-09-10T08:46:57.962318+0000","last_peered":"2024-09-10T08:46:57.962318+0000","last_clean":"2024-09-10T08:46:57.962318+0000","last_became_active":"2024-09-10T08:46:50.770687+0000","last_became_peered":"2024-09-10T08:46:50.770687+0000","last_unstale":"2024-09-10T08:46:57.962318+0000","last_undegraded":"2024-09-10T08:46:57.962318+0000","last_fullsized":"2024-09-10T08:46:57.962318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:55.305892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.806573+0000","last_change":"2024-09-10T08:46:55.831028+0000","last_active":"2024-09-10T08:46:56.806573+0000","last_peered":"2024-09-10T08:46:56.806573+0000","last_clean":"2024-09-10T08:46:56.806573+0000","last_became_active":"2024-09-10T08:46:55.830439+0000","last_became_peered":"2024-09-10T08:46:55.830439+0000","last_unstale":"2024-09-10T08:46:56.806573+0000","last_undegraded":"2024-09-10T08:46:56.806573+0000","last_fullsized":"2024-09-10T08:46:56.806573+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:17:54.613658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082547+0000","last_change":"2024-09-10T08:46:51.781312+0000","last_active":"2024-09-10T08:46:58.082547+0000","last_peered":"2024-09-10T08:46:58.082547+0000","last_clean":"2024-09-10T08:46:58.082547+0000","last_became_active":"2024-09-10T08:46:51.779810+0000","last_became_peered":"2024-09-10T08:46:51.779810+0000","last_unstale":"2024-09-10T08:46:58.082547+0000","last_undegraded":"2024-09-10T08:46:58.082547+0000","last_fullsized":"2024-09-10T08:46:58.082547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:55:01.331346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083271+0000","last_change":"2024-09-10T08:46:50.766807+0000","last_active":"2024-09-10T08:46:58.083271+0000","last_peered":"2024-09-10T08:46:58.083271+0000","last_clean":"2024-09-10T08:46:58.083271+0000","last_became_active":"2024-09-10T08:46:50.766511+0000","last_became_peered":"2024-09-10T08:46:50.766511+0000","last_unstale":"2024-09-10T08:46:58.083271+0000","last_undegraded":"2024-09-10T08:46:58.083271+0000","last_fullsized":"2024-09-10T08:46:58.083271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:02:43.005946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.805396+0000","last_change":"2024-09-10T08:46:55.835018+0000","last_active":"2024-09-10T08:46:56.805396+0000","last_peered":"2024-09-10T08:46:56.805396+0000","last_clean":"2024-09-10T08:46:56.805396+0000","last_became_active":"2024-09-10T08:46:55.834507+0000","last_became_peered":"2024-09-10T08:46:55.834507+0000","last_unstale":"2024-09-10T08:46:56.805396+0000","last_undegraded":"2024-09-10T08:46:56.805396+0000","last_fullsized":"2024-09-10T08:46:56.805396+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:12:33.767988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082297+0000","last_change":"2024-09-10T08:46:51.771494+0000","last_active":"2024-09-10T08:46:58.082297+0000","last_peered":"2024-09-10T08:46:58.082297+0000","last_clean":"2024-09-10T08:46:58.082297+0000","last_became_active":"2024-09-10T08:46:51.771158+0000","last_became_peered":"2024-09-10T08:46:51.771158+0000","last_unstale":"2024-09-10T08:46:58.082297+0000","last_undegraded":"2024-09-10T08:46:58.082297+0000","last_fullsized":"2024-09-10T08:46:58.082297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:41:08.261156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082874+0000","last_change":"2024-09-10T08:46:50.767844+0000","last_active":"2024-09-10T08:46:58.082874+0000","last_peered":"2024-09-10T08:46:58.082874+0000","last_clean":"2024-09-10T08:46:58.082874+0000","last_became_active":"2024-09-10T08:46:50.767532+0000","last_became_peered":"2024-09-10T08:46:50.767532+0000","last_unstale":"2024-09-10T08:46:58.082874+0000","last_undegraded":"2024-09-10T08:46:58.082874+0000","last_fullsized":"2024-09-10T08:46:58.082874+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:55.305892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083798+0000","last_change":"2024-09-10T08:46:55.881275+0000","last_active":"2024-09-10T08:46:58.083798+0000","last_peered":"2024-09-10T08:46:58.083798+0000","last_clean":"2024-09-10T08:46:58.083798+0000","last_became_active":"2024-09-10T08:46:55.880859+0000","last_became_peered":"2024-09-10T08:46:55.880859+0000","last_unstale":"2024-09-10T08:46:58.083798+0000","last_undegraded":"2024-09-10T08:46:58.083798+0000","last_fullsized":"2024-09-10T08:46:58.083798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:32:51.937086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.806377+0000","last_change":"2024-09-10T08:46:51.768270+0000","last_active":"2024-09-10T08:46:56.806377+0000","last_peered":"2024-09-10T08:46:56.806377+0000","last_clean":"2024-09-10T08:46:56.806377+0000","last_became_active":"2024-09-10T08:46:51.767974+0000","last_became_peered":"2024-09-10T08:46:51.767974+0000","last_unstale":"2024-09-10T08:46:56.806377+0000","last_undegraded":"2024-09-10T08:46:56.806377+0000","last_fullsized":"2024-09-10T08:46:56.806377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:13:17.725125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.961838+0000","last_change":"2024-09-10T08:46:50.768755+0000","last_active":"2024-09-10T08:46:57.961838+0000","last_peered":"2024-09-10T08:46:57.961838+0000","last_clean":"2024-09-10T08:46:57.961838+0000","last_became_active":"2024-09-10T08:46:50.768090+0000","last_became_peered":"2024-09-10T08:46:50.768090+0000","last_unstale":"2024-09-10T08:46:57.961838+0000","last_undegraded":"2024-09-10T08:46:57.961838+0000","last_fullsized":"2024-09-10T08:46:57.961838+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:13:16.717444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.806723+0000","last_change":"2024-09-10T08:46:55.823983+0000","last_active":"2024-09-10T08:46:56.806723+0000","last_peered":"2024-09-10T08:46:56.806723+0000","last_clean":"2024-09-10T08:46:56.806723+0000","last_became_active":"2024-09-10T08:46:55.823590+0000","last_became_peered":"2024-09-10T08:46:55.823590+0000","last_unstale":"2024-09-10T08:46:56.806723+0000","last_undegraded":"2024-09-10T08:46:56.806723+0000","last_fullsized":"2024-09-10T08:46:56.806723+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:48:07.868707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.569487+0000","last_change":"2024-09-10T08:46:51.776329+0000","last_active":"2024-09-10T08:46:57.569487+0000","last_peered":"2024-09-10T08:46:57.569487+0000","last_clean":"2024-09-10T08:46:57.569487+0000","last_became_active":"2024-09-10T08:46:51.775407+0000","last_became_peered":"2024-09-10T08:46:51.775407+0000","last_unstale":"2024-09-10T08:46:57.569487+0000","last_undegraded":"2024-09-10T08:46:57.569487+0000","last_fullsized":"2024-09-10T08:46:57.569487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:56:12.749632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.807054+0000","last_change":"2024-09-10T08:46:50.756330+0000","last_active":"2024-09-10T08:46:56.807054+0000","last_peered":"2024-09-10T08:46:56.807054+0000","last_clean":"2024-09-10T08:46:56.807054+0000","last_became_active":"2024-09-10T08:46:50.755912+0000","last_became_peered":"2024-09-10T08:46:50.755912+0000","last_unstale":"2024-09-10T08:46:56.807054+0000","last_undegraded":"2024-09-10T08:46:56.807054+0000","last_fullsized":"2024-09-10T08:46:56.807054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:13:16.717444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.806363+0000","last_change":"2024-09-10T08:46:55.881993+0000","last_active":"2024-09-10T08:46:56.806363+0000","last_peered":"2024-09-10T08:46:56.806363+0000","last_clean":"2024-09-10T08:46:56.806363+0000","last_became_active":"2024-09-10T08:46:55.881654+0000","last_became_peered":"2024-09-10T08:46:55.881654+0000","last_unstale":"2024-09-10T08:46:56.806363+0000","last_undegraded":"2024-09-10T08:46:56.806363+0000","last_fullsized":"2024-09-10T08:46:56.806363+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:28.652609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.084400+0000","last_change":"2024-09-10T08:46:51.791470+0000","last_active":"2024-09-10T08:46:58.084400+0000","last_peered":"2024-09-10T08:46:58.084400+0000","last_clean":"2024-09-10T08:46:58.084400+0000","last_became_active":"2024-09-10T08:46:51.789315+0000","last_became_peered":"2024-09-10T08:46:51.789315+0000","last_unstale":"2024-09-10T08:46:58.084400+0000","last_undegraded":"2024-09-10T08:46:58.084400+0000","last_fullsized":"2024-09-10T08:46:58.084400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:35:58.356947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083695+0000","last_change":"2024-09-10T08:46:50.763200+0000","last_active":"2024-09-10T08:46:58.083695+0000","last_peered":"2024-09-10T08:46:58.083695+0000","last_clean":"2024-09-10T08:46:58.083695+0000","last_became_active":"2024-09-10T08:46:50.761919+0000","last_became_peered":"2024-09-10T08:46:50.761919+0000","last_unstale":"2024-09-10T08:46:58.083695+0000","last_undegraded":"2024-09-10T08:46:58.083695+0000","last_fullsized":"2024-09-10T08:46:58.083695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:27:43.187268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082087+0000","last_change":"2024-09-10T08:46:55.879120+0000","last_active":"2024-09-10T08:46:58.082087+0000","last_peered":"2024-09-10T08:46:58.082087+0000","last_clean":"2024-09-10T08:46:58.082087+0000","last_became_active":"2024-09-10T08:46:55.878150+0000","last_became_peered":"2024-09-10T08:46:55.878150+0000","last_unstale":"2024-09-10T08:46:58.082087+0000","last_undegraded":"2024-09-10T08:46:58.082087+0000","last_fullsized":"2024-09-10T08:46:58.082087+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:49:07.750480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083493+0000","last_change":"2024-09-10T08:46:51.764062+0000","last_active":"2024-09-10T08:46:58.083493+0000","last_peered":"2024-09-10T08:46:58.083493+0000","last_clean":"2024-09-10T08:46:58.083493+0000","last_became_active":"2024-09-10T08:46:51.763032+0000","last_became_peered":"2024-09-10T08:46:51.763032+0000","last_unstale":"2024-09-10T08:46:58.083493+0000","last_undegraded":"2024-09-10T08:46:58.083493+0000","last_fullsized":"2024-09-10T08:46:58.083493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:12:29.713395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.962641+0000","last_change":"2024-09-10T08:46:50.774433+0000","last_active":"2024-09-10T08:46:57.962641+0000","last_peered":"2024-09-10T08:46:57.962641+0000","last_clean":"2024-09-10T08:46:57.962641+0000","last_became_active":"2024-09-10T08:46:50.774032+0000","last_became_peered":"2024-09-10T08:46:50.774032+0000","last_unstale":"2024-09-10T08:46:57.962641+0000","last_undegraded":"2024-09-10T08:46:57.962641+0000","last_fullsized":"2024-09-10T08:46:57.962641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:20:23.136708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.569437+0000","last_change":"2024-09-10T08:46:55.884303+0000","last_active":"2024-09-10T08:46:57.569437+0000","last_peered":"2024-09-10T08:46:57.569437+0000","last_clean":"2024-09-10T08:46:57.569437+0000","last_became_active":"2024-09-10T08:46:55.880606+0000","last_became_peered":"2024-09-10T08:46:55.880606+0000","last_unstale":"2024-09-10T08:46:57.569437+0000","last_undegraded":"2024-09-10T08:46:57.569437+0000","last_fullsized":"2024-09-10T08:46:57.569437+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:28.966981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083135+0000","last_change":"2024-09-10T08:46:51.782882+0000","last_active":"2024-09-10T08:46:58.083135+0000","last_peered":"2024-09-10T08:46:58.083135+0000","last_clean":"2024-09-10T08:46:58.083135+0000","last_became_active":"2024-09-10T08:46:51.782618+0000","last_became_peered":"2024-09-10T08:46:51.782618+0000","last_unstale":"2024-09-10T08:46:58.083135+0000","last_undegraded":"2024-09-10T08:46:58.083135+0000","last_fullsized":"2024-09-10T08:46:58.083135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:53:54.788208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083587+0000","last_change":"2024-09-10T08:46:50.771532+0000","last_active":"2024-09-10T08:46:58.083587+0000","last_peered":"2024-09-10T08:46:58.083587+0000","last_clean":"2024-09-10T08:46:58.083587+0000","last_became_active":"2024-09-10T08:46:50.771211+0000","last_became_peered":"2024-09-10T08:46:50.771211+0000","last_unstale":"2024-09-10T08:46:58.083587+0000","last_undegraded":"2024-09-10T08:46:58.083587+0000","last_fullsized":"2024-09-10T08:46:58.083587+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:23:06.043116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083105+0000","last_change":"2024-09-10T08:46:55.833301+0000","last_active":"2024-09-10T08:46:58.083105+0000","last_peered":"2024-09-10T08:46:58.083105+0000","last_clean":"2024-09-10T08:46:58.083105+0000","last_became_active":"2024-09-10T08:46:55.832778+0000","last_became_peered":"2024-09-10T08:46:55.832778+0000","last_unstale":"2024-09-10T08:46:58.083105+0000","last_undegraded":"2024-09-10T08:46:58.083105+0000","last_fullsized":"2024-09-10T08:46:58.083105+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:38:27.475264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.806724+0000","last_change":"2024-09-10T08:46:51.773996+0000","last_active":"2024-09-10T08:46:56.806724+0000","last_peered":"2024-09-10T08:46:56.806724+0000","last_clean":"2024-09-10T08:46:56.806724+0000","last_became_active":"2024-09-10T08:46:51.773689+0000","last_became_peered":"2024-09-10T08:46:51.773689+0000","last_unstale":"2024-09-10T08:46:56.806724+0000","last_undegraded":"2024-09-10T08:46:56.806724+0000","last_fullsized":"2024-09-10T08:46:56.806724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:27:44.194949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083163+0000","last_change":"2024-09-10T08:46:50.769707+0000","last_active":"2024-09-10T08:46:58.083163+0000","last_peered":"2024-09-10T08:46:58.083163+0000","last_clean":"2024-09-10T08:46:58.083163+0000","last_became_active":"2024-09-10T08:46:50.769431+0000","last_became_peered":"2024-09-10T08:46:50.769431+0000","last_unstale":"2024-09-10T08:46:58.083163+0000","last_undegraded":"2024-09-10T08:46:58.083163+0000","last_fullsized":"2024-09-10T08:46:58.083163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:38:26.709117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083580+0000","last_change":"2024-09-10T08:46:55.825975+0000","last_active":"2024-09-10T08:46:58.083580+0000","last_peered":"2024-09-10T08:46:58.083580+0000","last_clean":"2024-09-10T08:46:58.083580+0000","last_became_active":"2024-09-10T08:46:55.824646+0000","last_became_peered":"2024-09-10T08:46:55.824646+0000","last_unstale":"2024-09-10T08:46:58.083580+0000","last_undegraded":"2024-09-10T08:46:58.083580+0000","last_fullsized":"2024-09-10T08:46:58.083580+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:30.769030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082407+0000","last_change":"2024-09-10T08:46:51.763566+0000","last_active":"2024-09-10T08:46:58.082407+0000","last_peered":"2024-09-10T08:46:58.082407+0000","last_clean":"2024-09-10T08:46:58.082407+0000","last_became_active":"2024-09-10T08:46:51.762799+0000","last_became_peered":"2024-09-10T08:46:51.762799+0000","last_unstale":"2024-09-10T08:46:58.082407+0000","last_undegraded":"2024-09-10T08:46:58.082407+0000","last_fullsized":"2024-09-10T08:46:58.082407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:32:41.996036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.804105+0000","last_change":"2024-09-10T08:46:50.759355+0000","last_active":"2024-09-10T08:46:56.804105+0000","last_peered":"2024-09-10T08:46:56.804105+0000","last_clean":"2024-09-10T08:46:56.804105+0000","last_became_active":"2024-09-10T08:46:50.758565+0000","last_became_peered":"2024-09-10T08:46:50.758565+0000","last_unstale":"2024-09-10T08:46:56.804105+0000","last_undegraded":"2024-09-10T08:46:56.804105+0000","last_fullsized":"2024-09-10T08:46:56.804105+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:02:43.005946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083886+0000","last_change":"2024-09-10T08:46:55.840925+0000","last_active":"2024-09-10T08:46:58.083886+0000","last_peered":"2024-09-10T08:46:58.083886+0000","last_clean":"2024-09-10T08:46:58.083886+0000","last_became_active":"2024-09-10T08:46:55.839186+0000","last_became_peered":"2024-09-10T08:46:55.839186+0000","last_unstale":"2024-09-10T08:46:58.083886+0000","last_undegraded":"2024-09-10T08:46:58.083886+0000","last_fullsized":"2024-09-10T08:46:58.083886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:28.966981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.568979+0000","last_change":"2024-09-10T08:46:51.793589+0000","last_active":"2024-09-10T08:46:57.568979+0000","last_peered":"2024-09-10T08:46:57.568979+0000","last_clean":"2024-09-10T08:46:57.568979+0000","last_became_active":"2024-09-10T08:46:51.792999+0000","last_became_peered":"2024-09-10T08:46:51.792999+0000","last_unstale":"2024-09-10T08:46:57.568979+0000","last_undegraded":"2024-09-10T08:46:57.568979+0000","last_fullsized":"2024-09-10T08:46:57.568979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:43:11.183186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.961882+0000","last_change":"2024-09-10T08:46:50.769021+0000","last_active":"2024-09-10T08:46:57.961882+0000","last_peered":"2024-09-10T08:46:57.961882+0000","last_clean":"2024-09-10T08:46:57.961882+0000","last_became_active":"2024-09-10T08:46:50.768447+0000","last_became_peered":"2024-09-10T08:46:50.768447+0000","last_unstale":"2024-09-10T08:46:57.961882+0000","last_undegraded":"2024-09-10T08:46:57.961882+0000","last_fullsized":"2024-09-10T08:46:57.961882+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:16:38.293555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.569408+0000","last_change":"2024-09-10T08:46:55.882489+0000","last_active":"2024-09-10T08:46:57.569408+0000","last_peered":"2024-09-10T08:46:57.569408+0000","last_clean":"2024-09-10T08:46:57.569408+0000","last_became_active":"2024-09-10T08:46:55.880753+0000","last_became_peered":"2024-09-10T08:46:55.880753+0000","last_unstale":"2024-09-10T08:46:57.569408+0000","last_undegraded":"2024-09-10T08:46:57.569408+0000","last_fullsized":"2024-09-10T08:46:57.569408+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:32:51.937086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082212+0000","last_change":"2024-09-10T08:46:51.780317+0000","last_active":"2024-09-10T08:46:58.082212+0000","last_peered":"2024-09-10T08:46:58.082212+0000","last_clean":"2024-09-10T08:46:58.082212+0000","last_became_active":"2024-09-10T08:46:51.780024+0000","last_became_peered":"2024-09-10T08:46:51.780024+0000","last_unstale":"2024-09-10T08:46:58.082212+0000","last_undegraded":"2024-09-10T08:46:58.082212+0000","last_fullsized":"2024-09-10T08:46:58.082212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:32:41.996036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082934+0000","last_change":"2024-09-10T08:46:50.765202+0000","last_active":"2024-09-10T08:46:58.082934+0000","last_peered":"2024-09-10T08:46:58.082934+0000","last_clean":"2024-09-10T08:46:58.082934+0000","last_became_active":"2024-09-10T08:46:50.762976+0000","last_became_peered":"2024-09-10T08:46:50.762976+0000","last_unstale":"2024-09-10T08:46:58.082934+0000","last_undegraded":"2024-09-10T08:46:58.082934+0000","last_fullsized":"2024-09-10T08:46:58.082934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:13:16.717444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.962109+0000","last_change":"2024-09-10T08:46:42.177049+0000","last_active":"2024-09-10T08:46:57.962109+0000","last_peered":"2024-09-10T08:46:57.962109+0000","last_clean":"2024-09-10T08:46:57.962109+0000","last_became_active":"2024-09-10T08:46:42.175678+0000","last_became_peered":"2024-09-10T08:46:42.175678+0000","last_unstale":"2024-09-10T08:46:57.962109+0000","last_undegraded":"2024-09-10T08:46:57.962109+0000","last_fullsized":"2024-09-10T08:46:57.962109+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:40.326212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:40.326212+0000","last_clean_scrub_stamp":"2024-09-10T08:46:40.326212+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:06.642437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.806408+0000","last_change":"2024-09-10T08:46:55.881533+0000","last_active":"2024-09-10T08:46:56.806408+0000","last_peered":"2024-09-10T08:46:56.806408+0000","last_clean":"2024-09-10T08:46:56.806408+0000","last_became_active":"2024-09-10T08:46:55.880157+0000","last_became_peered":"2024-09-10T08:46:55.880157+0000","last_unstale":"2024-09-10T08:46:56.806408+0000","last_undegraded":"2024-09-10T08:46:56.806408+0000","last_fullsized":"2024-09-10T08:46:56.806408+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:17:54.613658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.962401+0000","last_change":"2024-09-10T08:46:51.793262+0000","last_active":"2024-09-10T08:46:57.962401+0000","last_peered":"2024-09-10T08:46:57.962401+0000","last_clean":"2024-09-10T08:46:57.962401+0000","last_became_active":"2024-09-10T08:46:51.792966+0000","last_became_peered":"2024-09-10T08:46:51.792966+0000","last_unstale":"2024-09-10T08:46:57.962401+0000","last_undegraded":"2024-09-10T08:46:57.962401+0000","last_fullsized":"2024-09-10T08:46:57.962401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:38:23.420671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.804380+0000","last_change":"2024-09-10T08:46:50.768436+0000","last_active":"2024-09-10T08:46:56.804380+0000","last_peered":"2024-09-10T08:46:56.804380+0000","last_clean":"2024-09-10T08:46:56.804380+0000","last_became_active":"2024-09-10T08:46:50.767236+0000","last_became_peered":"2024-09-10T08:46:50.767236+0000","last_unstale":"2024-09-10T08:46:56.804380+0000","last_undegraded":"2024-09-10T08:46:56.804380+0000","last_fullsized":"2024-09-10T08:46:56.804380+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:36:19.851847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.804996+0000","last_change":"2024-09-10T08:46:55.881541+0000","last_active":"2024-09-10T08:46:56.804996+0000","last_peered":"2024-09-10T08:46:56.804996+0000","last_clean":"2024-09-10T08:46:56.804996+0000","last_became_active":"2024-09-10T08:46:55.881029+0000","last_became_peered":"2024-09-10T08:46:55.881029+0000","last_unstale":"2024-09-10T08:46:56.804996+0000","last_undegraded":"2024-09-10T08:46:56.804996+0000","last_fullsized":"2024-09-10T08:46:56.804996+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:02.411540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083119+0000","last_change":"2024-09-10T08:46:51.783403+0000","last_active":"2024-09-10T08:46:58.083119+0000","last_peered":"2024-09-10T08:46:58.083119+0000","last_clean":"2024-09-10T08:46:58.083119+0000","last_became_active":"2024-09-10T08:46:51.781308+0000","last_became_peered":"2024-09-10T08:46:51.781308+0000","last_unstale":"2024-09-10T08:46:58.083119+0000","last_undegraded":"2024-09-10T08:46:58.083119+0000","last_fullsized":"2024-09-10T08:46:58.083119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:24:26.259501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083401+0000","last_change":"2024-09-10T08:46:50.769999+0000","last_active":"2024-09-10T08:46:58.083401+0000","last_peered":"2024-09-10T08:46:58.083401+0000","last_clean":"2024-09-10T08:46:58.083401+0000","last_became_active":"2024-09-10T08:46:50.769664+0000","last_became_peered":"2024-09-10T08:46:50.769664+0000","last_unstale":"2024-09-10T08:46:58.083401+0000","last_undegraded":"2024-09-10T08:46:58.083401+0000","last_fullsized":"2024-09-10T08:46:58.083401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:16:38.293555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.569544+0000","last_change":"2024-09-10T08:46:55.835422+0000","last_active":"2024-09-10T08:46:57.569544+0000","last_peered":"2024-09-10T08:46:57.569544+0000","last_clean":"2024-09-10T08:46:57.569544+0000","last_became_active":"2024-09-10T08:46:55.834891+0000","last_became_peered":"2024-09-10T08:46:55.834891+0000","last_unstale":"2024-09-10T08:46:57.569544+0000","last_undegraded":"2024-09-10T08:46:57.569544+0000","last_fullsized":"2024-09-10T08:46:57.569544+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:49:07.750480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.962646+0000","last_change":"2024-09-10T08:46:51.790394+0000","last_active":"2024-09-10T08:46:57.962646+0000","last_peered":"2024-09-10T08:46:57.962646+0000","last_clean":"2024-09-10T08:46:57.962646+0000","last_became_active":"2024-09-10T08:46:51.790110+0000","last_became_peered":"2024-09-10T08:46:51.790110+0000","last_unstale":"2024-09-10T08:46:57.962646+0000","last_undegraded":"2024-09-10T08:46:57.962646+0000","last_fullsized":"2024-09-10T08:46:57.962646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:32:47.882493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.804824+0000","last_change":"2024-09-10T08:46:50.768366+0000","last_active":"2024-09-10T08:46:56.804824+0000","last_peered":"2024-09-10T08:46:56.804824+0000","last_clean":"2024-09-10T08:46:56.804824+0000","last_became_active":"2024-09-10T08:46:50.768064+0000","last_became_peered":"2024-09-10T08:46:50.768064+0000","last_unstale":"2024-09-10T08:46:56.804824+0000","last_undegraded":"2024-09-10T08:46:56.804824+0000","last_fullsized":"2024-09-10T08:46:56.804824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:41:14.189488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082532+0000","last_change":"2024-09-10T08:46:55.881381+0000","last_active":"2024-09-10T08:46:58.082532+0000","last_peered":"2024-09-10T08:46:58.082532+0000","last_clean":"2024-09-10T08:46:58.082532+0000","last_became_active":"2024-09-10T08:46:55.880233+0000","last_became_peered":"2024-09-10T08:46:55.880233+0000","last_unstale":"2024-09-10T08:46:58.082532+0000","last_undegraded":"2024-09-10T08:46:58.082532+0000","last_fullsized":"2024-09-10T08:46:58.082532+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:18:56.316368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.962469+0000","last_change":"2024-09-10T08:46:51.796394+0000","last_active":"2024-09-10T08:46:57.962469+0000","last_peered":"2024-09-10T08:46:57.962469+0000","last_clean":"2024-09-10T08:46:57.962469+0000","last_became_active":"2024-09-10T08:46:51.795460+0000","last_became_peered":"2024-09-10T08:46:51.795460+0000","last_unstale":"2024-09-10T08:46:57.962469+0000","last_undegraded":"2024-09-10T08:46:57.962469+0000","last_fullsized":"2024-09-10T08:46:57.962469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:24.912388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.805830+0000","last_change":"2024-09-10T08:46:50.764621+0000","last_active":"2024-09-10T08:46:56.805830+0000","last_peered":"2024-09-10T08:46:56.805830+0000","last_clean":"2024-09-10T08:46:56.805830+0000","last_became_active":"2024-09-10T08:46:50.764262+0000","last_became_peered":"2024-09-10T08:46:50.764262+0000","last_unstale":"2024-09-10T08:46:56.805830+0000","last_undegraded":"2024-09-10T08:46:56.805830+0000","last_fullsized":"2024-09-10T08:46:56.805830+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:18.256394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.805988+0000","last_change":"2024-09-10T08:46:55.835039+0000","last_active":"2024-09-10T08:46:56.805988+0000","last_peered":"2024-09-10T08:46:56.805988+0000","last_clean":"2024-09-10T08:46:56.805988+0000","last_became_active":"2024-09-10T08:46:55.834520+0000","last_became_peered":"2024-09-10T08:46:55.834520+0000","last_unstale":"2024-09-10T08:46:56.805988+0000","last_undegraded":"2024-09-10T08:46:56.805988+0000","last_fullsized":"2024-09-10T08:46:56.805988+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:28.297454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.962089+0000","last_change":"2024-09-10T08:46:51.792053+0000","last_active":"2024-09-10T08:46:57.962089+0000","last_peered":"2024-09-10T08:46:57.962089+0000","last_clean":"2024-09-10T08:46:57.962089+0000","last_became_active":"2024-09-10T08:46:51.791729+0000","last_became_peered":"2024-09-10T08:46:51.791729+0000","last_unstale":"2024-09-10T08:46:57.962089+0000","last_undegraded":"2024-09-10T08:46:57.962089+0000","last_fullsized":"2024-09-10T08:46:57.962089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:35:58.356947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.803934+0000","last_change":"2024-09-10T08:46:50.762530+0000","last_active":"2024-09-10T08:46:56.803934+0000","last_peered":"2024-09-10T08:46:56.803934+0000","last_clean":"2024-09-10T08:46:56.803934+0000","last_became_active":"2024-09-10T08:46:50.762274+0000","last_became_peered":"2024-09-10T08:46:50.762274+0000","last_unstale":"2024-09-10T08:46:56.803934+0000","last_undegraded":"2024-09-10T08:46:56.803934+0000","last_fullsized":"2024-09-10T08:46:56.803934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:38:26.709117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.569309+0000","last_change":"2024-09-10T08:46:55.837828+0000","last_active":"2024-09-10T08:46:57.569309+0000","last_peered":"2024-09-10T08:46:57.569309+0000","last_clean":"2024-09-10T08:46:57.569309+0000","last_became_active":"2024-09-10T08:46:55.837157+0000","last_became_peered":"2024-09-10T08:46:55.837157+0000","last_unstale":"2024-09-10T08:46:57.569309+0000","last_undegraded":"2024-09-10T08:46:57.569309+0000","last_fullsized":"2024-09-10T08:46:57.569309+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:30.769030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.805426+0000","last_change":"2024-09-10T08:46:51.780767+0000","last_active":"2024-09-10T08:46:56.805426+0000","last_peered":"2024-09-10T08:46:56.805426+0000","last_clean":"2024-09-10T08:46:56.805426+0000","last_became_active":"2024-09-10T08:46:51.780429+0000","last_became_peered":"2024-09-10T08:46:51.780429+0000","last_unstale":"2024-09-10T08:46:56.805426+0000","last_undegraded":"2024-09-10T08:46:56.805426+0000","last_fullsized":"2024-09-10T08:46:56.805426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:43:11.183186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.805298+0000","last_change":"2024-09-10T08:46:50.767724+0000","last_active":"2024-09-10T08:46:56.805298+0000","last_peered":"2024-09-10T08:46:56.805298+0000","last_clean":"2024-09-10T08:46:56.805298+0000","last_became_active":"2024-09-10T08:46:50.767440+0000","last_became_peered":"2024-09-10T08:46:50.767440+0000","last_unstale":"2024-09-10T08:46:56.805298+0000","last_undegraded":"2024-09-10T08:46:56.805298+0000","last_fullsized":"2024-09-10T08:46:56.805298+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:36:19.851847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.084325+0000","last_change":"2024-09-10T08:46:55.881726+0000","last_active":"2024-09-10T08:46:58.084325+0000","last_peered":"2024-09-10T08:46:58.084325+0000","last_clean":"2024-09-10T08:46:58.084325+0000","last_became_active":"2024-09-10T08:46:55.881215+0000","last_became_peered":"2024-09-10T08:46:55.881215+0000","last_unstale":"2024-09-10T08:46:58.084325+0000","last_undegraded":"2024-09-10T08:46:58.084325+0000","last_fullsized":"2024-09-10T08:46:58.084325+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:55:12.631797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.962268+0000","last_change":"2024-09-10T08:46:51.802443+0000","last_active":"2024-09-10T08:46:57.962268+0000","last_peered":"2024-09-10T08:46:57.962268+0000","last_clean":"2024-09-10T08:46:57.962268+0000","last_became_active":"2024-09-10T08:46:51.800377+0000","last_became_peered":"2024-09-10T08:46:51.800377+0000","last_unstale":"2024-09-10T08:46:57.962268+0000","last_undegraded":"2024-09-10T08:46:57.962268+0000","last_fullsized":"2024-09-10T08:46:57.962268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:17:50.559065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082973+0000","last_change":"2024-09-10T08:46:50.770106+0000","last_active":"2024-09-10T08:46:58.082973+0000","last_peered":"2024-09-10T08:46:58.082973+0000","last_clean":"2024-09-10T08:46:58.082973+0000","last_became_active":"2024-09-10T08:46:50.769664+0000","last_became_peered":"2024-09-10T08:46:50.769664+0000","last_unstale":"2024-09-10T08:46:58.082973+0000","last_undegraded":"2024-09-10T08:46:58.082973+0000","last_fullsized":"2024-09-10T08:46:58.082973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:02:43.005946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082899+0000","last_change":"2024-09-10T08:46:55.878519+0000","last_active":"2024-09-10T08:46:58.082899+0000","last_peered":"2024-09-10T08:46:58.082899+0000","last_clean":"2024-09-10T08:46:58.082899+0000","last_became_active":"2024-09-10T08:46:55.877986+0000","last_became_peered":"2024-09-10T08:46:55.877986+0000","last_unstale":"2024-09-10T08:46:58.082899+0000","last_undegraded":"2024-09-10T08:46:58.082899+0000","last_fullsized":"2024-09-10T08:46:58.082899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:29:38.674946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.569136+0000","last_change":"2024-09-10T08:46:51.788482+0000","last_active":"2024-09-10T08:46:57.569136+0000","last_peered":"2024-09-10T08:46:57.569136+0000","last_clean":"2024-09-10T08:46:57.569136+0000","last_became_active":"2024-09-10T08:46:51.787872+0000","last_became_peered":"2024-09-10T08:46:51.787872+0000","last_unstale":"2024-09-10T08:46:57.569136+0000","last_undegraded":"2024-09-10T08:46:57.569136+0000","last_fullsized":"2024-09-10T08:46:57.569136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:49:28.950554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.569602+0000","last_change":"2024-09-10T08:46:50.766888+0000","last_active":"2024-09-10T08:46:57.569602+0000","last_peered":"2024-09-10T08:46:57.569602+0000","last_clean":"2024-09-10T08:46:57.569602+0000","last_became_active":"2024-09-10T08:46:50.766608+0000","last_became_peered":"2024-09-10T08:46:50.766608+0000","last_unstale":"2024-09-10T08:46:57.569602+0000","last_undegraded":"2024-09-10T08:46:57.569602+0000","last_fullsized":"2024-09-10T08:46:57.569602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:41:14.189488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083056+0000","last_change":"2024-09-10T08:46:55.878767+0000","last_active":"2024-09-10T08:46:58.083056+0000","last_peered":"2024-09-10T08:46:58.083056+0000","last_clean":"2024-09-10T08:46:58.083056+0000","last_became_active":"2024-09-10T08:46:55.878328+0000","last_became_peered":"2024-09-10T08:46:55.878328+0000","last_unstale":"2024-09-10T08:46:58.083056+0000","last_undegraded":"2024-09-10T08:46:58.083056+0000","last_fullsized":"2024-09-10T08:46:58.083056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:29:38.674946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.962269+0000","last_change":"2024-09-10T08:46:51.782671+0000","last_active":"2024-09-10T08:46:57.962269+0000","last_peered":"2024-09-10T08:46:57.962269+0000","last_clean":"2024-09-10T08:46:57.962269+0000","last_became_active":"2024-09-10T08:46:51.782072+0000","last_became_peered":"2024-09-10T08:46:51.782072+0000","last_unstale":"2024-09-10T08:46:57.962269+0000","last_undegraded":"2024-09-10T08:46:57.962269+0000","last_fullsized":"2024-09-10T08:46:57.962269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:24:26.259501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:47:03.196847+0000","last_change":"2024-09-10T08:46:50.763937+0000","last_active":"2024-09-10T08:47:03.196847+0000","last_peered":"2024-09-10T08:47:03.196847+0000","last_clean":"2024-09-10T08:47:03.196847+0000","last_became_active":"2024-09-10T08:46:50.763447+0000","last_became_peered":"2024-09-10T08:46:50.763447+0000","last_unstale":"2024-09-10T08:47:03.196847+0000","last_undegraded":"2024-09-10T08:47:03.196847+0000","last_fullsized":"2024-09-10T08:47:03.196847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:16:38.293555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083220+0000","last_change":"2024-09-10T08:46:55.822409+0000","last_active":"2024-09-10T08:46:58.083220+0000","last_peered":"2024-09-10T08:46:58.083220+0000","last_clean":"2024-09-10T08:46:58.083220+0000","last_became_active":"2024-09-10T08:46:55.821875+0000","last_became_peered":"2024-09-10T08:46:55.821875+0000","last_unstale":"2024-09-10T08:46:58.083220+0000","last_undegraded":"2024-09-10T08:46:58.083220+0000","last_fullsized":"2024-09-10T08:46:58.083220+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:53:58.842801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.805662+0000","last_change":"2024-09-10T08:46:51.780453+0000","last_active":"2024-09-10T08:46:56.805662+0000","last_peered":"2024-09-10T08:46:56.805662+0000","last_clean":"2024-09-10T08:46:56.805662+0000","last_became_active":"2024-09-10T08:46:51.780160+0000","last_became_peered":"2024-09-10T08:46:51.780160+0000","last_unstale":"2024-09-10T08:46:56.805662+0000","last_undegraded":"2024-09-10T08:46:56.805662+0000","last_fullsized":"2024-09-10T08:46:56.805662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:23:07.050797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083373+0000","last_change":"2024-09-10T08:46:50.777289+0000","last_active":"2024-09-10T08:46:58.083373+0000","last_peered":"2024-09-10T08:46:58.083373+0000","last_clean":"2024-09-10T08:46:58.083373+0000","last_became_active":"2024-09-10T08:46:50.776985+0000","last_became_peered":"2024-09-10T08:46:50.776985+0000","last_unstale":"2024-09-10T08:46:58.083373+0000","last_undegraded":"2024-09-10T08:46:58.083373+0000","last_fullsized":"2024-09-10T08:46:58.083373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:13:16.717444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.806645+0000","last_change":"2024-09-10T08:46:55.818962+0000","last_active":"2024-09-10T08:46:56.806645+0000","last_peered":"2024-09-10T08:46:56.806645+0000","last_clean":"2024-09-10T08:46:56.806645+0000","last_became_active":"2024-09-10T08:46:55.818548+0000","last_became_peered":"2024-09-10T08:46:55.818548+0000","last_unstale":"2024-09-10T08:46:56.806645+0000","last_undegraded":"2024-09-10T08:46:56.806645+0000","last_fullsized":"2024-09-10T08:46:56.806645+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:24:30.314094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.569570+0000","last_change":"2024-09-10T08:46:51.786958+0000","last_active":"2024-09-10T08:46:57.569570+0000","last_peered":"2024-09-10T08:46:57.569570+0000","last_clean":"2024-09-10T08:46:57.569570+0000","last_became_active":"2024-09-10T08:46:51.786679+0000","last_became_peered":"2024-09-10T08:46:51.786679+0000","last_unstale":"2024-09-10T08:46:57.569570+0000","last_undegraded":"2024-09-10T08:46:57.569570+0000","last_fullsized":"2024-09-10T08:46:57.569570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:12:29.713395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083066+0000","last_change":"2024-09-10T08:46:50.770627+0000","last_active":"2024-09-10T08:46:58.083066+0000","last_peered":"2024-09-10T08:46:58.083066+0000","last_clean":"2024-09-10T08:46:58.083066+0000","last_became_active":"2024-09-10T08:46:50.770108+0000","last_became_peered":"2024-09-10T08:46:50.770108+0000","last_unstale":"2024-09-10T08:46:58.083066+0000","last_undegraded":"2024-09-10T08:46:58.083066+0000","last_fullsized":"2024-09-10T08:46:58.083066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:16:38.293555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082271+0000","last_change":"2024-09-10T08:46:55.834973+0000","last_active":"2024-09-10T08:46:58.082271+0000","last_peered":"2024-09-10T08:46:58.082271+0000","last_clean":"2024-09-10T08:46:58.082271+0000","last_became_active":"2024-09-10T08:46:55.834553+0000","last_became_peered":"2024-09-10T08:46:55.834553+0000","last_unstale":"2024-09-10T08:46:58.082271+0000","last_undegraded":"2024-09-10T08:46:58.082271+0000","last_fullsized":"2024-09-10T08:46:58.082271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:48:45.215364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082933+0000","last_change":"2024-09-10T08:46:51.792047+0000","last_active":"2024-09-10T08:46:58.082933+0000","last_peered":"2024-09-10T08:46:58.082933+0000","last_clean":"2024-09-10T08:46:58.082933+0000","last_became_active":"2024-09-10T08:46:51.790021+0000","last_became_peered":"2024-09-10T08:46:51.790021+0000","last_unstale":"2024-09-10T08:46:58.082933+0000","last_undegraded":"2024-09-10T08:46:58.082933+0000","last_fullsized":"2024-09-10T08:46:58.082933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:26.714437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.806941+0000","last_change":"2024-09-10T08:46:50.766074+0000","last_active":"2024-09-10T08:46:56.806941+0000","last_peered":"2024-09-10T08:46:56.806941+0000","last_clean":"2024-09-10T08:46:56.806941+0000","last_became_active":"2024-09-10T08:46:50.765744+0000","last_became_peered":"2024-09-10T08:46:50.765744+0000","last_unstale":"2024-09-10T08:46:56.806941+0000","last_undegraded":"2024-09-10T08:46:56.806941+0000","last_fullsized":"2024-09-10T08:46:56.806941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:02:43.005946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082526+0000","last_change":"2024-09-10T08:46:55.883453+0000","last_active":"2024-09-10T08:46:58.082526+0000","last_peered":"2024-09-10T08:46:58.082526+0000","last_clean":"2024-09-10T08:46:58.082526+0000","last_became_active":"2024-09-10T08:46:55.883030+0000","last_became_peered":"2024-09-10T08:46:55.883030+0000","last_unstale":"2024-09-10T08:46:58.082526+0000","last_undegraded":"2024-09-10T08:46:58.082526+0000","last_fullsized":"2024-09-10T08:46:58.082526+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:18:56.316368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.569239+0000","last_change":"2024-09-10T08:46:55.885568+0000","last_active":"2024-09-10T08:46:57.569239+0000","last_peered":"2024-09-10T08:46:57.569239+0000","last_clean":"2024-09-10T08:46:57.569239+0000","last_became_active":"2024-09-10T08:46:55.884728+0000","last_became_peered":"2024-09-10T08:46:55.884728+0000","last_unstale":"2024-09-10T08:46:57.569239+0000","last_undegraded":"2024-09-10T08:46:57.569239+0000","last_fullsized":"2024-09-10T08:46:57.569239+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:53:58.842801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082702+0000","last_change":"2024-09-10T08:46:51.772447+0000","last_active":"2024-09-10T08:46:58.082702+0000","last_peered":"2024-09-10T08:46:58.082702+0000","last_clean":"2024-09-10T08:46:58.082702+0000","last_became_active":"2024-09-10T08:46:51.772157+0000","last_became_peered":"2024-09-10T08:46:51.772157+0000","last_unstale":"2024-09-10T08:46:58.082702+0000","last_undegraded":"2024-09-10T08:46:58.082702+0000","last_fullsized":"2024-09-10T08:46:58.082702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:55:01.331346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082601+0000","last_change":"2024-09-10T08:46:50.773438+0000","last_active":"2024-09-10T08:46:58.082601+0000","last_peered":"2024-09-10T08:46:58.082601+0000","last_clean":"2024-09-10T08:46:58.082601+0000","last_became_active":"2024-09-10T08:46:50.769939+0000","last_became_peered":"2024-09-10T08:46:50.769939+0000","last_unstale":"2024-09-10T08:46:58.082601+0000","last_undegraded":"2024-09-10T08:46:58.082601+0000","last_fullsized":"2024-09-10T08:46:58.082601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:27:43.187268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.806816+0000","last_change":"2024-09-10T08:46:55.833783+0000","last_active":"2024-09-10T08:46:56.806816+0000","last_peered":"2024-09-10T08:46:56.806816+0000","last_clean":"2024-09-10T08:46:56.806816+0000","last_became_active":"2024-09-10T08:46:55.833320+0000","last_became_peered":"2024-09-10T08:46:55.833320+0000","last_unstale":"2024-09-10T08:46:56.806816+0000","last_undegraded":"2024-09-10T08:46:56.806816+0000","last_fullsized":"2024-09-10T08:46:56.806816+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:24:30.314094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082200+0000","last_change":"2024-09-10T08:46:51.773700+0000","last_active":"2024-09-10T08:46:58.082200+0000","last_peered":"2024-09-10T08:46:58.082200+0000","last_clean":"2024-09-10T08:46:58.082200+0000","last_became_active":"2024-09-10T08:46:51.771497+0000","last_became_peered":"2024-09-10T08:46:51.771497+0000","last_unstale":"2024-09-10T08:46:58.082200+0000","last_undegraded":"2024-09-10T08:46:58.082200+0000","last_fullsized":"2024-09-10T08:46:58.082200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:12:29.713395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082693+0000","last_change":"2024-09-10T08:46:50.760228+0000","last_active":"2024-09-10T08:46:58.082693+0000","last_peered":"2024-09-10T08:46:58.082693+0000","last_clean":"2024-09-10T08:46:58.082693+0000","last_became_active":"2024-09-10T08:46:50.759920+0000","last_became_peered":"2024-09-10T08:46:50.759920+0000","last_unstale":"2024-09-10T08:46:58.082693+0000","last_undegraded":"2024-09-10T08:46:58.082693+0000","last_fullsized":"2024-09-10T08:46:58.082693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:41:14.189488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.805887+0000","last_change":"2024-09-10T08:46:50.767239+0000","last_active":"2024-09-10T08:46:56.805887+0000","last_peered":"2024-09-10T08:46:56.805887+0000","last_clean":"2024-09-10T08:46:56.805887+0000","last_became_active":"2024-09-10T08:46:50.766809+0000","last_became_peered":"2024-09-10T08:46:50.766809+0000","last_unstale":"2024-09-10T08:46:56.805887+0000","last_undegraded":"2024-09-10T08:46:56.805887+0000","last_fullsized":"2024-09-10T08:46:56.805887+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:38:26.709117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.569591+0000","last_change":"2024-09-10T08:46:51.794973+0000","last_active":"2024-09-10T08:46:57.569591+0000","last_peered":"2024-09-10T08:46:57.569591+0000","last_clean":"2024-09-10T08:46:57.569591+0000","last_became_active":"2024-09-10T08:46:51.794731+0000","last_became_peered":"2024-09-10T08:46:51.794731+0000","last_unstale":"2024-09-10T08:46:57.569591+0000","last_undegraded":"2024-09-10T08:46:57.569591+0000","last_fullsized":"2024-09-10T08:46:57.569591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:40:55.949890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.804311+0000","last_change":"2024-09-10T08:46:55.824916+0000","last_active":"2024-09-10T08:46:56.804311+0000","last_peered":"2024-09-10T08:46:56.804311+0000","last_clean":"2024-09-10T08:46:56.804311+0000","last_became_active":"2024-09-10T08:46:55.823750+0000","last_became_peered":"2024-09-10T08:46:55.823750+0000","last_unstale":"2024-09-10T08:46:56.804311+0000","last_undegraded":"2024-09-10T08:46:56.804311+0000","last_fullsized":"2024-09-10T08:46:56.804311+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:29:01.507822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082610+0000","last_change":"2024-09-10T08:46:50.759413+0000","last_active":"2024-09-10T08:46:58.082610+0000","last_peered":"2024-09-10T08:46:58.082610+0000","last_clean":"2024-09-10T08:46:58.082610+0000","last_became_active":"2024-09-10T08:46:50.759045+0000","last_became_peered":"2024-09-10T08:46:50.759045+0000","last_unstale":"2024-09-10T08:46:58.082610+0000","last_undegraded":"2024-09-10T08:46:58.082610+0000","last_fullsized":"2024-09-10T08:46:58.082610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:36:19.851847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.805928+0000","last_change":"2024-09-10T08:46:51.769795+0000","last_active":"2024-09-10T08:46:56.805928+0000","last_peered":"2024-09-10T08:46:56.805928+0000","last_clean":"2024-09-10T08:46:56.805928+0000","last_became_active":"2024-09-10T08:46:51.769482+0000","last_became_peered":"2024-09-10T08:46:51.769482+0000","last_unstale":"2024-09-10T08:46:56.805928+0000","last_undegraded":"2024-09-10T08:46:56.805928+0000","last_fullsized":"2024-09-10T08:46:56.805928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:16:39.301236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.084120+0000","last_change":"2024-09-10T08:46:55.827136+0000","last_active":"2024-09-10T08:46:58.084120+0000","last_peered":"2024-09-10T08:46:58.084120+0000","last_clean":"2024-09-10T08:46:58.084120+0000","last_became_active":"2024-09-10T08:46:55.826597+0000","last_became_peered":"2024-09-10T08:46:55.826597+0000","last_unstale":"2024-09-10T08:46:58.084120+0000","last_undegraded":"2024-09-10T08:46:58.084120+0000","last_fullsized":"2024-09-10T08:46:58.084120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:01:01.534963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.805190+0000","last_change":"2024-09-10T08:46:51.775032+0000","last_active":"2024-09-10T08:46:56.805190+0000","last_peered":"2024-09-10T08:46:56.805190+0000","last_clean":"2024-09-10T08:46:56.805190+0000","last_became_active":"2024-09-10T08:46:51.774669+0000","last_became_peered":"2024-09-10T08:46:51.774669+0000","last_unstale":"2024-09-10T08:46:56.805190+0000","last_undegraded":"2024-09-10T08:46:56.805190+0000","last_fullsized":"2024-09-10T08:46:56.805190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:40:55.949890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.804036+0000","last_change":"2024-09-10T08:46:51.796531+0000","last_active":"2024-09-10T08:46:56.804036+0000","last_peered":"2024-09-10T08:46:56.804036+0000","last_clean":"2024-09-10T08:46:56.804036+0000","last_became_active":"2024-09-10T08:46:51.796249+0000","last_became_peered":"2024-09-10T08:46:51.796249+0000","last_unstale":"2024-09-10T08:46:56.804036+0000","last_undegraded":"2024-09-10T08:46:56.804036+0000","last_fullsized":"2024-09-10T08:46:56.804036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:23:07.050797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083010+0000","last_change":"2024-09-10T08:46:51.781773+0000","last_active":"2024-09-10T08:46:58.083010+0000","last_peered":"2024-09-10T08:46:58.083010+0000","last_clean":"2024-09-10T08:46:58.083010+0000","last_became_active":"2024-09-10T08:46:51.781397+0000","last_became_peered":"2024-09-10T08:46:51.781397+0000","last_unstale":"2024-09-10T08:46:58.083010+0000","last_undegraded":"2024-09-10T08:46:58.083010+0000","last_fullsized":"2024-09-10T08:46:58.083010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:35:58.356947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.569502+0000","last_change":"2024-09-10T08:46:51.780877+0000","last_active":"2024-09-10T08:46:57.569502+0000","last_peered":"2024-09-10T08:46:57.569502+0000","last_clean":"2024-09-10T08:46:57.569502+0000","last_became_active":"2024-09-10T08:46:51.778471+0000","last_became_peered":"2024-09-10T08:46:51.778471+0000","last_unstale":"2024-09-10T08:46:57.569502+0000","last_undegraded":"2024-09-10T08:46:57.569502+0000","last_fullsized":"2024-09-10T08:46:57.569502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:32:41.996036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083021+0000","last_change":"2024-09-10T08:46:51.777079+0000","last_active":"2024-09-10T08:46:58.083021+0000","last_peered":"2024-09-10T08:46:58.083021+0000","last_clean":"2024-09-10T08:46:58.083021+0000","last_became_active":"2024-09-10T08:46:51.776561+0000","last_became_peered":"2024-09-10T08:46:51.776561+0000","last_unstale":"2024-09-10T08:46:58.083021+0000","last_undegraded":"2024-09-10T08:46:58.083021+0000","last_fullsized":"2024-09-10T08:46:58.083021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:17:48.493127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083242+0000","last_change":"2024-09-10T08:46:51.772455+0000","last_active":"2024-09-10T08:46:58.083242+0000","last_peered":"2024-09-10T08:46:58.083242+0000","last_clean":"2024-09-10T08:46:58.083242+0000","last_became_active":"2024-09-10T08:46:51.772177+0000","last_became_peered":"2024-09-10T08:46:51.772177+0000","last_unstale":"2024-09-10T08:46:58.083242+0000","last_undegraded":"2024-09-10T08:46:58.083242+0000","last_fullsized":"2024-09-10T08:46:58.083242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:56:12.749632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.807011+0000","last_change":"2024-09-10T08:46:51.787208+0000","last_active":"2024-09-10T08:46:56.807011+0000","last_peered":"2024-09-10T08:46:56.807011+0000","last_clean":"2024-09-10T08:46:56.807011+0000","last_became_active":"2024-09-10T08:46:51.786911+0000","last_became_peered":"2024-09-10T08:46:51.786911+0000","last_unstale":"2024-09-10T08:46:56.807011+0000","last_undegraded":"2024-09-10T08:46:56.807011+0000","last_fullsized":"2024-09-10T08:46:56.807011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:17:48.493127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.084355+0000","last_change":"2024-09-10T08:46:51.779942+0000","last_active":"2024-09-10T08:46:58.084355+0000","last_peered":"2024-09-10T08:46:58.084355+0000","last_clean":"2024-09-10T08:46:58.084355+0000","last_became_active":"2024-09-10T08:46:51.779570+0000","last_became_peered":"2024-09-10T08:46:51.779570+0000","last_unstale":"2024-09-10T08:46:58.084355+0000","last_undegraded":"2024-09-10T08:46:58.084355+0000","last_fullsized":"2024-09-10T08:46:58.084355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:24.598016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082596+0000","last_change":"2024-09-10T08:46:51.786869+0000","last_active":"2024-09-10T08:46:58.082596+0000","last_peered":"2024-09-10T08:46:58.082596+0000","last_clean":"2024-09-10T08:46:58.082596+0000","last_became_active":"2024-09-10T08:46:51.786574+0000","last_became_peered":"2024-09-10T08:46:51.786574+0000","last_unstale":"2024-09-10T08:46:58.082596+0000","last_undegraded":"2024-09-10T08:46:58.082596+0000","last_fullsized":"2024-09-10T08:46:58.082596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:12:29.713395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082590+0000","last_change":"2024-09-10T08:46:51.779669+0000","last_active":"2024-09-10T08:46:58.082590+0000","last_peered":"2024-09-10T08:46:58.082590+0000","last_clean":"2024-09-10T08:46:58.082590+0000","last_became_active":"2024-09-10T08:46:51.779155+0000","last_became_peered":"2024-09-10T08:46:51.779155+0000","last_unstale":"2024-09-10T08:46:58.082590+0000","last_undegraded":"2024-09-10T08:46:58.082590+0000","last_fullsized":"2024-09-10T08:46:58.082590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:43:11.183186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082731+0000","last_change":"2024-09-10T08:46:51.784754+0000","last_active":"2024-09-10T08:46:58.082731+0000","last_peered":"2024-09-10T08:46:58.082731+0000","last_clean":"2024-09-10T08:46:58.082731+0000","last_became_active":"2024-09-10T08:46:51.784415+0000","last_became_peered":"2024-09-10T08:46:51.784415+0000","last_unstale":"2024-09-10T08:46:58.082731+0000","last_undegraded":"2024-09-10T08:46:58.082731+0000","last_fullsized":"2024-09-10T08:46:58.082731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:24.242861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.569395+0000","last_change":"2024-09-10T08:46:51.788577+0000","last_active":"2024-09-10T08:46:57.569395+0000","last_peered":"2024-09-10T08:46:57.569395+0000","last_clean":"2024-09-10T08:46:57.569395+0000","last_became_active":"2024-09-10T08:46:51.787904+0000","last_became_peered":"2024-09-10T08:46:51.787904+0000","last_unstale":"2024-09-10T08:46:57.569395+0000","last_undegraded":"2024-09-10T08:46:57.569395+0000","last_fullsized":"2024-09-10T08:46:57.569395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:28:57.453229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.806471+0000","last_change":"2024-09-10T08:46:51.776337+0000","last_active":"2024-09-10T08:46:56.806471+0000","last_peered":"2024-09-10T08:46:56.806471+0000","last_clean":"2024-09-10T08:46:56.806471+0000","last_became_active":"2024-09-10T08:46:51.776001+0000","last_became_peered":"2024-09-10T08:46:51.776001+0000","last_unstale":"2024-09-10T08:46:56.806471+0000","last_undegraded":"2024-09-10T08:46:56.806471+0000","last_fullsized":"2024-09-10T08:46:56.806471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:32:41.996036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.962516+0000","last_change":"2024-09-10T08:46:51.782912+0000","last_active":"2024-09-10T08:46:57.962516+0000","last_peered":"2024-09-10T08:46:57.962516+0000","last_clean":"2024-09-10T08:46:57.962516+0000","last_became_active":"2024-09-10T08:46:51.782378+0000","last_became_peered":"2024-09-10T08:46:51.782378+0000","last_unstale":"2024-09-10T08:46:57.962516+0000","last_undegraded":"2024-09-10T08:46:57.962516+0000","last_fullsized":"2024-09-10T08:46:57.962516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:26.714437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.804805+0000","last_change":"2024-09-10T08:46:51.773571+0000","last_active":"2024-09-10T08:46:56.804805+0000","last_peered":"2024-09-10T08:46:56.804805+0000","last_clean":"2024-09-10T08:46:56.804805+0000","last_became_active":"2024-09-10T08:46:51.773315+0000","last_became_peered":"2024-09-10T08:46:51.773315+0000","last_unstale":"2024-09-10T08:46:56.804805+0000","last_undegraded":"2024-09-10T08:46:56.804805+0000","last_fullsized":"2024-09-10T08:46:56.804805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:20:24.144389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083297+0000","last_change":"2024-09-10T08:46:51.785342+0000","last_active":"2024-09-10T08:46:58.083297+0000","last_peered":"2024-09-10T08:46:58.083297+0000","last_clean":"2024-09-10T08:46:58.083297+0000","last_became_active":"2024-09-10T08:46:51.785045+0000","last_became_peered":"2024-09-10T08:46:51.785045+0000","last_unstale":"2024-09-10T08:46:58.083297+0000","last_undegraded":"2024-09-10T08:46:58.083297+0000","last_fullsized":"2024-09-10T08:46:58.083297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:38:23.420671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082446+0000","last_change":"2024-09-10T08:46:51.779497+0000","last_active":"2024-09-10T08:46:58.082446+0000","last_peered":"2024-09-10T08:46:58.082446+0000","last_clean":"2024-09-10T08:46:58.082446+0000","last_became_active":"2024-09-10T08:46:51.778862+0000","last_became_peered":"2024-09-10T08:46:51.778862+0000","last_unstale":"2024-09-10T08:46:58.082446+0000","last_undegraded":"2024-09-10T08:46:58.082446+0000","last_fullsized":"2024-09-10T08:46:58.082446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:17:48.493127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082856+0000","last_change":"2024-09-10T08:46:51.777738+0000","last_active":"2024-09-10T08:46:58.082856+0000","last_peered":"2024-09-10T08:46:58.082856+0000","last_clean":"2024-09-10T08:46:58.082856+0000","last_became_active":"2024-09-10T08:46:51.777432+0000","last_became_peered":"2024-09-10T08:46:51.777432+0000","last_unstale":"2024-09-10T08:46:58.082856+0000","last_undegraded":"2024-09-10T08:46:58.082856+0000","last_fullsized":"2024-09-10T08:46:58.082856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:40:55.949890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.569117+0000","last_change":"2024-09-10T08:46:51.770094+0000","last_active":"2024-09-10T08:46:57.569117+0000","last_peered":"2024-09-10T08:46:57.569117+0000","last_clean":"2024-09-10T08:46:57.569117+0000","last_became_active":"2024-09-10T08:46:51.769753+0000","last_became_peered":"2024-09-10T08:46:51.769753+0000","last_unstale":"2024-09-10T08:46:57.569117+0000","last_undegraded":"2024-09-10T08:46:57.569117+0000","last_fullsized":"2024-09-10T08:46:57.569117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:24:41.697382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082447+0000","last_change":"2024-09-10T08:46:51.774060+0000","last_active":"2024-09-10T08:46:58.082447+0000","last_peered":"2024-09-10T08:46:58.082447+0000","last_clean":"2024-09-10T08:46:58.082447+0000","last_became_active":"2024-09-10T08:46:51.773763+0000","last_became_peered":"2024-09-10T08:46:51.773763+0000","last_unstale":"2024-09-10T08:46:58.082447+0000","last_undegraded":"2024-09-10T08:46:58.082447+0000","last_fullsized":"2024-09-10T08:46:58.082447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:40:55.949890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.805537+0000","last_change":"2024-09-10T08:46:51.772499+0000","last_active":"2024-09-10T08:46:56.805537+0000","last_peered":"2024-09-10T08:46:56.805537+0000","last_clean":"2024-09-10T08:46:56.805537+0000","last_became_active":"2024-09-10T08:46:51.772212+0000","last_became_peered":"2024-09-10T08:46:51.772212+0000","last_unstale":"2024-09-10T08:46:56.805537+0000","last_undegraded":"2024-09-10T08:46:56.805537+0000","last_fullsized":"2024-09-10T08:46:56.805537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:56.313573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.806478+0000","last_change":"2024-09-10T08:46:51.782216+0000","last_active":"2024-09-10T08:46:56.806478+0000","last_peered":"2024-09-10T08:46:56.806478+0000","last_clean":"2024-09-10T08:46:56.806478+0000","last_became_active":"2024-09-10T08:46:51.781363+0000","last_became_peered":"2024-09-10T08:46:51.781363+0000","last_unstale":"2024-09-10T08:46:56.806478+0000","last_undegraded":"2024-09-10T08:46:56.806478+0000","last_fullsized":"2024-09-10T08:46:56.806478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:55:01.331346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.806885+0000","last_change":"2024-09-10T08:46:51.796242+0000","last_active":"2024-09-10T08:46:56.806885+0000","last_peered":"2024-09-10T08:46:56.806885+0000","last_clean":"2024-09-10T08:46:56.806885+0000","last_became_active":"2024-09-10T08:46:51.795803+0000","last_became_peered":"2024-09-10T08:46:51.795803+0000","last_unstale":"2024-09-10T08:46:56.806885+0000","last_undegraded":"2024-09-10T08:46:56.806885+0000","last_fullsized":"2024-09-10T08:46:56.806885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:56:12.749632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.962635+0000","last_change":"2024-09-10T08:46:51.792984+0000","last_active":"2024-09-10T08:46:57.962635+0000","last_peered":"2024-09-10T08:46:57.962635+0000","last_clean":"2024-09-10T08:46:57.962635+0000","last_became_active":"2024-09-10T08:46:51.792602+0000","last_became_peered":"2024-09-10T08:46:51.792602+0000","last_unstale":"2024-09-10T08:46:57.962635+0000","last_undegraded":"2024-09-10T08:46:57.962635+0000","last_fullsized":"2024-09-10T08:46:57.962635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:53:54.788208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082095+0000","last_change":"2024-09-10T08:46:51.781436+0000","last_active":"2024-09-10T08:46:58.082095+0000","last_peered":"2024-09-10T08:46:58.082095+0000","last_clean":"2024-09-10T08:46:58.082095+0000","last_became_active":"2024-09-10T08:46:51.781123+0000","last_became_peered":"2024-09-10T08:46:51.781123+0000","last_unstale":"2024-09-10T08:46:58.082095+0000","last_undegraded":"2024-09-10T08:46:58.082095+0000","last_fullsized":"2024-09-10T08:46:58.082095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:56:12.749632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.962036+0000","last_change":"2024-09-10T08:46:51.779525+0000","last_active":"2024-09-10T08:46:57.962036+0000","last_peered":"2024-09-10T08:46:57.962036+0000","last_clean":"2024-09-10T08:46:57.962036+0000","last_became_active":"2024-09-10T08:46:51.779188+0000","last_became_peered":"2024-09-10T08:46:51.779188+0000","last_unstale":"2024-09-10T08:46:57.962036+0000","last_undegraded":"2024-09-10T08:46:57.962036+0000","last_fullsized":"2024-09-10T08:46:57.962036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:24.242861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082677+0000","last_change":"2024-09-10T08:46:51.788567+0000","last_active":"2024-09-10T08:46:58.082677+0000","last_peered":"2024-09-10T08:46:58.082677+0000","last_clean":"2024-09-10T08:46:58.082677+0000","last_became_active":"2024-09-10T08:46:51.787403+0000","last_became_peered":"2024-09-10T08:46:51.787403+0000","last_unstale":"2024-09-10T08:46:58.082677+0000","last_undegraded":"2024-09-10T08:46:58.082677+0000","last_fullsized":"2024-09-10T08:46:58.082677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:41:08.261156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.962152+0000","last_change":"2024-09-10T08:46:51.779364+0000","last_active":"2024-09-10T08:46:57.962152+0000","last_peered":"2024-09-10T08:46:57.962152+0000","last_clean":"2024-09-10T08:46:57.962152+0000","last_became_active":"2024-09-10T08:46:51.778893+0000","last_became_peered":"2024-09-10T08:46:51.778893+0000","last_unstale":"2024-09-10T08:46:57.962152+0000","last_undegraded":"2024-09-10T08:46:57.962152+0000","last_fullsized":"2024-09-10T08:46:57.962152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:24.598016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082934+0000","last_change":"2024-09-10T08:46:51.784880+0000","last_active":"2024-09-10T08:46:58.082934+0000","last_peered":"2024-09-10T08:46:58.082934+0000","last_clean":"2024-09-10T08:46:58.082934+0000","last_became_active":"2024-09-10T08:46:51.784571+0000","last_became_peered":"2024-09-10T08:46:51.784571+0000","last_unstale":"2024-09-10T08:46:58.082934+0000","last_undegraded":"2024-09-10T08:46:58.082934+0000","last_fullsized":"2024-09-10T08:46:58.082934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:24.598016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.569257+0000","last_change":"2024-09-10T08:46:51.778810+0000","last_active":"2024-09-10T08:46:57.569257+0000","last_peered":"2024-09-10T08:46:57.569257+0000","last_clean":"2024-09-10T08:46:57.569257+0000","last_became_active":"2024-09-10T08:46:51.777129+0000","last_became_peered":"2024-09-10T08:46:51.777129+0000","last_unstale":"2024-09-10T08:46:57.569257+0000","last_undegraded":"2024-09-10T08:46:57.569257+0000","last_fullsized":"2024-09-10T08:46:57.569257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:55:01.331346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083661+0000","last_change":"2024-09-10T08:46:51.777958+0000","last_active":"2024-09-10T08:46:58.083661+0000","last_peered":"2024-09-10T08:46:58.083661+0000","last_clean":"2024-09-10T08:46:58.083661+0000","last_became_active":"2024-09-10T08:46:51.777701+0000","last_became_peered":"2024-09-10T08:46:51.777701+0000","last_unstale":"2024-09-10T08:46:58.083661+0000","last_undegraded":"2024-09-10T08:46:58.083661+0000","last_fullsized":"2024-09-10T08:46:58.083661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:17:48.493127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.962500+0000","last_change":"2024-09-10T08:46:51.794577+0000","last_active":"2024-09-10T08:46:57.962500+0000","last_peered":"2024-09-10T08:46:57.962500+0000","last_clean":"2024-09-10T08:46:57.962500+0000","last_became_active":"2024-09-10T08:46:51.794266+0000","last_became_peered":"2024-09-10T08:46:51.794266+0000","last_unstale":"2024-09-10T08:46:57.962500+0000","last_undegraded":"2024-09-10T08:46:57.962500+0000","last_fullsized":"2024-09-10T08:46:57.962500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:48:03.814114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4642,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":104100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":104100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32028,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339812,"statfs":{"total":96636764160,"available":96603967488,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:47:14.667 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:47:14.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.857+0000 7fbc8e000640 1 Processor -- start 2024-09-10T08:47:14.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.857+0000 7fbc8e000640 1 -- start start 2024-09-10T08:47:14.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.858+0000 7fbc8e000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbc88144250 0x7fbc880cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:14.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.859+0000 7fbc8e000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbc880cd480 0x7fbc880ce420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:14.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.859+0000 7fbc8e000640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc8806f540 con 0x7fbc88144c90 2024-09-10T08:47:14.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.859+0000 7fbc8e000640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fbc8806f820 con 0x7fbc880cd480 2024-09-10T08:47:14.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.859+0000 7fbc8e000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fbc8806fb00 con 0x7fbc88144250 2024-09-10T08:47:14.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.859+0000 7fbc87e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbc880cd480 0x7fbc880ce420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:14.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.859+0000 7fbc87e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbc880cd480 0x7fbc880ce420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40900/0 (socket says 172.21.15.2:40900) 2024-09-10T08:47:14.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.859+0000 7fbc87e00640 1 -- 172.21.15.2:0/1754211850 learned_addr learned my addr 172.21.15.2:0/1754211850 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:14.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.859+0000 7fbc87400640 1 --2- 172.21.15.2:0/1754211850 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbc88144250 0x7fbc880cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:14.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.859+0000 7fbc87e00640 1 -- 172.21.15.2:0/1754211850 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbc88144250 msgr2=0x7fbc880cf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:14.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.859+0000 7fbc87e00640 1 --2- 172.21.15.2:0/1754211850 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbc88144250 0x7fbc880cf8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:14.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.859+0000 7fbc87e00640 1 -- 172.21.15.2:0/1754211850 >> v1:172.21.15.155:6789/0 conn(0x7fbc88144c90 legacy=0x7fbc880ccd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:14.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.859+0000 7fbc87e00640 1 -- 172.21.15.2:0/1754211850 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc8806fde0 con 0x7fbc880cd480 2024-09-10T08:47:14.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.860+0000 7fbc87e00640 1 --2- 172.21.15.2:0/1754211850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc880cd480 0x7fbc880ce420 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbc80009e50 tx=0x7fbc8002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f92a4d962bf242b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:14.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.861+0000 7fbc86a00640 1 -- 172.21.15.2:0/1754211850 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc80036070 con 0x7fbc880cd480 2024-09-10T08:47:14.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.861+0000 7fbc86a00640 1 -- 172.21.15.2:0/1754211850 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc80031600 con 0x7fbc880cd480 2024-09-10T08:47:14.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.861+0000 7fbc86a00640 1 -- 172.21.15.2:0/1754211850 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc800319d0 con 0x7fbc880cd480 2024-09-10T08:47:14.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.861+0000 7fbc8e000640 1 -- 172.21.15.2:0/1754211850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc880cd480 msgr2=0x7fbc880ce420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:14.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.861+0000 7fbc8e000640 1 --2- 172.21.15.2:0/1754211850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc880cd480 0x7fbc880ce420 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbc80009e50 tx=0x7fbc8002a710 comp rx=0 tx=0).stop 2024-09-10T08:47:14.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.861+0000 7fbc8e000640 1 -- 172.21.15.2:0/1754211850 shutdown_connections 2024-09-10T08:47:14.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.861+0000 7fbc8e000640 1 --2- 172.21.15.2:0/1754211850 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc880cd480 0x7fbc880ce420 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:14.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.861+0000 7fbc8e000640 1 --2- 172.21.15.2:0/1754211850 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbc88144250 0x7fbc880cf8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:14.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.861+0000 7fbc8e000640 1 -- 172.21.15.2:0/1754211850 >> 172.21.15.2:0/1754211850 conn(0x7fbc8806bc10 msgr2=0x7fbc8806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:14.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.861+0000 7fbc8e000640 1 -- 172.21.15.2:0/1754211850 shutdown_connections 2024-09-10T08:47:14.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.861+0000 7fbc8e000640 1 -- 172.21.15.2:0/1754211850 wait complete. 2024-09-10T08:47:14.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.863+0000 7fbc8e000640 1 Processor -- start 2024-09-10T08:47:14.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.863+0000 7fbc8e000640 1 -- start start 2024-09-10T08:47:14.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.864+0000 7fbc8e000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc880cd480 0x7fbc88139980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:14.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.864+0000 7fbc8e000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbc88144250 0x7fbc8815a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:14.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.864+0000 7fbc8e000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc88144c90 0x7fbc8813cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:14.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.864+0000 7fbc8e000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbc880b3390 con 0x7fbc88144c90 2024-09-10T08:47:14.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.864+0000 7fbc8e000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fbc880cfe10 con 0x7fbc880cd480 2024-09-10T08:47:14.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.864+0000 7fbc8e000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fbc880ce960 con 0x7fbc88144250 2024-09-10T08:47:14.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.864+0000 7fbc87e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc88144c90 0x7fbc8813cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:14.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.864+0000 7fbc87e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc88144c90 0x7fbc8813cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40910/0 (socket says 172.21.15.2:40910) 2024-09-10T08:47:14.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.864+0000 7fbc87e00640 1 -- 172.21.15.2:0/3935302897 learned_addr learned my addr 172.21.15.2:0/3935302897 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:14.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.864+0000 7fbc87400640 1 --2- 172.21.15.2:0/3935302897 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc880cd480 0x7fbc88139980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:14.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.864+0000 7fbc7fe00640 1 --2- 172.21.15.2:0/3935302897 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbc88144250 0x7fbc8815a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:14.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.865+0000 7fbc87e00640 1 -- 172.21.15.2:0/3935302897 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbc88144250 msgr2=0x7fbc8815a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:14.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.865+0000 7fbc87e00640 1 --2- 172.21.15.2:0/3935302897 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbc88144250 0x7fbc8815a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:14.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.865+0000 7fbc87e00640 1 -- 172.21.15.2:0/3935302897 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc880cd480 msgr2=0x7fbc88139980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:14.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.865+0000 7fbc87e00640 1 --2- 172.21.15.2:0/3935302897 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc880cd480 0x7fbc88139980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:14.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.865+0000 7fbc87e00640 1 -- 172.21.15.2:0/3935302897 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc88139ec0 con 0x7fbc88144c90 2024-09-10T08:47:14.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.865+0000 7fbc87e00640 1 --2- 172.21.15.2:0/3935302897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc88144c90 0x7fbc8813cd60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbc80009e50 tx=0x7fbc80004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:14.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.865+0000 7fbc7f400640 1 -- 172.21.15.2:0/3935302897 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc80036050 con 0x7fbc88144c90 2024-09-10T08:47:14.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.866+0000 7fbc7f400640 1 -- 172.21.15.2:0/3935302897 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc80042070 con 0x7fbc88144c90 2024-09-10T08:47:14.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.866+0000 7fbc7f400640 1 -- 172.21.15.2:0/3935302897 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc80009510 con 0x7fbc88144c90 2024-09-10T08:47:14.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.866+0000 7fbc8e000640 1 -- 172.21.15.2:0/3935302897 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc880b2bf0 con 0x7fbc88144c90 2024-09-10T08:47:14.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.866+0000 7fbc8e000640 1 -- 172.21.15.2:0/3935302897 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc8815c5a0 con 0x7fbc88144c90 2024-09-10T08:47:14.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.867+0000 7fbc8e000640 1 -- 172.21.15.2:0/3935302897 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc880ce420 con 0x7fbc88144c90 2024-09-10T08:47:14.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.868+0000 7fbc7f400640 1 -- 172.21.15.2:0/3935302897 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbc80007bd0 con 0x7fbc88144c90 2024-09-10T08:47:14.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.869+0000 7fbc7f400640 1 --2- 172.21.15.2:0/3935302897 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fbc6406be60 0x7fbc6406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:14.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.869+0000 7fbc7f400640 1 -- 172.21.15.2:0/3935302897 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fbc800abee0 con 0x7fbc88144c90 2024-09-10T08:47:14.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.869+0000 7fbc87400640 1 --2- 172.21.15.2:0/3935302897 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fbc6406be60 0x7fbc6406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:14.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.870+0000 7fbc87400640 1 --2- 172.21.15.2:0/3935302897 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fbc6406be60 0x7fbc6406e320 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbc78006fd0 tx=0x7fbc78008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:14.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:14.873+0000 7fbc7f400640 1 -- 172.21.15.2:0/3935302897 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbc88139ec0 con 0x7fbc88144c90 2024-09-10T08:47:15.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.053+0000 7fbc8e000640 1 -- 172.21.15.2:0/3935302897 --> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbc88141b70 con 0x7fbc6406be60 2024-09-10T08:47:15.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.062+0000 7fbc7f400640 1 -- 172.21.15.2:0/3935302897 <== mgr.4099 v2:172.21.15.155:6832/2611418382 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7fbc88141b70 con 0x7fbc6406be60 2024-09-10T08:47:15.067 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:47:15.068 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-10T08:47:15.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.066+0000 7fbc8e000640 1 -- 172.21.15.2:0/3935302897 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fbc6406be60 msgr2=0x7fbc6406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:15.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.066+0000 7fbc8e000640 1 --2- 172.21.15.2:0/3935302897 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fbc6406be60 0x7fbc6406e320 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbc78006fd0 tx=0x7fbc78008040 comp rx=0 tx=0).stop 2024-09-10T08:47:15.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.066+0000 7fbc8e000640 1 -- 172.21.15.2:0/3935302897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc88144c90 msgr2=0x7fbc8813cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:15.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.066+0000 7fbc8e000640 1 --2- 172.21.15.2:0/3935302897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc88144c90 0x7fbc8813cd60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbc80009e50 tx=0x7fbc80004a40 comp rx=0 tx=0).stop 2024-09-10T08:47:15.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.066+0000 7fbc8e000640 1 -- 172.21.15.2:0/3935302897 shutdown_connections 2024-09-10T08:47:15.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.066+0000 7fbc8e000640 1 --2- 172.21.15.2:0/3935302897 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc88144c90 0x7fbc8813cd60 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:15.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.066+0000 7fbc8e000640 1 --2- 172.21.15.2:0/3935302897 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fbc6406be60 0x7fbc6406e320 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:15.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.066+0000 7fbc8e000640 1 --2- 172.21.15.2:0/3935302897 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbc88144250 0x7fbc8815a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:15.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.066+0000 7fbc8e000640 1 --2- 172.21.15.2:0/3935302897 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc880cd480 0x7fbc88139980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:15.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.066+0000 7fbc8e000640 1 -- 172.21.15.2:0/3935302897 >> 172.21.15.2:0/3935302897 conn(0x7fbc8806bc10 msgr2=0x7fbc88141e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:15.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.067+0000 7fbc8e000640 1 -- 172.21.15.2:0/3935302897 shutdown_connections 2024-09-10T08:47:15.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.067+0000 7fbc8e000640 1 -- 172.21.15.2:0/3935302897 wait complete. 2024-09-10T08:47:15.084 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-09-10T08:47:13.376830+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595010,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231916,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754742804,"statfs":{"total":773094113280,"available":772856631296,"internally_reserved":0,"allocated":3284992,"data_stored":1992068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":234016304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2232,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003934"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.569663+0000","last_change":"2024-09-10T08:46:50.757068+0000","last_active":"2024-09-10T08:46:57.569663+0000","last_peered":"2024-09-10T08:46:57.569663+0000","last_clean":"2024-09-10T08:46:57.569663+0000","last_became_active":"2024-09-10T08:46:50.754880+0000","last_became_peered":"2024-09-10T08:46:50.754880+0000","last_unstale":"2024-09-10T08:46:57.569663+0000","last_undegraded":"2024-09-10T08:46:57.569663+0000","last_fullsized":"2024-09-10T08:46:57.569663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:56:12.627990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.084163+0000","last_change":"2024-09-10T08:46:51.773476+0000","last_active":"2024-09-10T08:46:58.084163+0000","last_peered":"2024-09-10T08:46:58.084163+0000","last_clean":"2024-09-10T08:46:58.084163+0000","last_became_active":"2024-09-10T08:46:51.773221+0000","last_became_peered":"2024-09-10T08:46:51.773221+0000","last_unstale":"2024-09-10T08:46:58.084163+0000","last_undegraded":"2024-09-10T08:46:58.084163+0000","last_fullsized":"2024-09-10T08:46:58.084163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:24.242861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082454+0000","last_change":"2024-09-10T08:46:55.882294+0000","last_active":"2024-09-10T08:46:58.082454+0000","last_peered":"2024-09-10T08:46:58.082454+0000","last_clean":"2024-09-10T08:46:58.082454+0000","last_became_active":"2024-09-10T08:46:55.881924+0000","last_became_peered":"2024-09-10T08:46:55.881924+0000","last_unstale":"2024-09-10T08:46:58.082454+0000","last_undegraded":"2024-09-10T08:46:58.082454+0000","last_fullsized":"2024-09-10T08:46:58.082454+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:09:55.956737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.084247+0000","last_change":"2024-09-10T08:46:50.763493+0000","last_active":"2024-09-10T08:46:58.084247+0000","last_peered":"2024-09-10T08:46:58.084247+0000","last_clean":"2024-09-10T08:46:58.084247+0000","last_became_active":"2024-09-10T08:46:50.761280+0000","last_became_peered":"2024-09-10T08:46:50.761280+0000","last_unstale":"2024-09-10T08:46:58.084247+0000","last_undegraded":"2024-09-10T08:46:58.084247+0000","last_fullsized":"2024-09-10T08:46:58.084247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:38:26.709117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.569396+0000","last_change":"2024-09-10T08:46:51.794099+0000","last_active":"2024-09-10T08:46:57.569396+0000","last_peered":"2024-09-10T08:46:57.569396+0000","last_clean":"2024-09-10T08:46:57.569396+0000","last_became_active":"2024-09-10T08:46:51.793831+0000","last_became_peered":"2024-09-10T08:46:51.793831+0000","last_unstale":"2024-09-10T08:46:57.569396+0000","last_undegraded":"2024-09-10T08:46:57.569396+0000","last_fullsized":"2024-09-10T08:46:57.569396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:17:48.493127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.805298+0000","last_change":"2024-09-10T08:46:55.835850+0000","last_active":"2024-09-10T08:46:56.805298+0000","last_peered":"2024-09-10T08:46:56.805298+0000","last_clean":"2024-09-10T08:46:56.805298+0000","last_became_active":"2024-09-10T08:46:55.834778+0000","last_became_peered":"2024-09-10T08:46:55.834778+0000","last_unstale":"2024-09-10T08:46:56.805298+0000","last_undegraded":"2024-09-10T08:46:56.805298+0000","last_fullsized":"2024-09-10T08:46:56.805298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:17:52.547720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.962530+0000","last_change":"2024-09-10T08:46:50.762150+0000","last_active":"2024-09-10T08:46:57.962530+0000","last_peered":"2024-09-10T08:46:57.962530+0000","last_clean":"2024-09-10T08:46:57.962530+0000","last_became_active":"2024-09-10T08:46:50.761706+0000","last_became_peered":"2024-09-10T08:46:50.761706+0000","last_unstale":"2024-09-10T08:46:57.962530+0000","last_undegraded":"2024-09-10T08:46:57.962530+0000","last_fullsized":"2024-09-10T08:46:57.962530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:23:06.043116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082889+0000","last_change":"2024-09-10T08:46:51.795776+0000","last_active":"2024-09-10T08:46:58.082889+0000","last_peered":"2024-09-10T08:46:58.082889+0000","last_clean":"2024-09-10T08:46:58.082889+0000","last_became_active":"2024-09-10T08:46:51.795503+0000","last_became_peered":"2024-09-10T08:46:51.795503+0000","last_unstale":"2024-09-10T08:46:58.082889+0000","last_undegraded":"2024-09-10T08:46:58.082889+0000","last_fullsized":"2024-09-10T08:46:58.082889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:17:50.559065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.806427+0000","last_change":"2024-09-10T08:46:55.836120+0000","last_active":"2024-09-10T08:46:56.806427+0000","last_peered":"2024-09-10T08:46:56.806427+0000","last_clean":"2024-09-10T08:46:56.806427+0000","last_became_active":"2024-09-10T08:46:55.834616+0000","last_became_peered":"2024-09-10T08:46:55.834616+0000","last_unstale":"2024-09-10T08:46:56.806427+0000","last_undegraded":"2024-09-10T08:46:56.806427+0000","last_fullsized":"2024-09-10T08:46:56.806427+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:02.411540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.962107+0000","last_change":"2024-09-10T08:46:50.775708+0000","last_active":"2024-09-10T08:46:57.962107+0000","last_peered":"2024-09-10T08:46:57.962107+0000","last_clean":"2024-09-10T08:46:57.962107+0000","last_became_active":"2024-09-10T08:46:50.775448+0000","last_became_peered":"2024-09-10T08:46:50.775448+0000","last_unstale":"2024-09-10T08:46:57.962107+0000","last_undegraded":"2024-09-10T08:46:57.962107+0000","last_fullsized":"2024-09-10T08:46:57.962107+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:27:43.187268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083129+0000","last_change":"2024-09-10T08:46:51.791061+0000","last_active":"2024-09-10T08:46:58.083129+0000","last_peered":"2024-09-10T08:46:58.083129+0000","last_clean":"2024-09-10T08:46:58.083129+0000","last_became_active":"2024-09-10T08:46:51.790526+0000","last_became_peered":"2024-09-10T08:46:51.790526+0000","last_unstale":"2024-09-10T08:46:58.083129+0000","last_undegraded":"2024-09-10T08:46:58.083129+0000","last_fullsized":"2024-09-10T08:46:58.083129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:48:03.814114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.805699+0000","last_change":"2024-09-10T08:46:55.823814+0000","last_active":"2024-09-10T08:46:56.805699+0000","last_peered":"2024-09-10T08:46:56.805699+0000","last_clean":"2024-09-10T08:46:56.805699+0000","last_became_active":"2024-09-10T08:46:55.823335+0000","last_became_peered":"2024-09-10T08:46:55.823335+0000","last_unstale":"2024-09-10T08:46:56.805699+0000","last_undegraded":"2024-09-10T08:46:56.805699+0000","last_fullsized":"2024-09-10T08:46:56.805699+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:41:12.315749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.805058+0000","last_change":"2024-09-10T08:46:51.781024+0000","last_active":"2024-09-10T08:46:56.805058+0000","last_peered":"2024-09-10T08:46:56.805058+0000","last_clean":"2024-09-10T08:46:56.805058+0000","last_became_active":"2024-09-10T08:46:51.780735+0000","last_became_peered":"2024-09-10T08:46:51.780735+0000","last_unstale":"2024-09-10T08:46:56.805058+0000","last_undegraded":"2024-09-10T08:46:56.805058+0000","last_fullsized":"2024-09-10T08:46:56.805058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:49:28.950554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.962318+0000","last_change":"2024-09-10T08:46:50.772598+0000","last_active":"2024-09-10T08:46:57.962318+0000","last_peered":"2024-09-10T08:46:57.962318+0000","last_clean":"2024-09-10T08:46:57.962318+0000","last_became_active":"2024-09-10T08:46:50.770687+0000","last_became_peered":"2024-09-10T08:46:50.770687+0000","last_unstale":"2024-09-10T08:46:57.962318+0000","last_undegraded":"2024-09-10T08:46:57.962318+0000","last_fullsized":"2024-09-10T08:46:57.962318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:55.305892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.806573+0000","last_change":"2024-09-10T08:46:55.831028+0000","last_active":"2024-09-10T08:46:56.806573+0000","last_peered":"2024-09-10T08:46:56.806573+0000","last_clean":"2024-09-10T08:46:56.806573+0000","last_became_active":"2024-09-10T08:46:55.830439+0000","last_became_peered":"2024-09-10T08:46:55.830439+0000","last_unstale":"2024-09-10T08:46:56.806573+0000","last_undegraded":"2024-09-10T08:46:56.806573+0000","last_fullsized":"2024-09-10T08:46:56.806573+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:17:54.613658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082547+0000","last_change":"2024-09-10T08:46:51.781312+0000","last_active":"2024-09-10T08:46:58.082547+0000","last_peered":"2024-09-10T08:46:58.082547+0000","last_clean":"2024-09-10T08:46:58.082547+0000","last_became_active":"2024-09-10T08:46:51.779810+0000","last_became_peered":"2024-09-10T08:46:51.779810+0000","last_unstale":"2024-09-10T08:46:58.082547+0000","last_undegraded":"2024-09-10T08:46:58.082547+0000","last_fullsized":"2024-09-10T08:46:58.082547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:55:01.331346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083271+0000","last_change":"2024-09-10T08:46:50.766807+0000","last_active":"2024-09-10T08:46:58.083271+0000","last_peered":"2024-09-10T08:46:58.083271+0000","last_clean":"2024-09-10T08:46:58.083271+0000","last_became_active":"2024-09-10T08:46:50.766511+0000","last_became_peered":"2024-09-10T08:46:50.766511+0000","last_unstale":"2024-09-10T08:46:58.083271+0000","last_undegraded":"2024-09-10T08:46:58.083271+0000","last_fullsized":"2024-09-10T08:46:58.083271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:02:43.005946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.805396+0000","last_change":"2024-09-10T08:46:55.835018+0000","last_active":"2024-09-10T08:46:56.805396+0000","last_peered":"2024-09-10T08:46:56.805396+0000","last_clean":"2024-09-10T08:46:56.805396+0000","last_became_active":"2024-09-10T08:46:55.834507+0000","last_became_peered":"2024-09-10T08:46:55.834507+0000","last_unstale":"2024-09-10T08:46:56.805396+0000","last_undegraded":"2024-09-10T08:46:56.805396+0000","last_fullsized":"2024-09-10T08:46:56.805396+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:12:33.767988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082297+0000","last_change":"2024-09-10T08:46:51.771494+0000","last_active":"2024-09-10T08:46:58.082297+0000","last_peered":"2024-09-10T08:46:58.082297+0000","last_clean":"2024-09-10T08:46:58.082297+0000","last_became_active":"2024-09-10T08:46:51.771158+0000","last_became_peered":"2024-09-10T08:46:51.771158+0000","last_unstale":"2024-09-10T08:46:58.082297+0000","last_undegraded":"2024-09-10T08:46:58.082297+0000","last_fullsized":"2024-09-10T08:46:58.082297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:41:08.261156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082874+0000","last_change":"2024-09-10T08:46:50.767844+0000","last_active":"2024-09-10T08:46:58.082874+0000","last_peered":"2024-09-10T08:46:58.082874+0000","last_clean":"2024-09-10T08:46:58.082874+0000","last_became_active":"2024-09-10T08:46:50.767532+0000","last_became_peered":"2024-09-10T08:46:50.767532+0000","last_unstale":"2024-09-10T08:46:58.082874+0000","last_undegraded":"2024-09-10T08:46:58.082874+0000","last_fullsized":"2024-09-10T08:46:58.082874+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:55.305892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083798+0000","last_change":"2024-09-10T08:46:55.881275+0000","last_active":"2024-09-10T08:46:58.083798+0000","last_peered":"2024-09-10T08:46:58.083798+0000","last_clean":"2024-09-10T08:46:58.083798+0000","last_became_active":"2024-09-10T08:46:55.880859+0000","last_became_peered":"2024-09-10T08:46:55.880859+0000","last_unstale":"2024-09-10T08:46:58.083798+0000","last_undegraded":"2024-09-10T08:46:58.083798+0000","last_fullsized":"2024-09-10T08:46:58.083798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:32:51.937086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.806377+0000","last_change":"2024-09-10T08:46:51.768270+0000","last_active":"2024-09-10T08:46:56.806377+0000","last_peered":"2024-09-10T08:46:56.806377+0000","last_clean":"2024-09-10T08:46:56.806377+0000","last_became_active":"2024-09-10T08:46:51.767974+0000","last_became_peered":"2024-09-10T08:46:51.767974+0000","last_unstale":"2024-09-10T08:46:56.806377+0000","last_undegraded":"2024-09-10T08:46:56.806377+0000","last_fullsized":"2024-09-10T08:46:56.806377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:13:17.725125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.961838+0000","last_change":"2024-09-10T08:46:50.768755+0000","last_active":"2024-09-10T08:46:57.961838+0000","last_peered":"2024-09-10T08:46:57.961838+0000","last_clean":"2024-09-10T08:46:57.961838+0000","last_became_active":"2024-09-10T08:46:50.768090+0000","last_became_peered":"2024-09-10T08:46:50.768090+0000","last_unstale":"2024-09-10T08:46:57.961838+0000","last_undegraded":"2024-09-10T08:46:57.961838+0000","last_fullsized":"2024-09-10T08:46:57.961838+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:13:16.717444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.806723+0000","last_change":"2024-09-10T08:46:55.823983+0000","last_active":"2024-09-10T08:46:56.806723+0000","last_peered":"2024-09-10T08:46:56.806723+0000","last_clean":"2024-09-10T08:46:56.806723+0000","last_became_active":"2024-09-10T08:46:55.823590+0000","last_became_peered":"2024-09-10T08:46:55.823590+0000","last_unstale":"2024-09-10T08:46:56.806723+0000","last_undegraded":"2024-09-10T08:46:56.806723+0000","last_fullsized":"2024-09-10T08:46:56.806723+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:48:07.868707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.569487+0000","last_change":"2024-09-10T08:46:51.776329+0000","last_active":"2024-09-10T08:46:57.569487+0000","last_peered":"2024-09-10T08:46:57.569487+0000","last_clean":"2024-09-10T08:46:57.569487+0000","last_became_active":"2024-09-10T08:46:51.775407+0000","last_became_peered":"2024-09-10T08:46:51.775407+0000","last_unstale":"2024-09-10T08:46:57.569487+0000","last_undegraded":"2024-09-10T08:46:57.569487+0000","last_fullsized":"2024-09-10T08:46:57.569487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:56:12.749632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.807054+0000","last_change":"2024-09-10T08:46:50.756330+0000","last_active":"2024-09-10T08:46:56.807054+0000","last_peered":"2024-09-10T08:46:56.807054+0000","last_clean":"2024-09-10T08:46:56.807054+0000","last_became_active":"2024-09-10T08:46:50.755912+0000","last_became_peered":"2024-09-10T08:46:50.755912+0000","last_unstale":"2024-09-10T08:46:56.807054+0000","last_undegraded":"2024-09-10T08:46:56.807054+0000","last_fullsized":"2024-09-10T08:46:56.807054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:13:16.717444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.806363+0000","last_change":"2024-09-10T08:46:55.881993+0000","last_active":"2024-09-10T08:46:56.806363+0000","last_peered":"2024-09-10T08:46:56.806363+0000","last_clean":"2024-09-10T08:46:56.806363+0000","last_became_active":"2024-09-10T08:46:55.881654+0000","last_became_peered":"2024-09-10T08:46:55.881654+0000","last_unstale":"2024-09-10T08:46:56.806363+0000","last_undegraded":"2024-09-10T08:46:56.806363+0000","last_fullsized":"2024-09-10T08:46:56.806363+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:28.652609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.084400+0000","last_change":"2024-09-10T08:46:51.791470+0000","last_active":"2024-09-10T08:46:58.084400+0000","last_peered":"2024-09-10T08:46:58.084400+0000","last_clean":"2024-09-10T08:46:58.084400+0000","last_became_active":"2024-09-10T08:46:51.789315+0000","last_became_peered":"2024-09-10T08:46:51.789315+0000","last_unstale":"2024-09-10T08:46:58.084400+0000","last_undegraded":"2024-09-10T08:46:58.084400+0000","last_fullsized":"2024-09-10T08:46:58.084400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:35:58.356947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083695+0000","last_change":"2024-09-10T08:46:50.763200+0000","last_active":"2024-09-10T08:46:58.083695+0000","last_peered":"2024-09-10T08:46:58.083695+0000","last_clean":"2024-09-10T08:46:58.083695+0000","last_became_active":"2024-09-10T08:46:50.761919+0000","last_became_peered":"2024-09-10T08:46:50.761919+0000","last_unstale":"2024-09-10T08:46:58.083695+0000","last_undegraded":"2024-09-10T08:46:58.083695+0000","last_fullsized":"2024-09-10T08:46:58.083695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:27:43.187268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082087+0000","last_change":"2024-09-10T08:46:55.879120+0000","last_active":"2024-09-10T08:46:58.082087+0000","last_peered":"2024-09-10T08:46:58.082087+0000","last_clean":"2024-09-10T08:46:58.082087+0000","last_became_active":"2024-09-10T08:46:55.878150+0000","last_became_peered":"2024-09-10T08:46:55.878150+0000","last_unstale":"2024-09-10T08:46:58.082087+0000","last_undegraded":"2024-09-10T08:46:58.082087+0000","last_fullsized":"2024-09-10T08:46:58.082087+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:49:07.750480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083493+0000","last_change":"2024-09-10T08:46:51.764062+0000","last_active":"2024-09-10T08:46:58.083493+0000","last_peered":"2024-09-10T08:46:58.083493+0000","last_clean":"2024-09-10T08:46:58.083493+0000","last_became_active":"2024-09-10T08:46:51.763032+0000","last_became_peered":"2024-09-10T08:46:51.763032+0000","last_unstale":"2024-09-10T08:46:58.083493+0000","last_undegraded":"2024-09-10T08:46:58.083493+0000","last_fullsized":"2024-09-10T08:46:58.083493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:12:29.713395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.962641+0000","last_change":"2024-09-10T08:46:50.774433+0000","last_active":"2024-09-10T08:46:57.962641+0000","last_peered":"2024-09-10T08:46:57.962641+0000","last_clean":"2024-09-10T08:46:57.962641+0000","last_became_active":"2024-09-10T08:46:50.774032+0000","last_became_peered":"2024-09-10T08:46:50.774032+0000","last_unstale":"2024-09-10T08:46:57.962641+0000","last_undegraded":"2024-09-10T08:46:57.962641+0000","last_fullsized":"2024-09-10T08:46:57.962641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:20:23.136708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.569437+0000","last_change":"2024-09-10T08:46:55.884303+0000","last_active":"2024-09-10T08:46:57.569437+0000","last_peered":"2024-09-10T08:46:57.569437+0000","last_clean":"2024-09-10T08:46:57.569437+0000","last_became_active":"2024-09-10T08:46:55.880606+0000","last_became_peered":"2024-09-10T08:46:55.880606+0000","last_unstale":"2024-09-10T08:46:57.569437+0000","last_undegraded":"2024-09-10T08:46:57.569437+0000","last_fullsized":"2024-09-10T08:46:57.569437+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:28.966981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083135+0000","last_change":"2024-09-10T08:46:51.782882+0000","last_active":"2024-09-10T08:46:58.083135+0000","last_peered":"2024-09-10T08:46:58.083135+0000","last_clean":"2024-09-10T08:46:58.083135+0000","last_became_active":"2024-09-10T08:46:51.782618+0000","last_became_peered":"2024-09-10T08:46:51.782618+0000","last_unstale":"2024-09-10T08:46:58.083135+0000","last_undegraded":"2024-09-10T08:46:58.083135+0000","last_fullsized":"2024-09-10T08:46:58.083135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:53:54.788208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083587+0000","last_change":"2024-09-10T08:46:50.771532+0000","last_active":"2024-09-10T08:46:58.083587+0000","last_peered":"2024-09-10T08:46:58.083587+0000","last_clean":"2024-09-10T08:46:58.083587+0000","last_became_active":"2024-09-10T08:46:50.771211+0000","last_became_peered":"2024-09-10T08:46:50.771211+0000","last_unstale":"2024-09-10T08:46:58.083587+0000","last_undegraded":"2024-09-10T08:46:58.083587+0000","last_fullsized":"2024-09-10T08:46:58.083587+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:23:06.043116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083105+0000","last_change":"2024-09-10T08:46:55.833301+0000","last_active":"2024-09-10T08:46:58.083105+0000","last_peered":"2024-09-10T08:46:58.083105+0000","last_clean":"2024-09-10T08:46:58.083105+0000","last_became_active":"2024-09-10T08:46:55.832778+0000","last_became_peered":"2024-09-10T08:46:55.832778+0000","last_unstale":"2024-09-10T08:46:58.083105+0000","last_undegraded":"2024-09-10T08:46:58.083105+0000","last_fullsized":"2024-09-10T08:46:58.083105+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:38:27.475264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.806724+0000","last_change":"2024-09-10T08:46:51.773996+0000","last_active":"2024-09-10T08:46:56.806724+0000","last_peered":"2024-09-10T08:46:56.806724+0000","last_clean":"2024-09-10T08:46:56.806724+0000","last_became_active":"2024-09-10T08:46:51.773689+0000","last_became_peered":"2024-09-10T08:46:51.773689+0000","last_unstale":"2024-09-10T08:46:56.806724+0000","last_undegraded":"2024-09-10T08:46:56.806724+0000","last_fullsized":"2024-09-10T08:46:56.806724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:27:44.194949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083163+0000","last_change":"2024-09-10T08:46:50.769707+0000","last_active":"2024-09-10T08:46:58.083163+0000","last_peered":"2024-09-10T08:46:58.083163+0000","last_clean":"2024-09-10T08:46:58.083163+0000","last_became_active":"2024-09-10T08:46:50.769431+0000","last_became_peered":"2024-09-10T08:46:50.769431+0000","last_unstale":"2024-09-10T08:46:58.083163+0000","last_undegraded":"2024-09-10T08:46:58.083163+0000","last_fullsized":"2024-09-10T08:46:58.083163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:38:26.709117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083580+0000","last_change":"2024-09-10T08:46:55.825975+0000","last_active":"2024-09-10T08:46:58.083580+0000","last_peered":"2024-09-10T08:46:58.083580+0000","last_clean":"2024-09-10T08:46:58.083580+0000","last_became_active":"2024-09-10T08:46:55.824646+0000","last_became_peered":"2024-09-10T08:46:55.824646+0000","last_unstale":"2024-09-10T08:46:58.083580+0000","last_undegraded":"2024-09-10T08:46:58.083580+0000","last_fullsized":"2024-09-10T08:46:58.083580+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:30.769030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082407+0000","last_change":"2024-09-10T08:46:51.763566+0000","last_active":"2024-09-10T08:46:58.082407+0000","last_peered":"2024-09-10T08:46:58.082407+0000","last_clean":"2024-09-10T08:46:58.082407+0000","last_became_active":"2024-09-10T08:46:51.762799+0000","last_became_peered":"2024-09-10T08:46:51.762799+0000","last_unstale":"2024-09-10T08:46:58.082407+0000","last_undegraded":"2024-09-10T08:46:58.082407+0000","last_fullsized":"2024-09-10T08:46:58.082407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:32:41.996036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.804105+0000","last_change":"2024-09-10T08:46:50.759355+0000","last_active":"2024-09-10T08:46:56.804105+0000","last_peered":"2024-09-10T08:46:56.804105+0000","last_clean":"2024-09-10T08:46:56.804105+0000","last_became_active":"2024-09-10T08:46:50.758565+0000","last_became_peered":"2024-09-10T08:46:50.758565+0000","last_unstale":"2024-09-10T08:46:56.804105+0000","last_undegraded":"2024-09-10T08:46:56.804105+0000","last_fullsized":"2024-09-10T08:46:56.804105+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:02:43.005946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083886+0000","last_change":"2024-09-10T08:46:55.840925+0000","last_active":"2024-09-10T08:46:58.083886+0000","last_peered":"2024-09-10T08:46:58.083886+0000","last_clean":"2024-09-10T08:46:58.083886+0000","last_became_active":"2024-09-10T08:46:55.839186+0000","last_became_peered":"2024-09-10T08:46:55.839186+0000","last_unstale":"2024-09-10T08:46:58.083886+0000","last_undegraded":"2024-09-10T08:46:58.083886+0000","last_fullsized":"2024-09-10T08:46:58.083886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:28.966981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.568979+0000","last_change":"2024-09-10T08:46:51.793589+0000","last_active":"2024-09-10T08:46:57.568979+0000","last_peered":"2024-09-10T08:46:57.568979+0000","last_clean":"2024-09-10T08:46:57.568979+0000","last_became_active":"2024-09-10T08:46:51.792999+0000","last_became_peered":"2024-09-10T08:46:51.792999+0000","last_unstale":"2024-09-10T08:46:57.568979+0000","last_undegraded":"2024-09-10T08:46:57.568979+0000","last_fullsized":"2024-09-10T08:46:57.568979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:43:11.183186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.961882+0000","last_change":"2024-09-10T08:46:50.769021+0000","last_active":"2024-09-10T08:46:57.961882+0000","last_peered":"2024-09-10T08:46:57.961882+0000","last_clean":"2024-09-10T08:46:57.961882+0000","last_became_active":"2024-09-10T08:46:50.768447+0000","last_became_peered":"2024-09-10T08:46:50.768447+0000","last_unstale":"2024-09-10T08:46:57.961882+0000","last_undegraded":"2024-09-10T08:46:57.961882+0000","last_fullsized":"2024-09-10T08:46:57.961882+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:16:38.293555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.569408+0000","last_change":"2024-09-10T08:46:55.882489+0000","last_active":"2024-09-10T08:46:57.569408+0000","last_peered":"2024-09-10T08:46:57.569408+0000","last_clean":"2024-09-10T08:46:57.569408+0000","last_became_active":"2024-09-10T08:46:55.880753+0000","last_became_peered":"2024-09-10T08:46:55.880753+0000","last_unstale":"2024-09-10T08:46:57.569408+0000","last_undegraded":"2024-09-10T08:46:57.569408+0000","last_fullsized":"2024-09-10T08:46:57.569408+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:32:51.937086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082212+0000","last_change":"2024-09-10T08:46:51.780317+0000","last_active":"2024-09-10T08:46:58.082212+0000","last_peered":"2024-09-10T08:46:58.082212+0000","last_clean":"2024-09-10T08:46:58.082212+0000","last_became_active":"2024-09-10T08:46:51.780024+0000","last_became_peered":"2024-09-10T08:46:51.780024+0000","last_unstale":"2024-09-10T08:46:58.082212+0000","last_undegraded":"2024-09-10T08:46:58.082212+0000","last_fullsized":"2024-09-10T08:46:58.082212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:32:41.996036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082934+0000","last_change":"2024-09-10T08:46:50.765202+0000","last_active":"2024-09-10T08:46:58.082934+0000","last_peered":"2024-09-10T08:46:58.082934+0000","last_clean":"2024-09-10T08:46:58.082934+0000","last_became_active":"2024-09-10T08:46:50.762976+0000","last_became_peered":"2024-09-10T08:46:50.762976+0000","last_unstale":"2024-09-10T08:46:58.082934+0000","last_undegraded":"2024-09-10T08:46:58.082934+0000","last_fullsized":"2024-09-10T08:46:58.082934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:13:16.717444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.962109+0000","last_change":"2024-09-10T08:46:42.177049+0000","last_active":"2024-09-10T08:46:57.962109+0000","last_peered":"2024-09-10T08:46:57.962109+0000","last_clean":"2024-09-10T08:46:57.962109+0000","last_became_active":"2024-09-10T08:46:42.175678+0000","last_became_peered":"2024-09-10T08:46:42.175678+0000","last_unstale":"2024-09-10T08:46:57.962109+0000","last_undegraded":"2024-09-10T08:46:57.962109+0000","last_fullsized":"2024-09-10T08:46:57.962109+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:40.326212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:40.326212+0000","last_clean_scrub_stamp":"2024-09-10T08:46:40.326212+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:06.642437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.806408+0000","last_change":"2024-09-10T08:46:55.881533+0000","last_active":"2024-09-10T08:46:56.806408+0000","last_peered":"2024-09-10T08:46:56.806408+0000","last_clean":"2024-09-10T08:46:56.806408+0000","last_became_active":"2024-09-10T08:46:55.880157+0000","last_became_peered":"2024-09-10T08:46:55.880157+0000","last_unstale":"2024-09-10T08:46:56.806408+0000","last_undegraded":"2024-09-10T08:46:56.806408+0000","last_fullsized":"2024-09-10T08:46:56.806408+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:17:54.613658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.962401+0000","last_change":"2024-09-10T08:46:51.793262+0000","last_active":"2024-09-10T08:46:57.962401+0000","last_peered":"2024-09-10T08:46:57.962401+0000","last_clean":"2024-09-10T08:46:57.962401+0000","last_became_active":"2024-09-10T08:46:51.792966+0000","last_became_peered":"2024-09-10T08:46:51.792966+0000","last_unstale":"2024-09-10T08:46:57.962401+0000","last_undegraded":"2024-09-10T08:46:57.962401+0000","last_fullsized":"2024-09-10T08:46:57.962401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:38:23.420671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.804380+0000","last_change":"2024-09-10T08:46:50.768436+0000","last_active":"2024-09-10T08:46:56.804380+0000","last_peered":"2024-09-10T08:46:56.804380+0000","last_clean":"2024-09-10T08:46:56.804380+0000","last_became_active":"2024-09-10T08:46:50.767236+0000","last_became_peered":"2024-09-10T08:46:50.767236+0000","last_unstale":"2024-09-10T08:46:56.804380+0000","last_undegraded":"2024-09-10T08:46:56.804380+0000","last_fullsized":"2024-09-10T08:46:56.804380+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:36:19.851847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.804996+0000","last_change":"2024-09-10T08:46:55.881541+0000","last_active":"2024-09-10T08:46:56.804996+0000","last_peered":"2024-09-10T08:46:56.804996+0000","last_clean":"2024-09-10T08:46:56.804996+0000","last_became_active":"2024-09-10T08:46:55.881029+0000","last_became_peered":"2024-09-10T08:46:55.881029+0000","last_unstale":"2024-09-10T08:46:56.804996+0000","last_undegraded":"2024-09-10T08:46:56.804996+0000","last_fullsized":"2024-09-10T08:46:56.804996+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:02.411540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083119+0000","last_change":"2024-09-10T08:46:51.783403+0000","last_active":"2024-09-10T08:46:58.083119+0000","last_peered":"2024-09-10T08:46:58.083119+0000","last_clean":"2024-09-10T08:46:58.083119+0000","last_became_active":"2024-09-10T08:46:51.781308+0000","last_became_peered":"2024-09-10T08:46:51.781308+0000","last_unstale":"2024-09-10T08:46:58.083119+0000","last_undegraded":"2024-09-10T08:46:58.083119+0000","last_fullsized":"2024-09-10T08:46:58.083119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:24:26.259501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083401+0000","last_change":"2024-09-10T08:46:50.769999+0000","last_active":"2024-09-10T08:46:58.083401+0000","last_peered":"2024-09-10T08:46:58.083401+0000","last_clean":"2024-09-10T08:46:58.083401+0000","last_became_active":"2024-09-10T08:46:50.769664+0000","last_became_peered":"2024-09-10T08:46:50.769664+0000","last_unstale":"2024-09-10T08:46:58.083401+0000","last_undegraded":"2024-09-10T08:46:58.083401+0000","last_fullsized":"2024-09-10T08:46:58.083401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:16:38.293555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.569544+0000","last_change":"2024-09-10T08:46:55.835422+0000","last_active":"2024-09-10T08:46:57.569544+0000","last_peered":"2024-09-10T08:46:57.569544+0000","last_clean":"2024-09-10T08:46:57.569544+0000","last_became_active":"2024-09-10T08:46:55.834891+0000","last_became_peered":"2024-09-10T08:46:55.834891+0000","last_unstale":"2024-09-10T08:46:57.569544+0000","last_undegraded":"2024-09-10T08:46:57.569544+0000","last_fullsized":"2024-09-10T08:46:57.569544+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:49:07.750480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.962646+0000","last_change":"2024-09-10T08:46:51.790394+0000","last_active":"2024-09-10T08:46:57.962646+0000","last_peered":"2024-09-10T08:46:57.962646+0000","last_clean":"2024-09-10T08:46:57.962646+0000","last_became_active":"2024-09-10T08:46:51.790110+0000","last_became_peered":"2024-09-10T08:46:51.790110+0000","last_unstale":"2024-09-10T08:46:57.962646+0000","last_undegraded":"2024-09-10T08:46:57.962646+0000","last_fullsized":"2024-09-10T08:46:57.962646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:32:47.882493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.804824+0000","last_change":"2024-09-10T08:46:50.768366+0000","last_active":"2024-09-10T08:46:56.804824+0000","last_peered":"2024-09-10T08:46:56.804824+0000","last_clean":"2024-09-10T08:46:56.804824+0000","last_became_active":"2024-09-10T08:46:50.768064+0000","last_became_peered":"2024-09-10T08:46:50.768064+0000","last_unstale":"2024-09-10T08:46:56.804824+0000","last_undegraded":"2024-09-10T08:46:56.804824+0000","last_fullsized":"2024-09-10T08:46:56.804824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:41:14.189488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082532+0000","last_change":"2024-09-10T08:46:55.881381+0000","last_active":"2024-09-10T08:46:58.082532+0000","last_peered":"2024-09-10T08:46:58.082532+0000","last_clean":"2024-09-10T08:46:58.082532+0000","last_became_active":"2024-09-10T08:46:55.880233+0000","last_became_peered":"2024-09-10T08:46:55.880233+0000","last_unstale":"2024-09-10T08:46:58.082532+0000","last_undegraded":"2024-09-10T08:46:58.082532+0000","last_fullsized":"2024-09-10T08:46:58.082532+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:18:56.316368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.962469+0000","last_change":"2024-09-10T08:46:51.796394+0000","last_active":"2024-09-10T08:46:57.962469+0000","last_peered":"2024-09-10T08:46:57.962469+0000","last_clean":"2024-09-10T08:46:57.962469+0000","last_became_active":"2024-09-10T08:46:51.795460+0000","last_became_peered":"2024-09-10T08:46:51.795460+0000","last_unstale":"2024-09-10T08:46:57.962469+0000","last_undegraded":"2024-09-10T08:46:57.962469+0000","last_fullsized":"2024-09-10T08:46:57.962469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:24.912388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.805830+0000","last_change":"2024-09-10T08:46:50.764621+0000","last_active":"2024-09-10T08:46:56.805830+0000","last_peered":"2024-09-10T08:46:56.805830+0000","last_clean":"2024-09-10T08:46:56.805830+0000","last_became_active":"2024-09-10T08:46:50.764262+0000","last_became_peered":"2024-09-10T08:46:50.764262+0000","last_unstale":"2024-09-10T08:46:56.805830+0000","last_undegraded":"2024-09-10T08:46:56.805830+0000","last_fullsized":"2024-09-10T08:46:56.805830+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:18.256394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.805988+0000","last_change":"2024-09-10T08:46:55.835039+0000","last_active":"2024-09-10T08:46:56.805988+0000","last_peered":"2024-09-10T08:46:56.805988+0000","last_clean":"2024-09-10T08:46:56.805988+0000","last_became_active":"2024-09-10T08:46:55.834520+0000","last_became_peered":"2024-09-10T08:46:55.834520+0000","last_unstale":"2024-09-10T08:46:56.805988+0000","last_undegraded":"2024-09-10T08:46:56.805988+0000","last_fullsized":"2024-09-10T08:46:56.805988+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:28.297454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.962089+0000","last_change":"2024-09-10T08:46:51.792053+0000","last_active":"2024-09-10T08:46:57.962089+0000","last_peered":"2024-09-10T08:46:57.962089+0000","last_clean":"2024-09-10T08:46:57.962089+0000","last_became_active":"2024-09-10T08:46:51.791729+0000","last_became_peered":"2024-09-10T08:46:51.791729+0000","last_unstale":"2024-09-10T08:46:57.962089+0000","last_undegraded":"2024-09-10T08:46:57.962089+0000","last_fullsized":"2024-09-10T08:46:57.962089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:35:58.356947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.803934+0000","last_change":"2024-09-10T08:46:50.762530+0000","last_active":"2024-09-10T08:46:56.803934+0000","last_peered":"2024-09-10T08:46:56.803934+0000","last_clean":"2024-09-10T08:46:56.803934+0000","last_became_active":"2024-09-10T08:46:50.762274+0000","last_became_peered":"2024-09-10T08:46:50.762274+0000","last_unstale":"2024-09-10T08:46:56.803934+0000","last_undegraded":"2024-09-10T08:46:56.803934+0000","last_fullsized":"2024-09-10T08:46:56.803934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:38:26.709117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.569309+0000","last_change":"2024-09-10T08:46:55.837828+0000","last_active":"2024-09-10T08:46:57.569309+0000","last_peered":"2024-09-10T08:46:57.569309+0000","last_clean":"2024-09-10T08:46:57.569309+0000","last_became_active":"2024-09-10T08:46:55.837157+0000","last_became_peered":"2024-09-10T08:46:55.837157+0000","last_unstale":"2024-09-10T08:46:57.569309+0000","last_undegraded":"2024-09-10T08:46:57.569309+0000","last_fullsized":"2024-09-10T08:46:57.569309+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:30.769030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.805426+0000","last_change":"2024-09-10T08:46:51.780767+0000","last_active":"2024-09-10T08:46:56.805426+0000","last_peered":"2024-09-10T08:46:56.805426+0000","last_clean":"2024-09-10T08:46:56.805426+0000","last_became_active":"2024-09-10T08:46:51.780429+0000","last_became_peered":"2024-09-10T08:46:51.780429+0000","last_unstale":"2024-09-10T08:46:56.805426+0000","last_undegraded":"2024-09-10T08:46:56.805426+0000","last_fullsized":"2024-09-10T08:46:56.805426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:43:11.183186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.805298+0000","last_change":"2024-09-10T08:46:50.767724+0000","last_active":"2024-09-10T08:46:56.805298+0000","last_peered":"2024-09-10T08:46:56.805298+0000","last_clean":"2024-09-10T08:46:56.805298+0000","last_became_active":"2024-09-10T08:46:50.767440+0000","last_became_peered":"2024-09-10T08:46:50.767440+0000","last_unstale":"2024-09-10T08:46:56.805298+0000","last_undegraded":"2024-09-10T08:46:56.805298+0000","last_fullsized":"2024-09-10T08:46:56.805298+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:36:19.851847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.084325+0000","last_change":"2024-09-10T08:46:55.881726+0000","last_active":"2024-09-10T08:46:58.084325+0000","last_peered":"2024-09-10T08:46:58.084325+0000","last_clean":"2024-09-10T08:46:58.084325+0000","last_became_active":"2024-09-10T08:46:55.881215+0000","last_became_peered":"2024-09-10T08:46:55.881215+0000","last_unstale":"2024-09-10T08:46:58.084325+0000","last_undegraded":"2024-09-10T08:46:58.084325+0000","last_fullsized":"2024-09-10T08:46:58.084325+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:55:12.631797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.962268+0000","last_change":"2024-09-10T08:46:51.802443+0000","last_active":"2024-09-10T08:46:57.962268+0000","last_peered":"2024-09-10T08:46:57.962268+0000","last_clean":"2024-09-10T08:46:57.962268+0000","last_became_active":"2024-09-10T08:46:51.800377+0000","last_became_peered":"2024-09-10T08:46:51.800377+0000","last_unstale":"2024-09-10T08:46:57.962268+0000","last_undegraded":"2024-09-10T08:46:57.962268+0000","last_fullsized":"2024-09-10T08:46:57.962268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:17:50.559065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082973+0000","last_change":"2024-09-10T08:46:50.770106+0000","last_active":"2024-09-10T08:46:58.082973+0000","last_peered":"2024-09-10T08:46:58.082973+0000","last_clean":"2024-09-10T08:46:58.082973+0000","last_became_active":"2024-09-10T08:46:50.769664+0000","last_became_peered":"2024-09-10T08:46:50.769664+0000","last_unstale":"2024-09-10T08:46:58.082973+0000","last_undegraded":"2024-09-10T08:46:58.082973+0000","last_fullsized":"2024-09-10T08:46:58.082973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:02:43.005946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082899+0000","last_change":"2024-09-10T08:46:55.878519+0000","last_active":"2024-09-10T08:46:58.082899+0000","last_peered":"2024-09-10T08:46:58.082899+0000","last_clean":"2024-09-10T08:46:58.082899+0000","last_became_active":"2024-09-10T08:46:55.877986+0000","last_became_peered":"2024-09-10T08:46:55.877986+0000","last_unstale":"2024-09-10T08:46:58.082899+0000","last_undegraded":"2024-09-10T08:46:58.082899+0000","last_fullsized":"2024-09-10T08:46:58.082899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:29:38.674946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.569136+0000","last_change":"2024-09-10T08:46:51.788482+0000","last_active":"2024-09-10T08:46:57.569136+0000","last_peered":"2024-09-10T08:46:57.569136+0000","last_clean":"2024-09-10T08:46:57.569136+0000","last_became_active":"2024-09-10T08:46:51.787872+0000","last_became_peered":"2024-09-10T08:46:51.787872+0000","last_unstale":"2024-09-10T08:46:57.569136+0000","last_undegraded":"2024-09-10T08:46:57.569136+0000","last_fullsized":"2024-09-10T08:46:57.569136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:49:28.950554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.569602+0000","last_change":"2024-09-10T08:46:50.766888+0000","last_active":"2024-09-10T08:46:57.569602+0000","last_peered":"2024-09-10T08:46:57.569602+0000","last_clean":"2024-09-10T08:46:57.569602+0000","last_became_active":"2024-09-10T08:46:50.766608+0000","last_became_peered":"2024-09-10T08:46:50.766608+0000","last_unstale":"2024-09-10T08:46:57.569602+0000","last_undegraded":"2024-09-10T08:46:57.569602+0000","last_fullsized":"2024-09-10T08:46:57.569602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:41:14.189488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083056+0000","last_change":"2024-09-10T08:46:55.878767+0000","last_active":"2024-09-10T08:46:58.083056+0000","last_peered":"2024-09-10T08:46:58.083056+0000","last_clean":"2024-09-10T08:46:58.083056+0000","last_became_active":"2024-09-10T08:46:55.878328+0000","last_became_peered":"2024-09-10T08:46:55.878328+0000","last_unstale":"2024-09-10T08:46:58.083056+0000","last_undegraded":"2024-09-10T08:46:58.083056+0000","last_fullsized":"2024-09-10T08:46:58.083056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:29:38.674946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.962269+0000","last_change":"2024-09-10T08:46:51.782671+0000","last_active":"2024-09-10T08:46:57.962269+0000","last_peered":"2024-09-10T08:46:57.962269+0000","last_clean":"2024-09-10T08:46:57.962269+0000","last_became_active":"2024-09-10T08:46:51.782072+0000","last_became_peered":"2024-09-10T08:46:51.782072+0000","last_unstale":"2024-09-10T08:46:57.962269+0000","last_undegraded":"2024-09-10T08:46:57.962269+0000","last_fullsized":"2024-09-10T08:46:57.962269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:24:26.259501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:47:03.196847+0000","last_change":"2024-09-10T08:46:50.763937+0000","last_active":"2024-09-10T08:47:03.196847+0000","last_peered":"2024-09-10T08:47:03.196847+0000","last_clean":"2024-09-10T08:47:03.196847+0000","last_became_active":"2024-09-10T08:46:50.763447+0000","last_became_peered":"2024-09-10T08:46:50.763447+0000","last_unstale":"2024-09-10T08:47:03.196847+0000","last_undegraded":"2024-09-10T08:47:03.196847+0000","last_fullsized":"2024-09-10T08:47:03.196847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:16:38.293555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083220+0000","last_change":"2024-09-10T08:46:55.822409+0000","last_active":"2024-09-10T08:46:58.083220+0000","last_peered":"2024-09-10T08:46:58.083220+0000","last_clean":"2024-09-10T08:46:58.083220+0000","last_became_active":"2024-09-10T08:46:55.821875+0000","last_became_peered":"2024-09-10T08:46:55.821875+0000","last_unstale":"2024-09-10T08:46:58.083220+0000","last_undegraded":"2024-09-10T08:46:58.083220+0000","last_fullsized":"2024-09-10T08:46:58.083220+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:53:58.842801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.805662+0000","last_change":"2024-09-10T08:46:51.780453+0000","last_active":"2024-09-10T08:46:56.805662+0000","last_peered":"2024-09-10T08:46:56.805662+0000","last_clean":"2024-09-10T08:46:56.805662+0000","last_became_active":"2024-09-10T08:46:51.780160+0000","last_became_peered":"2024-09-10T08:46:51.780160+0000","last_unstale":"2024-09-10T08:46:56.805662+0000","last_undegraded":"2024-09-10T08:46:56.805662+0000","last_fullsized":"2024-09-10T08:46:56.805662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:23:07.050797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083373+0000","last_change":"2024-09-10T08:46:50.777289+0000","last_active":"2024-09-10T08:46:58.083373+0000","last_peered":"2024-09-10T08:46:58.083373+0000","last_clean":"2024-09-10T08:46:58.083373+0000","last_became_active":"2024-09-10T08:46:50.776985+0000","last_became_peered":"2024-09-10T08:46:50.776985+0000","last_unstale":"2024-09-10T08:46:58.083373+0000","last_undegraded":"2024-09-10T08:46:58.083373+0000","last_fullsized":"2024-09-10T08:46:58.083373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:13:16.717444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.806645+0000","last_change":"2024-09-10T08:46:55.818962+0000","last_active":"2024-09-10T08:46:56.806645+0000","last_peered":"2024-09-10T08:46:56.806645+0000","last_clean":"2024-09-10T08:46:56.806645+0000","last_became_active":"2024-09-10T08:46:55.818548+0000","last_became_peered":"2024-09-10T08:46:55.818548+0000","last_unstale":"2024-09-10T08:46:56.806645+0000","last_undegraded":"2024-09-10T08:46:56.806645+0000","last_fullsized":"2024-09-10T08:46:56.806645+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:24:30.314094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.569570+0000","last_change":"2024-09-10T08:46:51.786958+0000","last_active":"2024-09-10T08:46:57.569570+0000","last_peered":"2024-09-10T08:46:57.569570+0000","last_clean":"2024-09-10T08:46:57.569570+0000","last_became_active":"2024-09-10T08:46:51.786679+0000","last_became_peered":"2024-09-10T08:46:51.786679+0000","last_unstale":"2024-09-10T08:46:57.569570+0000","last_undegraded":"2024-09-10T08:46:57.569570+0000","last_fullsized":"2024-09-10T08:46:57.569570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:12:29.713395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083066+0000","last_change":"2024-09-10T08:46:50.770627+0000","last_active":"2024-09-10T08:46:58.083066+0000","last_peered":"2024-09-10T08:46:58.083066+0000","last_clean":"2024-09-10T08:46:58.083066+0000","last_became_active":"2024-09-10T08:46:50.770108+0000","last_became_peered":"2024-09-10T08:46:50.770108+0000","last_unstale":"2024-09-10T08:46:58.083066+0000","last_undegraded":"2024-09-10T08:46:58.083066+0000","last_fullsized":"2024-09-10T08:46:58.083066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:16:38.293555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082271+0000","last_change":"2024-09-10T08:46:55.834973+0000","last_active":"2024-09-10T08:46:58.082271+0000","last_peered":"2024-09-10T08:46:58.082271+0000","last_clean":"2024-09-10T08:46:58.082271+0000","last_became_active":"2024-09-10T08:46:55.834553+0000","last_became_peered":"2024-09-10T08:46:55.834553+0000","last_unstale":"2024-09-10T08:46:58.082271+0000","last_undegraded":"2024-09-10T08:46:58.082271+0000","last_fullsized":"2024-09-10T08:46:58.082271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:48:45.215364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082933+0000","last_change":"2024-09-10T08:46:51.792047+0000","last_active":"2024-09-10T08:46:58.082933+0000","last_peered":"2024-09-10T08:46:58.082933+0000","last_clean":"2024-09-10T08:46:58.082933+0000","last_became_active":"2024-09-10T08:46:51.790021+0000","last_became_peered":"2024-09-10T08:46:51.790021+0000","last_unstale":"2024-09-10T08:46:58.082933+0000","last_undegraded":"2024-09-10T08:46:58.082933+0000","last_fullsized":"2024-09-10T08:46:58.082933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:26.714437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.806941+0000","last_change":"2024-09-10T08:46:50.766074+0000","last_active":"2024-09-10T08:46:56.806941+0000","last_peered":"2024-09-10T08:46:56.806941+0000","last_clean":"2024-09-10T08:46:56.806941+0000","last_became_active":"2024-09-10T08:46:50.765744+0000","last_became_peered":"2024-09-10T08:46:50.765744+0000","last_unstale":"2024-09-10T08:46:56.806941+0000","last_undegraded":"2024-09-10T08:46:56.806941+0000","last_fullsized":"2024-09-10T08:46:56.806941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:02:43.005946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082526+0000","last_change":"2024-09-10T08:46:55.883453+0000","last_active":"2024-09-10T08:46:58.082526+0000","last_peered":"2024-09-10T08:46:58.082526+0000","last_clean":"2024-09-10T08:46:58.082526+0000","last_became_active":"2024-09-10T08:46:55.883030+0000","last_became_peered":"2024-09-10T08:46:55.883030+0000","last_unstale":"2024-09-10T08:46:58.082526+0000","last_undegraded":"2024-09-10T08:46:58.082526+0000","last_fullsized":"2024-09-10T08:46:58.082526+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:18:56.316368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.569239+0000","last_change":"2024-09-10T08:46:55.885568+0000","last_active":"2024-09-10T08:46:57.569239+0000","last_peered":"2024-09-10T08:46:57.569239+0000","last_clean":"2024-09-10T08:46:57.569239+0000","last_became_active":"2024-09-10T08:46:55.884728+0000","last_became_peered":"2024-09-10T08:46:55.884728+0000","last_unstale":"2024-09-10T08:46:57.569239+0000","last_undegraded":"2024-09-10T08:46:57.569239+0000","last_fullsized":"2024-09-10T08:46:57.569239+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:53:58.842801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082702+0000","last_change":"2024-09-10T08:46:51.772447+0000","last_active":"2024-09-10T08:46:58.082702+0000","last_peered":"2024-09-10T08:46:58.082702+0000","last_clean":"2024-09-10T08:46:58.082702+0000","last_became_active":"2024-09-10T08:46:51.772157+0000","last_became_peered":"2024-09-10T08:46:51.772157+0000","last_unstale":"2024-09-10T08:46:58.082702+0000","last_undegraded":"2024-09-10T08:46:58.082702+0000","last_fullsized":"2024-09-10T08:46:58.082702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:55:01.331346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082601+0000","last_change":"2024-09-10T08:46:50.773438+0000","last_active":"2024-09-10T08:46:58.082601+0000","last_peered":"2024-09-10T08:46:58.082601+0000","last_clean":"2024-09-10T08:46:58.082601+0000","last_became_active":"2024-09-10T08:46:50.769939+0000","last_became_peered":"2024-09-10T08:46:50.769939+0000","last_unstale":"2024-09-10T08:46:58.082601+0000","last_undegraded":"2024-09-10T08:46:58.082601+0000","last_fullsized":"2024-09-10T08:46:58.082601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:27:43.187268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.806816+0000","last_change":"2024-09-10T08:46:55.833783+0000","last_active":"2024-09-10T08:46:56.806816+0000","last_peered":"2024-09-10T08:46:56.806816+0000","last_clean":"2024-09-10T08:46:56.806816+0000","last_became_active":"2024-09-10T08:46:55.833320+0000","last_became_peered":"2024-09-10T08:46:55.833320+0000","last_unstale":"2024-09-10T08:46:56.806816+0000","last_undegraded":"2024-09-10T08:46:56.806816+0000","last_fullsized":"2024-09-10T08:46:56.806816+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:24:30.314094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082200+0000","last_change":"2024-09-10T08:46:51.773700+0000","last_active":"2024-09-10T08:46:58.082200+0000","last_peered":"2024-09-10T08:46:58.082200+0000","last_clean":"2024-09-10T08:46:58.082200+0000","last_became_active":"2024-09-10T08:46:51.771497+0000","last_became_peered":"2024-09-10T08:46:51.771497+0000","last_unstale":"2024-09-10T08:46:58.082200+0000","last_undegraded":"2024-09-10T08:46:58.082200+0000","last_fullsized":"2024-09-10T08:46:58.082200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:12:29.713395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082693+0000","last_change":"2024-09-10T08:46:50.760228+0000","last_active":"2024-09-10T08:46:58.082693+0000","last_peered":"2024-09-10T08:46:58.082693+0000","last_clean":"2024-09-10T08:46:58.082693+0000","last_became_active":"2024-09-10T08:46:50.759920+0000","last_became_peered":"2024-09-10T08:46:50.759920+0000","last_unstale":"2024-09-10T08:46:58.082693+0000","last_undegraded":"2024-09-10T08:46:58.082693+0000","last_fullsized":"2024-09-10T08:46:58.082693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:41:14.189488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.805887+0000","last_change":"2024-09-10T08:46:50.767239+0000","last_active":"2024-09-10T08:46:56.805887+0000","last_peered":"2024-09-10T08:46:56.805887+0000","last_clean":"2024-09-10T08:46:56.805887+0000","last_became_active":"2024-09-10T08:46:50.766809+0000","last_became_peered":"2024-09-10T08:46:50.766809+0000","last_unstale":"2024-09-10T08:46:56.805887+0000","last_undegraded":"2024-09-10T08:46:56.805887+0000","last_fullsized":"2024-09-10T08:46:56.805887+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:38:26.709117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.569591+0000","last_change":"2024-09-10T08:46:51.794973+0000","last_active":"2024-09-10T08:46:57.569591+0000","last_peered":"2024-09-10T08:46:57.569591+0000","last_clean":"2024-09-10T08:46:57.569591+0000","last_became_active":"2024-09-10T08:46:51.794731+0000","last_became_peered":"2024-09-10T08:46:51.794731+0000","last_unstale":"2024-09-10T08:46:57.569591+0000","last_undegraded":"2024-09-10T08:46:57.569591+0000","last_fullsized":"2024-09-10T08:46:57.569591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:40:55.949890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.804311+0000","last_change":"2024-09-10T08:46:55.824916+0000","last_active":"2024-09-10T08:46:56.804311+0000","last_peered":"2024-09-10T08:46:56.804311+0000","last_clean":"2024-09-10T08:46:56.804311+0000","last_became_active":"2024-09-10T08:46:55.823750+0000","last_became_peered":"2024-09-10T08:46:55.823750+0000","last_unstale":"2024-09-10T08:46:56.804311+0000","last_undegraded":"2024-09-10T08:46:56.804311+0000","last_fullsized":"2024-09-10T08:46:56.804311+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:29:01.507822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082610+0000","last_change":"2024-09-10T08:46:50.759413+0000","last_active":"2024-09-10T08:46:58.082610+0000","last_peered":"2024-09-10T08:46:58.082610+0000","last_clean":"2024-09-10T08:46:58.082610+0000","last_became_active":"2024-09-10T08:46:50.759045+0000","last_became_peered":"2024-09-10T08:46:50.759045+0000","last_unstale":"2024-09-10T08:46:58.082610+0000","last_undegraded":"2024-09-10T08:46:58.082610+0000","last_fullsized":"2024-09-10T08:46:58.082610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:36:19.851847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.805928+0000","last_change":"2024-09-10T08:46:51.769795+0000","last_active":"2024-09-10T08:46:56.805928+0000","last_peered":"2024-09-10T08:46:56.805928+0000","last_clean":"2024-09-10T08:46:56.805928+0000","last_became_active":"2024-09-10T08:46:51.769482+0000","last_became_peered":"2024-09-10T08:46:51.769482+0000","last_unstale":"2024-09-10T08:46:56.805928+0000","last_undegraded":"2024-09-10T08:46:56.805928+0000","last_fullsized":"2024-09-10T08:46:56.805928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:16:39.301236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.084120+0000","last_change":"2024-09-10T08:46:55.827136+0000","last_active":"2024-09-10T08:46:58.084120+0000","last_peered":"2024-09-10T08:46:58.084120+0000","last_clean":"2024-09-10T08:46:58.084120+0000","last_became_active":"2024-09-10T08:46:55.826597+0000","last_became_peered":"2024-09-10T08:46:55.826597+0000","last_unstale":"2024-09-10T08:46:58.084120+0000","last_undegraded":"2024-09-10T08:46:58.084120+0000","last_fullsized":"2024-09-10T08:46:58.084120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:01:01.534963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.805190+0000","last_change":"2024-09-10T08:46:51.775032+0000","last_active":"2024-09-10T08:46:56.805190+0000","last_peered":"2024-09-10T08:46:56.805190+0000","last_clean":"2024-09-10T08:46:56.805190+0000","last_became_active":"2024-09-10T08:46:51.774669+0000","last_became_peered":"2024-09-10T08:46:51.774669+0000","last_unstale":"2024-09-10T08:46:56.805190+0000","last_undegraded":"2024-09-10T08:46:56.805190+0000","last_fullsized":"2024-09-10T08:46:56.805190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:40:55.949890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.804036+0000","last_change":"2024-09-10T08:46:51.796531+0000","last_active":"2024-09-10T08:46:56.804036+0000","last_peered":"2024-09-10T08:46:56.804036+0000","last_clean":"2024-09-10T08:46:56.804036+0000","last_became_active":"2024-09-10T08:46:51.796249+0000","last_became_peered":"2024-09-10T08:46:51.796249+0000","last_unstale":"2024-09-10T08:46:56.804036+0000","last_undegraded":"2024-09-10T08:46:56.804036+0000","last_fullsized":"2024-09-10T08:46:56.804036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:23:07.050797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083010+0000","last_change":"2024-09-10T08:46:51.781773+0000","last_active":"2024-09-10T08:46:58.083010+0000","last_peered":"2024-09-10T08:46:58.083010+0000","last_clean":"2024-09-10T08:46:58.083010+0000","last_became_active":"2024-09-10T08:46:51.781397+0000","last_became_peered":"2024-09-10T08:46:51.781397+0000","last_unstale":"2024-09-10T08:46:58.083010+0000","last_undegraded":"2024-09-10T08:46:58.083010+0000","last_fullsized":"2024-09-10T08:46:58.083010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:35:58.356947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.569502+0000","last_change":"2024-09-10T08:46:51.780877+0000","last_active":"2024-09-10T08:46:57.569502+0000","last_peered":"2024-09-10T08:46:57.569502+0000","last_clean":"2024-09-10T08:46:57.569502+0000","last_became_active":"2024-09-10T08:46:51.778471+0000","last_became_peered":"2024-09-10T08:46:51.778471+0000","last_unstale":"2024-09-10T08:46:57.569502+0000","last_undegraded":"2024-09-10T08:46:57.569502+0000","last_fullsized":"2024-09-10T08:46:57.569502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:32:41.996036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083021+0000","last_change":"2024-09-10T08:46:51.777079+0000","last_active":"2024-09-10T08:46:58.083021+0000","last_peered":"2024-09-10T08:46:58.083021+0000","last_clean":"2024-09-10T08:46:58.083021+0000","last_became_active":"2024-09-10T08:46:51.776561+0000","last_became_peered":"2024-09-10T08:46:51.776561+0000","last_unstale":"2024-09-10T08:46:58.083021+0000","last_undegraded":"2024-09-10T08:46:58.083021+0000","last_fullsized":"2024-09-10T08:46:58.083021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:17:48.493127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083242+0000","last_change":"2024-09-10T08:46:51.772455+0000","last_active":"2024-09-10T08:46:58.083242+0000","last_peered":"2024-09-10T08:46:58.083242+0000","last_clean":"2024-09-10T08:46:58.083242+0000","last_became_active":"2024-09-10T08:46:51.772177+0000","last_became_peered":"2024-09-10T08:46:51.772177+0000","last_unstale":"2024-09-10T08:46:58.083242+0000","last_undegraded":"2024-09-10T08:46:58.083242+0000","last_fullsized":"2024-09-10T08:46:58.083242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:56:12.749632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.807011+0000","last_change":"2024-09-10T08:46:51.787208+0000","last_active":"2024-09-10T08:46:56.807011+0000","last_peered":"2024-09-10T08:46:56.807011+0000","last_clean":"2024-09-10T08:46:56.807011+0000","last_became_active":"2024-09-10T08:46:51.786911+0000","last_became_peered":"2024-09-10T08:46:51.786911+0000","last_unstale":"2024-09-10T08:46:56.807011+0000","last_undegraded":"2024-09-10T08:46:56.807011+0000","last_fullsized":"2024-09-10T08:46:56.807011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:17:48.493127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.084355+0000","last_change":"2024-09-10T08:46:51.779942+0000","last_active":"2024-09-10T08:46:58.084355+0000","last_peered":"2024-09-10T08:46:58.084355+0000","last_clean":"2024-09-10T08:46:58.084355+0000","last_became_active":"2024-09-10T08:46:51.779570+0000","last_became_peered":"2024-09-10T08:46:51.779570+0000","last_unstale":"2024-09-10T08:46:58.084355+0000","last_undegraded":"2024-09-10T08:46:58.084355+0000","last_fullsized":"2024-09-10T08:46:58.084355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:24.598016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082596+0000","last_change":"2024-09-10T08:46:51.786869+0000","last_active":"2024-09-10T08:46:58.082596+0000","last_peered":"2024-09-10T08:46:58.082596+0000","last_clean":"2024-09-10T08:46:58.082596+0000","last_became_active":"2024-09-10T08:46:51.786574+0000","last_became_peered":"2024-09-10T08:46:51.786574+0000","last_unstale":"2024-09-10T08:46:58.082596+0000","last_undegraded":"2024-09-10T08:46:58.082596+0000","last_fullsized":"2024-09-10T08:46:58.082596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:12:29.713395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082590+0000","last_change":"2024-09-10T08:46:51.779669+0000","last_active":"2024-09-10T08:46:58.082590+0000","last_peered":"2024-09-10T08:46:58.082590+0000","last_clean":"2024-09-10T08:46:58.082590+0000","last_became_active":"2024-09-10T08:46:51.779155+0000","last_became_peered":"2024-09-10T08:46:51.779155+0000","last_unstale":"2024-09-10T08:46:58.082590+0000","last_undegraded":"2024-09-10T08:46:58.082590+0000","last_fullsized":"2024-09-10T08:46:58.082590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:43:11.183186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082731+0000","last_change":"2024-09-10T08:46:51.784754+0000","last_active":"2024-09-10T08:46:58.082731+0000","last_peered":"2024-09-10T08:46:58.082731+0000","last_clean":"2024-09-10T08:46:58.082731+0000","last_became_active":"2024-09-10T08:46:51.784415+0000","last_became_peered":"2024-09-10T08:46:51.784415+0000","last_unstale":"2024-09-10T08:46:58.082731+0000","last_undegraded":"2024-09-10T08:46:58.082731+0000","last_fullsized":"2024-09-10T08:46:58.082731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:24.242861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.569395+0000","last_change":"2024-09-10T08:46:51.788577+0000","last_active":"2024-09-10T08:46:57.569395+0000","last_peered":"2024-09-10T08:46:57.569395+0000","last_clean":"2024-09-10T08:46:57.569395+0000","last_became_active":"2024-09-10T08:46:51.787904+0000","last_became_peered":"2024-09-10T08:46:51.787904+0000","last_unstale":"2024-09-10T08:46:57.569395+0000","last_undegraded":"2024-09-10T08:46:57.569395+0000","last_fullsized":"2024-09-10T08:46:57.569395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:28:57.453229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.806471+0000","last_change":"2024-09-10T08:46:51.776337+0000","last_active":"2024-09-10T08:46:56.806471+0000","last_peered":"2024-09-10T08:46:56.806471+0000","last_clean":"2024-09-10T08:46:56.806471+0000","last_became_active":"2024-09-10T08:46:51.776001+0000","last_became_peered":"2024-09-10T08:46:51.776001+0000","last_unstale":"2024-09-10T08:46:56.806471+0000","last_undegraded":"2024-09-10T08:46:56.806471+0000","last_fullsized":"2024-09-10T08:46:56.806471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:32:41.996036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.962516+0000","last_change":"2024-09-10T08:46:51.782912+0000","last_active":"2024-09-10T08:46:57.962516+0000","last_peered":"2024-09-10T08:46:57.962516+0000","last_clean":"2024-09-10T08:46:57.962516+0000","last_became_active":"2024-09-10T08:46:51.782378+0000","last_became_peered":"2024-09-10T08:46:51.782378+0000","last_unstale":"2024-09-10T08:46:57.962516+0000","last_undegraded":"2024-09-10T08:46:57.962516+0000","last_fullsized":"2024-09-10T08:46:57.962516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:26.714437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.804805+0000","last_change":"2024-09-10T08:46:51.773571+0000","last_active":"2024-09-10T08:46:56.804805+0000","last_peered":"2024-09-10T08:46:56.804805+0000","last_clean":"2024-09-10T08:46:56.804805+0000","last_became_active":"2024-09-10T08:46:51.773315+0000","last_became_peered":"2024-09-10T08:46:51.773315+0000","last_unstale":"2024-09-10T08:46:56.804805+0000","last_undegraded":"2024-09-10T08:46:56.804805+0000","last_fullsized":"2024-09-10T08:46:56.804805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:20:24.144389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083297+0000","last_change":"2024-09-10T08:46:51.785342+0000","last_active":"2024-09-10T08:46:58.083297+0000","last_peered":"2024-09-10T08:46:58.083297+0000","last_clean":"2024-09-10T08:46:58.083297+0000","last_became_active":"2024-09-10T08:46:51.785045+0000","last_became_peered":"2024-09-10T08:46:51.785045+0000","last_unstale":"2024-09-10T08:46:58.083297+0000","last_undegraded":"2024-09-10T08:46:58.083297+0000","last_fullsized":"2024-09-10T08:46:58.083297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:38:23.420671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082446+0000","last_change":"2024-09-10T08:46:51.779497+0000","last_active":"2024-09-10T08:46:58.082446+0000","last_peered":"2024-09-10T08:46:58.082446+0000","last_clean":"2024-09-10T08:46:58.082446+0000","last_became_active":"2024-09-10T08:46:51.778862+0000","last_became_peered":"2024-09-10T08:46:51.778862+0000","last_unstale":"2024-09-10T08:46:58.082446+0000","last_undegraded":"2024-09-10T08:46:58.082446+0000","last_fullsized":"2024-09-10T08:46:58.082446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:17:48.493127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082856+0000","last_change":"2024-09-10T08:46:51.777738+0000","last_active":"2024-09-10T08:46:58.082856+0000","last_peered":"2024-09-10T08:46:58.082856+0000","last_clean":"2024-09-10T08:46:58.082856+0000","last_became_active":"2024-09-10T08:46:51.777432+0000","last_became_peered":"2024-09-10T08:46:51.777432+0000","last_unstale":"2024-09-10T08:46:58.082856+0000","last_undegraded":"2024-09-10T08:46:58.082856+0000","last_fullsized":"2024-09-10T08:46:58.082856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:40:55.949890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.569117+0000","last_change":"2024-09-10T08:46:51.770094+0000","last_active":"2024-09-10T08:46:57.569117+0000","last_peered":"2024-09-10T08:46:57.569117+0000","last_clean":"2024-09-10T08:46:57.569117+0000","last_became_active":"2024-09-10T08:46:51.769753+0000","last_became_peered":"2024-09-10T08:46:51.769753+0000","last_unstale":"2024-09-10T08:46:57.569117+0000","last_undegraded":"2024-09-10T08:46:57.569117+0000","last_fullsized":"2024-09-10T08:46:57.569117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:24:41.697382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082447+0000","last_change":"2024-09-10T08:46:51.774060+0000","last_active":"2024-09-10T08:46:58.082447+0000","last_peered":"2024-09-10T08:46:58.082447+0000","last_clean":"2024-09-10T08:46:58.082447+0000","last_became_active":"2024-09-10T08:46:51.773763+0000","last_became_peered":"2024-09-10T08:46:51.773763+0000","last_unstale":"2024-09-10T08:46:58.082447+0000","last_undegraded":"2024-09-10T08:46:58.082447+0000","last_fullsized":"2024-09-10T08:46:58.082447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:40:55.949890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.805537+0000","last_change":"2024-09-10T08:46:51.772499+0000","last_active":"2024-09-10T08:46:56.805537+0000","last_peered":"2024-09-10T08:46:56.805537+0000","last_clean":"2024-09-10T08:46:56.805537+0000","last_became_active":"2024-09-10T08:46:51.772212+0000","last_became_peered":"2024-09-10T08:46:51.772212+0000","last_unstale":"2024-09-10T08:46:56.805537+0000","last_undegraded":"2024-09-10T08:46:56.805537+0000","last_fullsized":"2024-09-10T08:46:56.805537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:56.313573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.806478+0000","last_change":"2024-09-10T08:46:51.782216+0000","last_active":"2024-09-10T08:46:56.806478+0000","last_peered":"2024-09-10T08:46:56.806478+0000","last_clean":"2024-09-10T08:46:56.806478+0000","last_became_active":"2024-09-10T08:46:51.781363+0000","last_became_peered":"2024-09-10T08:46:51.781363+0000","last_unstale":"2024-09-10T08:46:56.806478+0000","last_undegraded":"2024-09-10T08:46:56.806478+0000","last_fullsized":"2024-09-10T08:46:56.806478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:55:01.331346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.806885+0000","last_change":"2024-09-10T08:46:51.796242+0000","last_active":"2024-09-10T08:46:56.806885+0000","last_peered":"2024-09-10T08:46:56.806885+0000","last_clean":"2024-09-10T08:46:56.806885+0000","last_became_active":"2024-09-10T08:46:51.795803+0000","last_became_peered":"2024-09-10T08:46:51.795803+0000","last_unstale":"2024-09-10T08:46:56.806885+0000","last_undegraded":"2024-09-10T08:46:56.806885+0000","last_fullsized":"2024-09-10T08:46:56.806885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:56:12.749632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.962635+0000","last_change":"2024-09-10T08:46:51.792984+0000","last_active":"2024-09-10T08:46:57.962635+0000","last_peered":"2024-09-10T08:46:57.962635+0000","last_clean":"2024-09-10T08:46:57.962635+0000","last_became_active":"2024-09-10T08:46:51.792602+0000","last_became_peered":"2024-09-10T08:46:51.792602+0000","last_unstale":"2024-09-10T08:46:57.962635+0000","last_undegraded":"2024-09-10T08:46:57.962635+0000","last_fullsized":"2024-09-10T08:46:57.962635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:53:54.788208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082095+0000","last_change":"2024-09-10T08:46:51.781436+0000","last_active":"2024-09-10T08:46:58.082095+0000","last_peered":"2024-09-10T08:46:58.082095+0000","last_clean":"2024-09-10T08:46:58.082095+0000","last_became_active":"2024-09-10T08:46:51.781123+0000","last_became_peered":"2024-09-10T08:46:51.781123+0000","last_unstale":"2024-09-10T08:46:58.082095+0000","last_undegraded":"2024-09-10T08:46:58.082095+0000","last_fullsized":"2024-09-10T08:46:58.082095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:56:12.749632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.962036+0000","last_change":"2024-09-10T08:46:51.779525+0000","last_active":"2024-09-10T08:46:57.962036+0000","last_peered":"2024-09-10T08:46:57.962036+0000","last_clean":"2024-09-10T08:46:57.962036+0000","last_became_active":"2024-09-10T08:46:51.779188+0000","last_became_peered":"2024-09-10T08:46:51.779188+0000","last_unstale":"2024-09-10T08:46:57.962036+0000","last_undegraded":"2024-09-10T08:46:57.962036+0000","last_fullsized":"2024-09-10T08:46:57.962036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:24.242861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082677+0000","last_change":"2024-09-10T08:46:51.788567+0000","last_active":"2024-09-10T08:46:58.082677+0000","last_peered":"2024-09-10T08:46:58.082677+0000","last_clean":"2024-09-10T08:46:58.082677+0000","last_became_active":"2024-09-10T08:46:51.787403+0000","last_became_peered":"2024-09-10T08:46:51.787403+0000","last_unstale":"2024-09-10T08:46:58.082677+0000","last_undegraded":"2024-09-10T08:46:58.082677+0000","last_fullsized":"2024-09-10T08:46:58.082677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:41:08.261156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.962152+0000","last_change":"2024-09-10T08:46:51.779364+0000","last_active":"2024-09-10T08:46:57.962152+0000","last_peered":"2024-09-10T08:46:57.962152+0000","last_clean":"2024-09-10T08:46:57.962152+0000","last_became_active":"2024-09-10T08:46:51.778893+0000","last_became_peered":"2024-09-10T08:46:51.778893+0000","last_unstale":"2024-09-10T08:46:57.962152+0000","last_undegraded":"2024-09-10T08:46:57.962152+0000","last_fullsized":"2024-09-10T08:46:57.962152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:24.598016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082934+0000","last_change":"2024-09-10T08:46:51.784880+0000","last_active":"2024-09-10T08:46:58.082934+0000","last_peered":"2024-09-10T08:46:58.082934+0000","last_clean":"2024-09-10T08:46:58.082934+0000","last_became_active":"2024-09-10T08:46:51.784571+0000","last_became_peered":"2024-09-10T08:46:51.784571+0000","last_unstale":"2024-09-10T08:46:58.082934+0000","last_undegraded":"2024-09-10T08:46:58.082934+0000","last_fullsized":"2024-09-10T08:46:58.082934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:24.598016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.569257+0000","last_change":"2024-09-10T08:46:51.778810+0000","last_active":"2024-09-10T08:46:57.569257+0000","last_peered":"2024-09-10T08:46:57.569257+0000","last_clean":"2024-09-10T08:46:57.569257+0000","last_became_active":"2024-09-10T08:46:51.777129+0000","last_became_peered":"2024-09-10T08:46:51.777129+0000","last_unstale":"2024-09-10T08:46:57.569257+0000","last_undegraded":"2024-09-10T08:46:57.569257+0000","last_fullsized":"2024-09-10T08:46:57.569257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:55:01.331346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083661+0000","last_change":"2024-09-10T08:46:51.777958+0000","last_active":"2024-09-10T08:46:58.083661+0000","last_peered":"2024-09-10T08:46:58.083661+0000","last_clean":"2024-09-10T08:46:58.083661+0000","last_became_active":"2024-09-10T08:46:51.777701+0000","last_became_peered":"2024-09-10T08:46:51.777701+0000","last_unstale":"2024-09-10T08:46:58.083661+0000","last_undegraded":"2024-09-10T08:46:58.083661+0000","last_fullsized":"2024-09-10T08:46:58.083661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:17:48.493127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.962500+0000","last_change":"2024-09-10T08:46:51.794577+0000","last_active":"2024-09-10T08:46:57.962500+0000","last_peered":"2024-09-10T08:46:57.962500+0000","last_clean":"2024-09-10T08:46:57.962500+0000","last_became_active":"2024-09-10T08:46:51.794266+0000","last_became_peered":"2024-09-10T08:46:51.794266+0000","last_unstale":"2024-09-10T08:46:57.962500+0000","last_undegraded":"2024-09-10T08:46:57.962500+0000","last_fullsized":"2024-09-10T08:46:57.962500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:48:03.814114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4642,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":104100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":104100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32028,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339812,"statfs":{"total":96636764160,"available":96603967488,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:47:15.089 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T08:47:15.089 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-10T08:47:15.089 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-10T08:47:15.089 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-10T08:47:15.090 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-10T08:47:15.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.278+0000 7f0114000640 1 Processor -- start 2024-09-10T08:47:15.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.279+0000 7f0114000640 1 -- start start 2024-09-10T08:47:15.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.280+0000 7f0114000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f010c144250 0x7f010c0cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:15.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.280+0000 7f0114000640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f010c144c90 0x7f010c0ccd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:15.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.280+0000 7f0114000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f010c0cd2b0 0x7f010c15ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:15.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.280+0000 7f0114000640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f010c06f540 con 0x7f010c0cd2b0 2024-09-10T08:47:15.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.280+0000 7f0114000640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f010c06f820 con 0x7f010c144c90 2024-09-10T08:47:15.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.280+0000 7f0114000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f010c06fb00 con 0x7f010c144250 2024-09-10T08:47:15.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.280+0000 7f0112000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f010c0cd2b0 0x7f010c15ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:15.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.280+0000 7f0112000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f010c0cd2b0 0x7f010c15ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40916/0 (socket says 172.21.15.2:40916) 2024-09-10T08:47:15.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.280+0000 7f0110c00640 1 --2- 172.21.15.2:0/38423497 >> v2:172.21.15.155:3300/0 conn(0x7f010c144c90 0x7f010c0ccd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:15.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.280+0000 7f0112000640 1 -- 172.21.15.2:0/38423497 learned_addr learned my addr 172.21.15.2:0/38423497 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:15.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.280+0000 7f0111600640 1 --2- 172.21.15.2:0/38423497 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f010c144250 0x7f010c0cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:15.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.281+0000 7f0112000640 1 -- 172.21.15.2:0/38423497 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f010c144250 msgr2=0x7f010c0cf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:15.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.281+0000 7f0112000640 1 --2- 172.21.15.2:0/38423497 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f010c144250 0x7f010c0cf8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:15.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.281+0000 7f0112000640 1 -- 172.21.15.2:0/38423497 >> v2:172.21.15.155:3300/0 conn(0x7f010c144c90 msgr2=0x7f010c0ccd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:15.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.281+0000 7f0112000640 1 --2- 172.21.15.2:0/38423497 >> v2:172.21.15.155:3300/0 conn(0x7f010c144c90 0x7f010c0ccd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:15.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.281+0000 7f0112000640 1 -- 172.21.15.2:0/38423497 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f010c06fde0 con 0x7f010c0cd2b0 2024-09-10T08:47:15.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.282+0000 7f0112000640 1 --2- 172.21.15.2:0/38423497 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f010c0cd2b0 0x7f010c15ef70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f010c073250 tx=0x7f010402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd0ead2d28e02d5d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:15.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.282+0000 7f010be00640 1 -- 172.21.15.2:0/38423497 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0104036070 con 0x7f010c0cd2b0 2024-09-10T08:47:15.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.282+0000 7f010be00640 1 -- 172.21.15.2:0/38423497 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0104031600 con 0x7f010c0cd2b0 2024-09-10T08:47:15.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.282+0000 7f010be00640 1 -- 172.21.15.2:0/38423497 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01040319d0 con 0x7f010c0cd2b0 2024-09-10T08:47:15.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.283+0000 7f0114000640 1 -- 172.21.15.2:0/38423497 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f010c0cd2b0 msgr2=0x7f010c15ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:15.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.283+0000 7f0114000640 1 --2- 172.21.15.2:0/38423497 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f010c0cd2b0 0x7f010c15ef70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f010c073250 tx=0x7f010402a6a0 comp rx=0 tx=0).stop 2024-09-10T08:47:15.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.283+0000 7f0114000640 1 -- 172.21.15.2:0/38423497 shutdown_connections 2024-09-10T08:47:15.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.283+0000 7f0114000640 1 --2- 172.21.15.2:0/38423497 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f010c0cd2b0 0x7f010c15ef70 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:15.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.283+0000 7f0114000640 1 --2- 172.21.15.2:0/38423497 >> v2:172.21.15.155:3300/0 conn(0x7f010c144c90 0x7f010c0ccd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:15.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.283+0000 7f0114000640 1 --2- 172.21.15.2:0/38423497 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f010c144250 0x7f010c0cf8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:15.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.283+0000 7f0114000640 1 -- 172.21.15.2:0/38423497 >> 172.21.15.2:0/38423497 conn(0x7f010c06bc10 msgr2=0x7f010c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:15.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.283+0000 7f0114000640 1 -- 172.21.15.2:0/38423497 shutdown_connections 2024-09-10T08:47:15.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.283+0000 7f0114000640 1 -- 172.21.15.2:0/38423497 wait complete. 2024-09-10T08:47:15.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.284+0000 7f0114000640 1 Processor -- start 2024-09-10T08:47:15.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.284+0000 7f0114000640 1 -- start start 2024-09-10T08:47:15.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.285+0000 7f0114000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f010c0cd2b0 0x7f010c0b05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:15.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.285+0000 7f0114000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f010c144250 0x7f010c15ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:15.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.285+0000 7f0114000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f010c144c90 0x7f010c15c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:15.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.285+0000 7f0114000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f010c0b3390 con 0x7f010c0cd2b0 2024-09-10T08:47:15.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.285+0000 7f0114000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f010c0cfe10 con 0x7f010c144250 2024-09-10T08:47:15.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.285+0000 7f0114000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f010c15f4b0 con 0x7f010c144c90 2024-09-10T08:47:15.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.286+0000 7f0111600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f010c0cd2b0 0x7f010c0b05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:15.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.286+0000 7f0111600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f010c0cd2b0 0x7f010c0b05c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40924/0 (socket says 172.21.15.2:40924) 2024-09-10T08:47:15.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.286+0000 7f0111600640 1 -- 172.21.15.2:0/2736950031 learned_addr learned my addr 172.21.15.2:0/2736950031 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:15.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.286+0000 7f0110c00640 1 --2- 172.21.15.2:0/2736950031 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f010c144250 0x7f010c15ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:15.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.286+0000 7f0112000640 1 --2- 172.21.15.2:0/2736950031 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f010c144c90 0x7f010c15c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:15.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.286+0000 7f0111600640 1 -- 172.21.15.2:0/2736950031 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f010c144c90 msgr2=0x7f010c15c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:15.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.286+0000 7f0111600640 1 --2- 172.21.15.2:0/2736950031 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f010c144c90 0x7f010c15c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:15.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.286+0000 7f0111600640 1 -- 172.21.15.2:0/2736950031 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f010c144250 msgr2=0x7f010c15ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:15.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.286+0000 7f0111600640 1 --2- 172.21.15.2:0/2736950031 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f010c144250 0x7f010c15ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:15.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.286+0000 7f0111600640 1 -- 172.21.15.2:0/2736950031 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f010c13e9b0 con 0x7f010c0cd2b0 2024-09-10T08:47:15.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.286+0000 7f0110c00640 1 --2- 172.21.15.2:0/2736950031 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f010c144250 0x7f010c15ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:47:15.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.286+0000 7f0112000640 1 --2- 172.21.15.2:0/2736950031 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f010c144c90 0x7f010c15c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:47:15.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.287+0000 7f0111600640 1 --2- 172.21.15.2:0/2736950031 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f010c0cd2b0 0x7f010c0b05c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f010000e890 tx=0x7f010000ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:15.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.287+0000 7f0109600640 1 -- 172.21.15.2:0/2736950031 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0100017070 con 0x7f010c0cd2b0 2024-09-10T08:47:15.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.287+0000 7f0109600640 1 -- 172.21.15.2:0/2736950031 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f010000c940 con 0x7f010c0cd2b0 2024-09-10T08:47:15.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.287+0000 7f0109600640 1 -- 172.21.15.2:0/2736950031 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f010000cd10 con 0x7f010c0cd2b0 2024-09-10T08:47:15.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.287+0000 7f0114000640 1 -- 172.21.15.2:0/2736950031 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f010c15bb70 con 0x7f010c0cd2b0 2024-09-10T08:47:15.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.287+0000 7f0114000640 1 -- 172.21.15.2:0/2736950031 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f010c15c130 con 0x7f010c0cd2b0 2024-09-10T08:47:15.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.288+0000 7f0114000640 1 -- 172.21.15.2:0/2736950031 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f010c0cf8d0 con 0x7f010c0cd2b0 2024-09-10T08:47:15.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.289+0000 7f0109600640 1 -- 172.21.15.2:0/2736950031 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f010001a070 con 0x7f010c0cd2b0 2024-09-10T08:47:15.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.290+0000 7f0109600640 1 --2- 172.21.15.2:0/2736950031 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f00ec06be30 0x7f00ec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:15.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.290+0000 7f0109600640 1 -- 172.21.15.2:0/2736950031 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f010008b4c0 con 0x7f010c0cd2b0 2024-09-10T08:47:15.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.290+0000 7f0110c00640 1 --2- 172.21.15.2:0/2736950031 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f00ec06be30 0x7f00ec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:15.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.291+0000 7f0110c00640 1 --2- 172.21.15.2:0/2736950031 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f00ec06be30 0x7f00ec06e2f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f010c0b2320 tx=0x7f00f8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:15.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.294+0000 7f0109600640 1 -- 172.21.15.2:0/2736950031 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0100059b20 con 0x7f010c0cd2b0 2024-09-10T08:47:15.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.526+0000 7f0114000640 1 -- 172.21.15.2:0/2736950031 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f010c0b0b00 con 0x7f010c0cd2b0 2024-09-10T08:47:15.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.529+0000 7f0109600640 1 -- 172.21.15.2:0/2736950031 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+172944 (secure 0 0 0) 0x7f0100059420 con 0x7f010c0cd2b0 2024-09-10T08:47:15.533 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:47:15.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.532+0000 7f0114000640 1 -- 172.21.15.2:0/2736950031 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f00ec06be30 msgr2=0x7f00ec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:15.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.532+0000 7f0114000640 1 --2- 172.21.15.2:0/2736950031 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f00ec06be30 0x7f00ec06e2f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f010c0b2320 tx=0x7f00f8008040 comp rx=0 tx=0).stop 2024-09-10T08:47:15.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.532+0000 7f0114000640 1 -- 172.21.15.2:0/2736950031 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f010c0cd2b0 msgr2=0x7f010c0b05c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:15.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.533+0000 7f0114000640 1 --2- 172.21.15.2:0/2736950031 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f010c0cd2b0 0x7f010c0b05c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f010000e890 tx=0x7f010000ed50 comp rx=0 tx=0).stop 2024-09-10T08:47:15.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.533+0000 7f0114000640 1 -- 172.21.15.2:0/2736950031 shutdown_connections 2024-09-10T08:47:15.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.533+0000 7f0114000640 1 --2- 172.21.15.2:0/2736950031 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f00ec06be30 0x7f00ec06e2f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:15.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.533+0000 7f0114000640 1 --2- 172.21.15.2:0/2736950031 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f010c144c90 0x7f010c15c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:15.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.533+0000 7f0114000640 1 --2- 172.21.15.2:0/2736950031 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f010c144250 0x7f010c15ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:15.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.533+0000 7f0114000640 1 --2- 172.21.15.2:0/2736950031 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f010c0cd2b0 0x7f010c0b05c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:15.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.533+0000 7f0114000640 1 -- 172.21.15.2:0/2736950031 >> 172.21.15.2:0/2736950031 conn(0x7f010c06bc10 msgr2=0x7f010c141120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:15.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.533+0000 7f0114000640 1 -- 172.21.15.2:0/2736950031 shutdown_connections 2024-09-10T08:47:15.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.533+0000 7f0114000640 1 -- 172.21.15.2:0/2736950031 wait complete. 2024-09-10T08:47:15.549 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":5,"flags":0,"active_gid":4099,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2611418382},{"type":"v1","addr":"172.21.15.155:6833","nonce":2611418382}]},"active_addr":"172.21.15.155:6833/2611418382","active_change":"2024-09-10T08:46:31.356570+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4107,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.155:0","nonce":1305551464}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.155:0","nonce":41896583}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.155:0","nonce":3560911645}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.155:0","nonce":1872766231}]}]} 2024-09-10T08:47:15.552 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-10T08:47:15.552 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-10T08:47:15.553 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:47:15.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.708+0000 7fd3e9600640 1 Processor -- start 2024-09-10T08:47:15.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.708+0000 7fd3e9600640 1 -- start start 2024-09-10T08:47:15.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.709+0000 7fd3e9600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3e40b43b0 0x7fd3e40b4820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:15.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.709+0000 7fd3e9600640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3e406ea10 con 0x7fd3e4067950 2024-09-10T08:47:15.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.709+0000 7fd3e9600640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3e406ecf0 con 0x7fd3e4067d30 2024-09-10T08:47:15.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.709+0000 7fd3e9600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd3e406f620 con 0x7fd3e40b43b0 2024-09-10T08:47:15.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.709+0000 7fd3e2a00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fd3e4067950 0x7fd3e415f600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:43352/0 (socket says 172.21.15.2:43352) 2024-09-10T08:47:15.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.709+0000 7fd3e2a00640 1 -- 172.21.15.2:0/2765836087 learned_addr learned my addr 172.21.15.2:0/2765836087 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:47:15.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.710+0000 7fd3e3400640 1 --2- 172.21.15.2:0/2765836087 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3e40b43b0 0x7fd3e40b4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:15.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.710+0000 7fd3e2000640 1 -- 172.21.15.2:0/2765836087 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4036311494 0 0) 0x7fd3e406ea10 con 0x7fd3e4067950 2024-09-10T08:47:15.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.710+0000 7fd3e2000640 1 -- 172.21.15.2:0/2765836087 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd3c8003520 con 0x7fd3e4067950 2024-09-10T08:47:15.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.710+0000 7fd3e2000640 1 -- 172.21.15.2:0/2765836087 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2226391724 0 0) 0x7fd3e406ecf0 con 0x7fd3e4067d30 2024-09-10T08:47:15.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.710+0000 7fd3e2000640 1 -- 172.21.15.2:0/2765836087 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd3e406ea10 con 0x7fd3e4067d30 2024-09-10T08:47:15.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.710+0000 7fd3e3400640 1 -- 172.21.15.2:0/2765836087 >> v1:172.21.15.155:6789/0 conn(0x7fd3e4067d30 legacy=0x7fd3e40b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:15.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.710+0000 7fd3e3400640 1 -- 172.21.15.2:0/2765836087 >> v1:172.21.15.2:6789/0 conn(0x7fd3e4067950 legacy=0x7fd3e415f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:15.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.710+0000 7fd3e3400640 1 -- 172.21.15.2:0/2765836087 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3e406efd0 con 0x7fd3e40b43b0 2024-09-10T08:47:15.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.711+0000 7fd3e3400640 1 --2- 172.21.15.2:0/2765836087 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3e40b43b0 0x7fd3e40b4820 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd3e406f7a0 tx=0x7fd3dc02a630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2821796a3acf031a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:15.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.711+0000 7fd3e2000640 1 -- 172.21.15.2:0/2765836087 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc007740 con 0x7fd3e40b43b0 2024-09-10T08:47:15.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.712+0000 7fd3e2000640 1 -- 172.21.15.2:0/2765836087 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3dc02ae50 con 0x7fd3e40b43b0 2024-09-10T08:47:15.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.712+0000 7fd3e2000640 1 -- 172.21.15.2:0/2765836087 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc007b00 con 0x7fd3e40b43b0 2024-09-10T08:47:15.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.712+0000 7fd3e9600640 1 -- 172.21.15.2:0/2765836087 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3e40b43b0 msgr2=0x7fd3e40b4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:15.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.712+0000 7fd3e9600640 1 --2- 172.21.15.2:0/2765836087 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3e40b43b0 0x7fd3e40b4820 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd3e406f7a0 tx=0x7fd3dc02a630 comp rx=0 tx=0).stop 2024-09-10T08:47:15.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.712+0000 7fd3e9600640 1 -- 172.21.15.2:0/2765836087 shutdown_connections 2024-09-10T08:47:15.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.712+0000 7fd3e9600640 1 --2- 172.21.15.2:0/2765836087 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3e40b43b0 0x7fd3e40b4820 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:15.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.712+0000 7fd3e9600640 1 -- 172.21.15.2:0/2765836087 >> 172.21.15.2:0/2765836087 conn(0x7fd3e40735e0 msgr2=0x7fd3e406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:15.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.712+0000 7fd3e9600640 1 -- 172.21.15.2:0/2765836087 shutdown_connections 2024-09-10T08:47:15.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.712+0000 7fd3e9600640 1 -- 172.21.15.2:0/2765836087 wait complete. 2024-09-10T08:47:15.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.714+0000 7fd3e9600640 1 Processor -- start 2024-09-10T08:47:15.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.714+0000 7fd3e9600640 1 -- start start 2024-09-10T08:47:15.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.715+0000 7fd3e9600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd3e4067950 0x7fd3e4147370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:15.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.715+0000 7fd3e9600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3e4067d30 0x7fd3e4151d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:15.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.715+0000 7fd3e9600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3e40b43b0 0x7fd3e415acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:15.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.715+0000 7fd3e9600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e4068170 con 0x7fd3e40b43b0 2024-09-10T08:47:15.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.715+0000 7fd3e9600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd3e406e700 con 0x7fd3e4067950 2024-09-10T08:47:15.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.715+0000 7fd3e9600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd3e4152760 con 0x7fd3e4067d30 2024-09-10T08:47:15.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.715+0000 7fd3e3400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3e40b43b0 0x7fd3e415acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:15.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.715+0000 7fd3e3400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3e40b43b0 0x7fd3e415acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:40930/0 (socket says 172.21.15.2:40930) 2024-09-10T08:47:15.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.715+0000 7fd3e3400640 1 -- 172.21.15.2:0/2459028356 learned_addr learned my addr 172.21.15.2:0/2459028356 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:15.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.715+0000 7fd3e2a00640 1 --2- 172.21.15.2:0/2459028356 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd3e4067950 0x7fd3e4147370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:15.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.715+0000 7fd3da000640 1 --2- 172.21.15.2:0/2459028356 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3e4067d30 0x7fd3e4151d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:15.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.716+0000 7fd3e3400640 1 -- 172.21.15.2:0/2459028356 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3e4067d30 msgr2=0x7fd3e4151d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:15.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.716+0000 7fd3e3400640 1 --2- 172.21.15.2:0/2459028356 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3e4067d30 0x7fd3e4151d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:15.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.716+0000 7fd3e3400640 1 -- 172.21.15.2:0/2459028356 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd3e4067950 msgr2=0x7fd3e4147370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:15.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.716+0000 7fd3e3400640 1 --2- 172.21.15.2:0/2459028356 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd3e4067950 0x7fd3e4147370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:15.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.716+0000 7fd3e3400640 1 -- 172.21.15.2:0/2459028356 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3e4152a40 con 0x7fd3e40b43b0 2024-09-10T08:47:15.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.716+0000 7fd3e3400640 1 --2- 172.21.15.2:0/2459028356 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3e40b43b0 0x7fd3e415acd0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc009eb0 tx=0x7fd3dc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:15.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.716+0000 7fd3db400640 1 -- 172.21.15.2:0/2459028356 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc03f070 con 0x7fd3e40b43b0 2024-09-10T08:47:15.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.716+0000 7fd3db400640 1 -- 172.21.15.2:0/2459028356 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3dc03b820 con 0x7fd3e40b43b0 2024-09-10T08:47:15.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.716+0000 7fd3db400640 1 -- 172.21.15.2:0/2459028356 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc03bbd0 con 0x7fd3e40b43b0 2024-09-10T08:47:15.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.716+0000 7fd3e9600640 1 -- 172.21.15.2:0/2459028356 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3e4152d20 con 0x7fd3e40b43b0 2024-09-10T08:47:15.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.717+0000 7fd3e9600640 1 -- 172.21.15.2:0/2459028356 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3e41532e0 con 0x7fd3e40b43b0 2024-09-10T08:47:15.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.718+0000 7fd3e9600640 1 -- 172.21.15.2:0/2459028356 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3e41534e0 con 0x7fd3e40b43b0 2024-09-10T08:47:15.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.718+0000 7fd3db400640 1 -- 172.21.15.2:0/2459028356 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd3dc031400 con 0x7fd3e40b43b0 2024-09-10T08:47:15.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.719+0000 7fd3db400640 1 --2- 172.21.15.2:0/2459028356 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fd3c006be30 0x7fd3c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:15.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.719+0000 7fd3db400640 1 -- 172.21.15.2:0/2459028356 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd3dc0ac690 con 0x7fd3e40b43b0 2024-09-10T08:47:15.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.720+0000 7fd3e2a00640 1 --2- 172.21.15.2:0/2459028356 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fd3c006be30 0x7fd3c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:15.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.720+0000 7fd3e2a00640 1 --2- 172.21.15.2:0/2459028356 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fd3c006be30 0x7fd3c006e2f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd3d4000f60 tx=0x7fd3d4007d70 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:15.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.723+0000 7fd3db400640 1 -- 172.21.15.2:0/2459028356 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd3e41534e0 con 0x7fd3e40b43b0 2024-09-10T08:47:15.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.914+0000 7fd3e9600640 1 -- 172.21.15.2:0/2459028356 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd3e40704b0 con 0x7fd3e40b43b0 2024-09-10T08:47:15.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.915+0000 7fd3db400640 1 -- 172.21.15.2:0/2459028356 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18538 (secure 0 0 0) 0x7fd3dc07a580 con 0x7fd3e40b43b0 2024-09-10T08:47:15.917 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:47:15.917 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":24,"fsid":"f20a15a7-d363-4d44-98cb-4f4f466b52b8","created":"2024-09-10T08:46:26.481619+0000","modified":"2024-09-10T08:46:56.240092+0000","last_up_change":"2024-09-10T08:46:39.323912+0000","last_in_change":"2024-09-10T08:46:29.499894+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:46:39.426180+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:46:49.214595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T08:46:50.168313+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T08:46:53.833162+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c90be333-506b-46d1-b00a-10d089a84776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6822","nonce":298678486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6823","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6826","nonce":298678486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6831","nonce":298678486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6829","nonce":298678486}]},"public_addr":"172.21.15.2:6822/298678486","cluster_addr":"172.21.15.2:6826/298678486","heartbeat_back_addr":"172.21.15.2:6831/298678486","heartbeat_front_addr":"172.21.15.2:6829/298678486","state":["exists","up"]},{"osd":1,"uuid":"3f8bdde8-6cd3-4112-8939-a876191c7368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6809","nonce":1619566025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6811","nonce":1619566025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6815","nonce":1619566025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6813","nonce":1619566025}]},"public_addr":"172.21.15.2:6809/1619566025","cluster_addr":"172.21.15.2:6811/1619566025","heartbeat_back_addr":"172.21.15.2:6815/1619566025","heartbeat_front_addr":"172.21.15.2:6813/1619566025","state":["exists","up"]},{"osd":2,"uuid":"3835f5ab-ed3a-4f46-ae6c-f0edf21708d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6801","nonce":3992427579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6803","nonce":3992427579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6807","nonce":3992427579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6805","nonce":3992427579}]},"public_addr":"172.21.15.2:6801/3992427579","cluster_addr":"172.21.15.2:6803/3992427579","heartbeat_back_addr":"172.21.15.2:6807/3992427579","heartbeat_front_addr":"172.21.15.2:6805/3992427579","state":["exists","up"]},{"osd":3,"uuid":"add6ad27-b411-4a82-9622-b0c1c1782cf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6817","nonce":1270626884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6819","nonce":1270626884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6827","nonce":1270626884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6824","nonce":1270626884}]},"public_addr":"172.21.15.2:6817/1270626884","cluster_addr":"172.21.15.2:6819/1270626884","heartbeat_back_addr":"172.21.15.2:6827/1270626884","heartbeat_front_addr":"172.21.15.2:6824/1270626884","state":["exists","up"]},{"osd":4,"uuid":"c7b642f4-8bd2-4262-9a82-ee1061cfab7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6803","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6806","nonce":553254873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6813","nonce":553254873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6822","nonce":553254873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6819","nonce":553254873}]},"public_addr":"172.21.15.155:6806/553254873","cluster_addr":"172.21.15.155:6813/553254873","heartbeat_back_addr":"172.21.15.155:6822/553254873","heartbeat_front_addr":"172.21.15.155:6819/553254873","state":["exists","up"]},{"osd":5,"uuid":"fb53289a-419f-46d8-9e3a-384ac529dc57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6805","nonce":2107688472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6811","nonce":2107688472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6823","nonce":2107688472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6817","nonce":2107688472}]},"public_addr":"172.21.15.155:6805/2107688472","cluster_addr":"172.21.15.155:6811/2107688472","heartbeat_back_addr":"172.21.15.155:6823/2107688472","heartbeat_front_addr":"172.21.15.155:6817/2107688472","state":["exists","up"]},{"osd":6,"uuid":"3f9ddd54-ede4-4565-aff6-ae1c07e7c678","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6825","nonce":944542383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6827","nonce":944542383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6831","nonce":944542383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6829","nonce":944542383}]},"public_addr":"172.21.15.155:6825/944542383","cluster_addr":"172.21.15.155:6827/944542383","heartbeat_back_addr":"172.21.15.155:6831/944542383","heartbeat_front_addr":"172.21.15.155:6829/944542383","state":["exists","up"]},{"osd":7,"uuid":"328d0681-eef4-4556-94e1-9745bd4adbe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6801","nonce":2220093913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6807","nonce":2220093913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6818","nonce":2220093913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6812","nonce":2220093913}]},"public_addr":"172.21.15.155:6801/2220093913","cluster_addr":"172.21.15.155:6807/2220093913","heartbeat_back_addr":"172.21.15.155:6818/2220093913","heartbeat_front_addr":"172.21.15.155:6812/2220093913","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.052980+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.104550+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.025661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:35.784354+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:35.863363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.322312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.100890+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:35.763584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:47:15.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.918+0000 7fd3e9600640 1 -- 172.21.15.2:0/2459028356 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fd3c006be30 msgr2=0x7fd3c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:15.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.918+0000 7fd3e9600640 1 --2- 172.21.15.2:0/2459028356 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fd3c006be30 0x7fd3c006e2f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd3d4000f60 tx=0x7fd3d4007d70 comp rx=0 tx=0).stop 2024-09-10T08:47:15.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.918+0000 7fd3e9600640 1 -- 172.21.15.2:0/2459028356 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3e40b43b0 msgr2=0x7fd3e415acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:15.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.918+0000 7fd3e9600640 1 --2- 172.21.15.2:0/2459028356 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3e40b43b0 0x7fd3e415acd0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc009eb0 tx=0x7fd3dc004a40 comp rx=0 tx=0).stop 2024-09-10T08:47:15.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.918+0000 7fd3e9600640 1 -- 172.21.15.2:0/2459028356 shutdown_connections 2024-09-10T08:47:15.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.918+0000 7fd3e9600640 1 --2- 172.21.15.2:0/2459028356 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd3e40b43b0 0x7fd3e415acd0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:15.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.918+0000 7fd3e9600640 1 --2- 172.21.15.2:0/2459028356 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fd3c006be30 0x7fd3c006e2f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:15.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.918+0000 7fd3e9600640 1 --2- 172.21.15.2:0/2459028356 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd3e4067d30 0x7fd3e4151d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:15.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.918+0000 7fd3e9600640 1 --2- 172.21.15.2:0/2459028356 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd3e4067950 0x7fd3e4147370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:15.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.918+0000 7fd3e9600640 1 -- 172.21.15.2:0/2459028356 >> 172.21.15.2:0/2459028356 conn(0x7fd3e40735e0 msgr2=0x7fd3e40af890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:15.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.918+0000 7fd3e9600640 1 -- 172.21.15.2:0/2459028356 shutdown_connections 2024-09-10T08:47:15.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:15.918+0000 7fd3e9600640 1 -- 172.21.15.2:0/2459028356 wait complete. 2024-09-10T08:47:15.935 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-10T08:47:15.935 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:47:16.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.090+0000 7f5003e00640 1 Processor -- start 2024-09-10T08:47:16.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.090+0000 7f5003e00640 1 -- start start 2024-09-10T08:47:16.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.091+0000 7f5003e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f500415e4c0 0x7f50040d2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:16.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.091+0000 7f5003e00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f50040b64f0 0x7f50040b7640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:16.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.091+0000 7f5003e00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50040d4180 con 0x7f50040cebc0 2024-09-10T08:47:16.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.091+0000 7f5003e00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f50040d30e0 con 0x7f50040b64f0 2024-09-10T08:47:16.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.091+0000 7f5003e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f50040d33c0 con 0x7f500415e4c0 2024-09-10T08:47:16.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.091+0000 7f5002a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f500415e4c0 0x7f50040d2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:16.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.091+0000 7f5002a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f500415e4c0 0x7f50040d2890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.2:40352/0 (socket says 172.21.15.2:40352) 2024-09-10T08:47:16.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.091+0000 7f5002a00640 1 -- 172.21.15.2:0/2615835923 learned_addr learned my addr 172.21.15.2:0/2615835923 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:16.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.092+0000 7f5003400640 1 --2- 172.21.15.2:0/2615835923 >> v2:172.21.15.155:3300/0 conn(0x7f50040b64f0 0x7f50040b7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:16.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.092+0000 7f5002a00640 1 -- 172.21.15.2:0/2615835923 >> v2:172.21.15.155:3300/0 conn(0x7f50040b64f0 msgr2=0x7f50040b7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:16.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.092+0000 7f5002a00640 1 --2- 172.21.15.2:0/2615835923 >> v2:172.21.15.155:3300/0 conn(0x7f50040b64f0 0x7f50040b7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:16.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.092+0000 7f5002a00640 1 -- 172.21.15.2:0/2615835923 >> v1:172.21.15.155:6789/0 conn(0x7f50040cebc0 legacy=0x7f50040b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:16.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.092+0000 7f5002a00640 1 -- 172.21.15.2:0/2615835923 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50040d36a0 con 0x7f500415e4c0 2024-09-10T08:47:16.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.092+0000 7f5003400640 1 --2- 172.21.15.2:0/2615835923 >> v2:172.21.15.155:3300/0 conn(0x7f50040b64f0 0x7f50040b7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:47:16.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.093+0000 7f5002a00640 1 --2- 172.21.15.2:0/2615835923 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f500415e4c0 0x7f50040d2890 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4ff4009870 tx=0x7f4ff402a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a66e123aef282df6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:16.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.093+0000 7f5002000640 1 -- 172.21.15.2:0/2615835923 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff4037070 con 0x7f500415e4c0 2024-09-10T08:47:16.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.093+0000 7f5002000640 1 -- 172.21.15.2:0/2615835923 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ff4032440 con 0x7f500415e4c0 2024-09-10T08:47:16.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.093+0000 7f5002000640 1 -- 172.21.15.2:0/2615835923 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff4032810 con 0x7f500415e4c0 2024-09-10T08:47:16.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.094+0000 7f5003e00640 1 -- 172.21.15.2:0/2615835923 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f500415e4c0 msgr2=0x7f50040d2890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:16.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.094+0000 7f5003e00640 1 --2- 172.21.15.2:0/2615835923 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f500415e4c0 0x7f50040d2890 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4ff4009870 tx=0x7f4ff402a250 comp rx=0 tx=0).stop 2024-09-10T08:47:16.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.094+0000 7f5003e00640 1 -- 172.21.15.2:0/2615835923 shutdown_connections 2024-09-10T08:47:16.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.094+0000 7f5003e00640 1 --2- 172.21.15.2:0/2615835923 >> v2:172.21.15.155:3300/0 conn(0x7f50040b64f0 0x7f50040b7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:16.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.094+0000 7f5003e00640 1 --2- 172.21.15.2:0/2615835923 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f500415e4c0 0x7f50040d2890 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:16.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.094+0000 7f5003e00640 1 -- 172.21.15.2:0/2615835923 >> 172.21.15.2:0/2615835923 conn(0x7f50040d0de0 msgr2=0x7f50040d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:16.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.094+0000 7f5003e00640 1 -- 172.21.15.2:0/2615835923 shutdown_connections 2024-09-10T08:47:16.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.094+0000 7f5003e00640 1 -- 172.21.15.2:0/2615835923 wait complete. 2024-09-10T08:47:16.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.096+0000 7f5003e00640 1 Processor -- start 2024-09-10T08:47:16.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.096+0000 7f5003e00640 1 -- start start 2024-09-10T08:47:16.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.097+0000 7f5003e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50040b64f0 0x7f50040c8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:16.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.097+0000 7f5003e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50040cebc0 0x7f50040cb430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:16.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.097+0000 7f5003e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f500415e4c0 0x7f50040cb970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:16.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.097+0000 7f5003e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f50040d2dd0 con 0x7f50040cebc0 2024-09-10T08:47:16.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.097+0000 7f5003e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f50040d3c60 con 0x7f50040b64f0 2024-09-10T08:47:16.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.097+0000 7f5003e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f500415e8a0 con 0x7f500415e4c0 2024-09-10T08:47:16.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.097+0000 7f4ffbe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50040cebc0 0x7f50040cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:16.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.097+0000 7f4ffbe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50040cebc0 0x7f50040cb430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50902/0 (socket says 172.21.15.2:50902) 2024-09-10T08:47:16.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.097+0000 7f4ffbe00640 1 -- 172.21.15.2:0/2198203747 learned_addr learned my addr 172.21.15.2:0/2198203747 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:16.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.097+0000 7f5003400640 1 --2- 172.21.15.2:0/2198203747 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f500415e4c0 0x7f50040cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:16.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.097+0000 7f5002a00640 1 --2- 172.21.15.2:0/2198203747 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50040b64f0 0x7f50040c8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:16.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.098+0000 7f4ffbe00640 1 -- 172.21.15.2:0/2198203747 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f500415e4c0 msgr2=0x7f50040cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:16.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.098+0000 7f4ffbe00640 1 --2- 172.21.15.2:0/2198203747 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f500415e4c0 0x7f50040cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:16.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.098+0000 7f4ffbe00640 1 -- 172.21.15.2:0/2198203747 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50040b64f0 msgr2=0x7f50040c8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:16.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.098+0000 7f4ffbe00640 1 --2- 172.21.15.2:0/2198203747 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50040b64f0 0x7f50040c8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:16.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.098+0000 7f4ffbe00640 1 -- 172.21.15.2:0/2198203747 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50041560d0 con 0x7f50040cebc0 2024-09-10T08:47:16.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.098+0000 7f4ffbe00640 1 --2- 172.21.15.2:0/2198203747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50040cebc0 0x7f50040cb430 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4fec00c400 tx=0x7f4fec00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:16.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.098+0000 7f4ffb400640 1 -- 172.21.15.2:0/2198203747 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fec0052d0 con 0x7f50040cebc0 2024-09-10T08:47:16.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.098+0000 7f4ffb400640 1 -- 172.21.15.2:0/2198203747 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fec005490 con 0x7f50040cebc0 2024-09-10T08:47:16.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.098+0000 7f4ffb400640 1 -- 172.21.15.2:0/2198203747 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fec007260 con 0x7f50040cebc0 2024-09-10T08:47:16.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.098+0000 7f5003e00640 1 -- 172.21.15.2:0/2198203747 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50040c8e40 con 0x7f50040cebc0 2024-09-10T08:47:16.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.098+0000 7f5003e00640 1 -- 172.21.15.2:0/2198203747 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50040c9400 con 0x7f50040cebc0 2024-09-10T08:47:16.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.099+0000 7f5003e00640 1 -- 172.21.15.2:0/2198203747 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f500415d0a0 con 0x7f50040cebc0 2024-09-10T08:47:16.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.100+0000 7f4ffb400640 1 -- 172.21.15.2:0/2198203747 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4fec007400 con 0x7f50040cebc0 2024-09-10T08:47:16.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.101+0000 7f4ffb400640 1 --2- 172.21.15.2:0/2198203747 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f4fe006be30 0x7f4fe006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:16.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.101+0000 7f4ffb400640 1 -- 172.21.15.2:0/2198203747 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f4fec08a630 con 0x7f50040cebc0 2024-09-10T08:47:16.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.102+0000 7f5002a00640 1 --2- 172.21.15.2:0/2198203747 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f4fe006be30 0x7f4fe006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:16.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.102+0000 7f5002a00640 1 --2- 172.21.15.2:0/2198203747 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f4fe006be30 0x7f4fe006e2f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4ff4034000 tx=0x7f4ff402e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:16.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.105+0000 7f4ffb400640 1 -- 172.21.15.2:0/2198203747 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f500415d0a0 con 0x7f50040cebc0 2024-09-10T08:47:16.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.289+0000 7f5003e00640 1 -- 172.21.15.2:0/2198203747 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f50040d2890 con 0x7f50040cebc0 2024-09-10T08:47:16.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.290+0000 7f4ffb400640 1 -- 172.21.15.2:0/2198203747 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18538 (secure 0 0 0) 0x7f50040d4180 con 0x7f50040cebc0 2024-09-10T08:47:16.292 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:47:16.292 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":24,"fsid":"f20a15a7-d363-4d44-98cb-4f4f466b52b8","created":"2024-09-10T08:46:26.481619+0000","modified":"2024-09-10T08:46:56.240092+0000","last_up_change":"2024-09-10T08:46:39.323912+0000","last_in_change":"2024-09-10T08:46:29.499894+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:46:39.426180+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:46:49.214595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T08:46:50.168313+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T08:46:53.833162+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c90be333-506b-46d1-b00a-10d089a84776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6822","nonce":298678486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6823","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6826","nonce":298678486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6831","nonce":298678486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6829","nonce":298678486}]},"public_addr":"172.21.15.2:6822/298678486","cluster_addr":"172.21.15.2:6826/298678486","heartbeat_back_addr":"172.21.15.2:6831/298678486","heartbeat_front_addr":"172.21.15.2:6829/298678486","state":["exists","up"]},{"osd":1,"uuid":"3f8bdde8-6cd3-4112-8939-a876191c7368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6809","nonce":1619566025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6811","nonce":1619566025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6815","nonce":1619566025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6813","nonce":1619566025}]},"public_addr":"172.21.15.2:6809/1619566025","cluster_addr":"172.21.15.2:6811/1619566025","heartbeat_back_addr":"172.21.15.2:6815/1619566025","heartbeat_front_addr":"172.21.15.2:6813/1619566025","state":["exists","up"]},{"osd":2,"uuid":"3835f5ab-ed3a-4f46-ae6c-f0edf21708d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6801","nonce":3992427579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6803","nonce":3992427579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6807","nonce":3992427579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6805","nonce":3992427579}]},"public_addr":"172.21.15.2:6801/3992427579","cluster_addr":"172.21.15.2:6803/3992427579","heartbeat_back_addr":"172.21.15.2:6807/3992427579","heartbeat_front_addr":"172.21.15.2:6805/3992427579","state":["exists","up"]},{"osd":3,"uuid":"add6ad27-b411-4a82-9622-b0c1c1782cf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6817","nonce":1270626884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6819","nonce":1270626884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6827","nonce":1270626884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6824","nonce":1270626884}]},"public_addr":"172.21.15.2:6817/1270626884","cluster_addr":"172.21.15.2:6819/1270626884","heartbeat_back_addr":"172.21.15.2:6827/1270626884","heartbeat_front_addr":"172.21.15.2:6824/1270626884","state":["exists","up"]},{"osd":4,"uuid":"c7b642f4-8bd2-4262-9a82-ee1061cfab7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6803","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6806","nonce":553254873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6813","nonce":553254873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6822","nonce":553254873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6819","nonce":553254873}]},"public_addr":"172.21.15.155:6806/553254873","cluster_addr":"172.21.15.155:6813/553254873","heartbeat_back_addr":"172.21.15.155:6822/553254873","heartbeat_front_addr":"172.21.15.155:6819/553254873","state":["exists","up"]},{"osd":5,"uuid":"fb53289a-419f-46d8-9e3a-384ac529dc57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6805","nonce":2107688472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6811","nonce":2107688472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6823","nonce":2107688472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6817","nonce":2107688472}]},"public_addr":"172.21.15.155:6805/2107688472","cluster_addr":"172.21.15.155:6811/2107688472","heartbeat_back_addr":"172.21.15.155:6823/2107688472","heartbeat_front_addr":"172.21.15.155:6817/2107688472","state":["exists","up"]},{"osd":6,"uuid":"3f9ddd54-ede4-4565-aff6-ae1c07e7c678","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6825","nonce":944542383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6827","nonce":944542383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6831","nonce":944542383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6829","nonce":944542383}]},"public_addr":"172.21.15.155:6825/944542383","cluster_addr":"172.21.15.155:6827/944542383","heartbeat_back_addr":"172.21.15.155:6831/944542383","heartbeat_front_addr":"172.21.15.155:6829/944542383","state":["exists","up"]},{"osd":7,"uuid":"328d0681-eef4-4556-94e1-9745bd4adbe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6801","nonce":2220093913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6807","nonce":2220093913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6818","nonce":2220093913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6812","nonce":2220093913}]},"public_addr":"172.21.15.155:6801/2220093913","cluster_addr":"172.21.15.155:6807/2220093913","heartbeat_back_addr":"172.21.15.155:6818/2220093913","heartbeat_front_addr":"172.21.15.155:6812/2220093913","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.052980+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.104550+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.025661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:35.784354+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:35.863363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.322312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.100890+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:35.763584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:47:16.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.293+0000 7f5003e00640 1 -- 172.21.15.2:0/2198203747 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f4fe006be30 msgr2=0x7f4fe006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:16.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.293+0000 7f5003e00640 1 --2- 172.21.15.2:0/2198203747 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f4fe006be30 0x7f4fe006e2f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4ff4034000 tx=0x7f4ff402e000 comp rx=0 tx=0).stop 2024-09-10T08:47:16.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.293+0000 7f5003e00640 1 -- 172.21.15.2:0/2198203747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50040cebc0 msgr2=0x7f50040cb430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:16.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.293+0000 7f5003e00640 1 --2- 172.21.15.2:0/2198203747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50040cebc0 0x7f50040cb430 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4fec00c400 tx=0x7f4fec00c8c0 comp rx=0 tx=0).stop 2024-09-10T08:47:16.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.293+0000 7f5003e00640 1 -- 172.21.15.2:0/2198203747 shutdown_connections 2024-09-10T08:47:16.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.293+0000 7f5003e00640 1 --2- 172.21.15.2:0/2198203747 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f4fe006be30 0x7f4fe006e2f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:16.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.293+0000 7f5003e00640 1 --2- 172.21.15.2:0/2198203747 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f500415e4c0 0x7f50040cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:16.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.293+0000 7f5003e00640 1 --2- 172.21.15.2:0/2198203747 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50040cebc0 0x7f50040cb430 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:16.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.293+0000 7f5003e00640 1 --2- 172.21.15.2:0/2198203747 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50040b64f0 0x7f50040c8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:16.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.293+0000 7f5003e00640 1 -- 172.21.15.2:0/2198203747 >> 172.21.15.2:0/2198203747 conn(0x7f50040d0de0 msgr2=0x7f50040b4990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:16.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.293+0000 7f5003e00640 1 -- 172.21.15.2:0/2198203747 shutdown_connections 2024-09-10T08:47:16.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.293+0000 7f5003e00640 1 -- 172.21.15.2:0/2198203747 wait complete. 2024-09-10T08:47:16.312 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-10T08:47:16.312 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-10T08:47:16.313 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-10T08:47:16.313 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-10T08:47:16.313 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-10T08:47:16.314 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-10T08:47:16.314 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-10T08:47:16.315 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-10T08:47:16.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.589+0000 7f3bb6400640 1 Processor -- start 2024-09-10T08:47:16.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.589+0000 7f3bb6400640 1 -- start start 2024-09-10T08:47:16.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.591+0000 7f3bb6400640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3bb008ba20 0x7f3bb0073760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:16.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.591+0000 7f3bb6400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3bb00b2f50 0x7f3bb00d0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:16.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.591+0000 7f3bb6400640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bb008be00 con 0x7f3bb0072150 2024-09-10T08:47:16.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.591+0000 7f3bb6400640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f3bb00726c0 con 0x7f3bb00b2f50 2024-09-10T08:47:16.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.591+0000 7f3bb6400640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f3bb00729a0 con 0x7f3bb008ba20 2024-09-10T08:47:16.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.591+0000 7f3bafe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3bb00b2f50 0x7f3bb00d0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:16.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.591+0000 7f3bafe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3bb00b2f50 0x7f3bb00d0210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50910/0 (socket says 172.21.15.2:50910) 2024-09-10T08:47:16.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.591+0000 7f3bafe00640 1 -- 172.21.15.2:0/3787499639 learned_addr learned my addr 172.21.15.2:0/3787499639 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:16.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.591+0000 7f3bb5000640 1 --2- 172.21.15.2:0/3787499639 >> v2:172.21.15.155:3300/0 conn(0x7f3bb008ba20 0x7f3bb0073760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:16.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.592+0000 7f3bafe00640 1 -- 172.21.15.2:0/3787499639 >> v2:172.21.15.155:3300/0 conn(0x7f3bb008ba20 msgr2=0x7f3bb0073760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:16.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.592+0000 7f3bafe00640 1 --2- 172.21.15.2:0/3787499639 >> v2:172.21.15.155:3300/0 conn(0x7f3bb008ba20 0x7f3bb0073760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:16.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.592+0000 7f3bafe00640 1 -- 172.21.15.2:0/3787499639 >> v1:172.21.15.155:6789/0 conn(0x7f3bb0072150 legacy=0x7f3bb00acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:16.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.592+0000 7f3bafe00640 1 -- 172.21.15.2:0/3787499639 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bb0072c80 con 0x7f3bb00b2f50 2024-09-10T08:47:16.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.594+0000 7f3bafe00640 1 --2- 172.21.15.2:0/3787499639 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3bb00b2f50 0x7f3bb00d0210 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3bb00d0d40 tx=0x7f3b9c02a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdc592e6f54b7b9f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:16.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.594+0000 7f3baf400640 1 -- 172.21.15.2:0/3787499639 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b9c037070 con 0x7f3bb00b2f50 2024-09-10T08:47:16.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.594+0000 7f3baf400640 1 -- 172.21.15.2:0/3787499639 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b9c032440 con 0x7f3bb00b2f50 2024-09-10T08:47:16.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.594+0000 7f3baf400640 1 -- 172.21.15.2:0/3787499639 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b9c032810 con 0x7f3bb00b2f50 2024-09-10T08:47:16.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.596+0000 7f3bb6400640 1 -- 172.21.15.2:0/3787499639 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3bb00b2f50 msgr2=0x7f3bb00d0210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:16.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.596+0000 7f3bb6400640 1 --2- 172.21.15.2:0/3787499639 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3bb00b2f50 0x7f3bb00d0210 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3bb00d0d40 tx=0x7f3b9c02a2a0 comp rx=0 tx=0).stop 2024-09-10T08:47:16.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.596+0000 7f3bb6400640 1 -- 172.21.15.2:0/3787499639 shutdown_connections 2024-09-10T08:47:16.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.596+0000 7f3bb6400640 1 --2- 172.21.15.2:0/3787499639 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3bb00b2f50 0x7f3bb00d0210 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:16.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.596+0000 7f3bb6400640 1 --2- 172.21.15.2:0/3787499639 >> v2:172.21.15.155:3300/0 conn(0x7f3bb008ba20 0x7f3bb0073760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:16.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.596+0000 7f3bb6400640 1 -- 172.21.15.2:0/3787499639 >> 172.21.15.2:0/3787499639 conn(0x7f3bb006bdf0 msgr2=0x7f3bb006c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:16.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.597+0000 7f3bb6400640 1 -- 172.21.15.2:0/3787499639 shutdown_connections 2024-09-10T08:47:16.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.597+0000 7ff42cc00640 1 Processor -- start 2024-09-10T08:47:16.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.597+0000 7f3bb6400640 1 -- 172.21.15.2:0/3787499639 wait complete. 2024-09-10T08:47:16.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.597+0000 7f041c000640 1 Processor -- start 2024-09-10T08:47:16.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.598+0000 7f041c000640 1 -- start start 2024-09-10T08:47:16.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.597+0000 7ff42cc00640 1 -- start start 2024-09-10T08:47:16.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.599+0000 7f3bb6400640 1 Processor -- start 2024-09-10T08:47:16.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.599+0000 7ff42cc00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff4280d2f90 0x7ff4280d44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:16.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.599+0000 7ff42cc00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff4280d4a00 0x7ff4280d0920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:16.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.599+0000 7ff42cc00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff42815eb50 con 0x7ff42815e770 2024-09-10T08:47:16.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.599+0000 7ff42cc00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7ff4280cf640 con 0x7ff4280d4a00 2024-09-10T08:47:16.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.599+0000 7ff42cc00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff4280d4e50 con 0x7ff4280d2f90 2024-09-10T08:47:16.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.600+0000 7ff427400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ff42815e770 0x7ff4280cef30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48348/0 (socket says 172.21.15.2:48348) 2024-09-10T08:47:16.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.600+0000 7f3bb6400640 1 -- start start 2024-09-10T08:47:16.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.600+0000 7ff427400640 1 -- 172.21.15.2:0/3721512472 learned_addr learned my addr 172.21.15.2:0/3721512472 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:47:16.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.600+0000 7ff427e00640 1 --2- 172.21.15.2:0/3721512472 >> v2:172.21.15.155:3300/0 conn(0x7ff4280d4a00 0x7ff4280d0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:16.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.600+0000 7ff426a00640 1 --2- 172.21.15.2:0/3721512472 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff4280d2f90 0x7ff4280d44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:16.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.600+0000 7f041c000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0414161ca0 0x7f04140d2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:16.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.600+0000 7ff427e00640 1 -- 172.21.15.2:0/3721512472 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff4280d2f90 msgr2=0x7ff4280d44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:16.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.600+0000 7ff427e00640 1 --2- 172.21.15.2:0/3721512472 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff4280d2f90 0x7ff4280d44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:16.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.600+0000 7ff427e00640 1 -- 172.21.15.2:0/3721512472 >> v1:172.21.15.2:6789/0 conn(0x7ff42815e770 legacy=0x7ff4280cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:16.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.600+0000 7ff427e00640 1 -- 172.21.15.2:0/3721512472 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4280d33f0 con 0x7ff4280d4a00 2024-09-10T08:47:16.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.601+0000 7f041c000640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f04140d2b60 0x7f04140cf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:16.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.601+0000 7f20c6200640 1 Processor -- start 2024-09-10T08:47:16.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.601+0000 7f041c000640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04140cfba0 con 0x7f04140cf6f0 2024-09-10T08:47:16.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.601+0000 7f041c000640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f04140d34a0 con 0x7f04140d2b60 2024-09-10T08:47:16.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.601+0000 7f041c000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f041406cdf0 con 0x7f0414161ca0 2024-09-10T08:47:16.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.601+0000 7f041a000640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f04140cf6f0 0x7f04140d0d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.2:44136/0 (socket says 172.21.15.2:44136) 2024-09-10T08:47:16.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.601+0000 7f041a000640 1 -- 172.21.15.2:0/4017482509 learned_addr learned my addr 172.21.15.2:0/4017482509 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:47:16.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.602+0000 7f0419600640 1 --2- 172.21.15.2:0/4017482509 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0414161ca0 0x7f04140d2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:16.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.601+0000 7f3bb6400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3bb0072150 0x7f3bb015cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:16.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.601+0000 7f3bb6400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3bb008ba20 0x7f3bb0161540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:16.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.602+0000 7f3bb6400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3bb00b2f50 0x7f3bb00ce060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:16.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.602+0000 7f3bb6400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3bb00d0750 con 0x7f3bb00b2f50 2024-09-10T08:47:16.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.602+0000 7f3bb6400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3bb0071da0 con 0x7f3bb0072150 2024-09-10T08:47:16.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.602+0000 7f3bb6400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3bb00d08d0 con 0x7f3bb008ba20 2024-09-10T08:47:16.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.602+0000 7f3bafe00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3bb008ba20 0x7f3bb0161540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:16.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.602+0000 7f3bafe00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3bb008ba20 0x7f3bb0161540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.2:40380/0 (socket says 172.21.15.2:40380) 2024-09-10T08:47:16.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.602+0000 7f3bafe00640 1 -- 172.21.15.2:0/3808242425 learned_addr learned my addr 172.21.15.2:0/3808242425 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:16.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.602+0000 7f3bb5000640 1 --2- 172.21.15.2:0/3808242425 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3bb0072150 0x7f3bb015cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:16.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.602+0000 7f3bb5a00640 1 --2- 172.21.15.2:0/3808242425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3bb00b2f50 0x7f3bb00ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:16.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.602+0000 7f0418c00640 1 --2- 172.21.15.2:0/4017482509 >> v2:172.21.15.155:3300/0 conn(0x7f04140d2b60 0x7f04140cf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:16.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.603+0000 7f3bafe00640 1 -- 172.21.15.2:0/3808242425 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3bb0072150 msgr2=0x7f3bb015cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:16.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.603+0000 7f3bafe00640 1 --2- 172.21.15.2:0/3808242425 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3bb0072150 0x7f3bb015cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:16.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.603+0000 7f3bafe00640 1 -- 172.21.15.2:0/3808242425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3bb00b2f50 msgr2=0x7f3bb00ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:16.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.602+0000 7f0413e00640 1 -- 172.21.15.2:0/4017482509 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3762125308 0 0) 0x7f04140cfba0 con 0x7f04140cf6f0 2024-09-10T08:47:16.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.603+0000 7f0413e00640 1 -- 172.21.15.2:0/4017482509 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f03fc003520 con 0x7f04140cf6f0 2024-09-10T08:47:16.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.601+0000 7f20c6200640 1 -- start start 2024-09-10T08:47:16.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.603+0000 7ff427e00640 1 --2- 172.21.15.2:0/3721512472 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4280d4a00 0x7ff4280d0920 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff420009dc0 tx=0x7ff42002a6d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0dfbc2a3df9bbd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:16.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.603+0000 7f3bafe00640 1 --2- 172.21.15.2:0/3808242425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3bb00b2f50 0x7f3bb00ce060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:16.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.603+0000 7f3bafe00640 1 -- 172.21.15.2:0/3808242425 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bb015d0a0 con 0x7f3bb008ba20 2024-09-10T08:47:16.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.603+0000 7f3bb5a00640 1 --2- 172.21.15.2:0/3808242425 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3bb00b2f50 0x7f3bb00ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:47:16.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.603+0000 7f5a57200640 1 Processor -- start 2024-09-10T08:47:16.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.603+0000 7ff426000640 1 -- 172.21.15.2:0/3721512472 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff420007740 con 0x7ff4280d4a00 2024-09-10T08:47:16.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.604+0000 7ff426000640 1 -- 172.21.15.2:0/3721512472 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4200078e0 con 0x7ff4280d4a00 2024-09-10T08:47:16.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.604+0000 7ff426000640 1 -- 172.21.15.2:0/3721512472 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff420007cb0 con 0x7ff4280d4a00 2024-09-10T08:47:16.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.604+0000 7f5a57200640 1 -- start start 2024-09-10T08:47:16.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.604+0000 7f3bafe00640 1 --2- 172.21.15.2:0/3808242425 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3bb008ba20 0x7f3bb0161540 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c0090b0 tx=0x7f3b9c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:16.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.604+0000 7f3bacc00640 1 -- 172.21.15.2:0/3808242425 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b9c043070 con 0x7f3bb008ba20 2024-09-10T08:47:16.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.604+0000 7f3bacc00640 1 -- 172.21.15.2:0/3808242425 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b9c038040 con 0x7f3bb008ba20 2024-09-10T08:47:16.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.604+0000 7f3bacc00640 1 -- 172.21.15.2:0/3808242425 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b9c037050 con 0x7f3bb008ba20 2024-09-10T08:47:16.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.603+0000 7f0418c00640 1 -- 172.21.15.2:0/4017482509 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0414161ca0 msgr2=0x7f04140d2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:16.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.603+0000 7f0418c00640 1 --2- 172.21.15.2:0/4017482509 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0414161ca0 0x7f04140d2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:16.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.603+0000 7f0418c00640 1 -- 172.21.15.2:0/4017482509 >> v1:172.21.15.155:6789/0 conn(0x7f04140cf6f0 legacy=0x7f04140d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:16.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.603+0000 7f0418c00640 1 -- 172.21.15.2:0/4017482509 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04140cfe50 con 0x7f04140d2b60 2024-09-10T08:47:16.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.605+0000 7f0418c00640 1 --2- 172.21.15.2:0/4017482509 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04140d2b60 0x7f04140cf1b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f04000097a0 tx=0x7f040002a080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=545a9e03c10f1648 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:16.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.603+0000 7f20c6200640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f20c00b4410 0x7f20c00b47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:16.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.604+0000 7f20c6200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f20c00ce1c0 0x7f20c006e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:16.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.604+0000 7f20c6200640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20c00b4d30 con 0x7f20c00aec90 2024-09-10T08:47:16.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.604+0000 7f20c6200640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f20c00adbf0 con 0x7f20c00ce1c0 2024-09-10T08:47:16.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.604+0000 7f20c6200640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f20c00aded0 con 0x7f20c00b4410 2024-09-10T08:47:16.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.604+0000 7f20bf400640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f20c00b4410 0x7f20c00b47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:16.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.605+0000 7f20bf400640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f20c00b4410 0x7f20c00b47f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.2:45370/0 (socket says 172.21.15.2:45370) 2024-09-10T08:47:16.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.605+0000 7f20bf400640 1 -- 172.21.15.2:0/1668650844 learned_addr learned my addr 172.21.15.2:0/1668650844 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:16.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.605+0000 7f20bfe00640 1 --2- 172.21.15.2:0/1668650844 >> v2:172.21.15.2:3300/0 conn(0x7f20c00ce1c0 0x7f20c006e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:16.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.605+0000 7f20bf400640 1 -- 172.21.15.2:0/1668650844 >> v2:172.21.15.2:3300/0 conn(0x7f20c00ce1c0 msgr2=0x7f20c006e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:16.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.605+0000 7f20bf400640 1 --2- 172.21.15.2:0/1668650844 >> v2:172.21.15.2:3300/0 conn(0x7f20c00ce1c0 0x7f20c006e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:16.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.605+0000 7f20bf400640 1 -- 172.21.15.2:0/1668650844 >> v1:172.21.15.2:6789/0 conn(0x7f20c00aec90 legacy=0x7f20c006df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:16.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.605+0000 7f3bb6400640 1 -- 172.21.15.2:0/3808242425 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bb0160aa0 con 0x7f3bb008ba20 2024-09-10T08:47:16.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.605+0000 7f3bb6400640 1 -- 172.21.15.2:0/3808242425 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bb0160d40 con 0x7f3bb008ba20 2024-09-10T08:47:16.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.606+0000 7f5a57200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a5815e690 0x7f5a580d0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:16.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.606+0000 7f0413e00640 1 -- 172.21.15.2:0/4017482509 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0400037070 con 0x7f04140d2b60 2024-09-10T08:47:16.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.606+0000 7f20bf400640 1 -- 172.21.15.2:0/1668650844 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20c00ae1b0 con 0x7f20c00b4410 2024-09-10T08:47:16.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.606+0000 7f5a57200640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a580d3720 con 0x7f5a580d20e0 2024-09-10T08:47:16.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.606+0000 7f5a57200640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a580d2680 con 0x7f5a580d13d0 2024-09-10T08:47:16.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.606+0000 7f5a57200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5a580d3290 con 0x7f5a5815e690 2024-09-10T08:47:16.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.606+0000 7f5a56800640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f5a580d13d0 0x7f5a580d0310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.2:44140/0 (socket says 172.21.15.2:44140) 2024-09-10T08:47:16.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.606+0000 7f5a56800640 1 -- 172.21.15.2:0/3202531829 learned_addr learned my addr 172.21.15.2:0/3202531829 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:47:16.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.606+0000 7f5a55e00640 1 --2- 172.21.15.2:0/3202531829 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a5815e690 0x7f5a580d0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:16.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.607+0000 7f0413e00640 1 -- 172.21.15.2:0/4017482509 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f040002ab10 con 0x7f04140d2b60 2024-09-10T08:47:16.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.607+0000 7f0413e00640 1 -- 172.21.15.2:0/4017482509 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f040c0019f0 con 0x7f04140d2b60 2024-09-10T08:47:16.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.607+0000 7f3bb6400640 1 -- 172.21.15.2:0/3808242425 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3bb0073760 con 0x7f3bb008ba20 2024-09-10T08:47:16.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.607+0000 7ff42cc00640 1 -- 172.21.15.2:0/3721512472 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4280d4a00 msgr2=0x7ff4280d0920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:16.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.607+0000 7ff42cc00640 1 --2- 172.21.15.2:0/3721512472 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4280d4a00 0x7ff4280d0920 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff420009dc0 tx=0x7ff42002a6d0 comp rx=0 tx=0).stop 2024-09-10T08:47:16.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.607+0000 7f5a54a00640 1 -- 172.21.15.2:0/3202531829 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2110738071 0 0) 0x7f5a580d2680 con 0x7f5a580d13d0 2024-09-10T08:47:16.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.607+0000 7ff42cc00640 1 -- 172.21.15.2:0/3721512472 shutdown_connections 2024-09-10T08:47:16.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.607+0000 7ff42cc00640 1 --2- 172.21.15.2:0/3721512472 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4280d4a00 0x7ff4280d0920 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:16.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.607+0000 7ff42cc00640 1 --2- 172.21.15.2:0/3721512472 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff4280d2f90 0x7ff4280d44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:16.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.607+0000 7ff42cc00640 1 -- 172.21.15.2:0/3721512472 >> 172.21.15.2:0/3721512472 conn(0x7ff42808bfd0 msgr2=0x7ff42809d7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:16.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.607+0000 7f74de600640 1 Processor -- start 2024-09-10T08:47:16.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.607+0000 7f5a54a00640 1 -- 172.21.15.2:0/3202531829 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a3c003520 con 0x7f5a580d13d0 2024-09-10T08:47:16.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.607+0000 7f5a54a00640 1 -- 172.21.15.2:0/3202531829 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2186861772 0 0) 0x7f5a580d3720 con 0x7f5a580d20e0 2024-09-10T08:47:16.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.608+0000 7f5a54a00640 1 -- 172.21.15.2:0/3202531829 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a580d2680 con 0x7f5a580d20e0 2024-09-10T08:47:16.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.608+0000 7ff42cc00640 1 -- 172.21.15.2:0/3721512472 shutdown_connections 2024-09-10T08:47:16.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.608+0000 7f74de600640 1 -- start start 2024-09-10T08:47:16.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.608+0000 7f041c000640 1 -- 172.21.15.2:0/4017482509 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04140d2b60 msgr2=0x7f04140cf1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:16.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.608+0000 7f041c000640 1 --2- 172.21.15.2:0/4017482509 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04140d2b60 0x7f04140cf1b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f04000097a0 tx=0x7f040002a080 comp rx=0 tx=0).stop 2024-09-10T08:47:16.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.608+0000 7f20bf400640 1 --2- 172.21.15.2:0/1668650844 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f20c00b4410 0x7f20c00b47f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f20c006dc70 tx=0x7f20a802a160 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1740b6c5563c3f18 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:16.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.608+0000 7f041c000640 1 -- 172.21.15.2:0/4017482509 shutdown_connections 2024-09-10T08:47:16.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.608+0000 7f5a54a00640 1 -- 172.21.15.2:0/3202531829 <== mon.1 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1038191122 0 0) 0x7f5a3c003520 con 0x7f5a580d13d0 2024-09-10T08:47:16.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.608+0000 7f5a54a00640 1 -- 172.21.15.2:0/3202531829 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a5815e690 msgr2=0x7f5a580d0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:16.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.608+0000 7f5a54a00640 1 --2- 172.21.15.2:0/3202531829 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a5815e690 0x7f5a580d0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:16.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.608+0000 7f5a54a00640 1 -- 172.21.15.2:0/3202531829 >> v1:172.21.15.2:6789/0 conn(0x7f5a580d20e0 legacy=0x7f5a580b1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:16.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.608+0000 7f5a54a00640 1 -- 172.21.15.2:0/3202531829 --> v1:172.21.15.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a580d2960 con 0x7f5a580d13d0 2024-09-10T08:47:16.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.608+0000 7f5a54a00640 1 -- 172.21.15.2:0/3202531829 <== mon.1 v1:172.21.15.155:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2345211856 0 0) 0x7f5a44001670 con 0x7f5a580d13d0 2024-09-10T08:47:16.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.608+0000 7f5a54a00640 1 -- 172.21.15.2:0/3202531829 >> v1:172.21.15.155:6789/0 conn(0x7f5a580d13d0 legacy=0x7f5a580d0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:16.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.608+0000 7f041c000640 1 --2- 172.21.15.2:0/4017482509 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04140d2b60 0x7f04140cf1b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:16.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.608+0000 7f041c000640 1 --2- 172.21.15.2:0/4017482509 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0414161ca0 0x7f04140d2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:16.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.608+0000 7f041c000640 1 -- 172.21.15.2:0/4017482509 >> 172.21.15.2:0/4017482509 conn(0x7f041408bfd0 msgr2=0x7f04140d45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:16.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.608+0000 7f20be000640 1 -- 172.21.15.2:0/1668650844 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a8037070 con 0x7f20c00b4410 2024-09-10T08:47:16.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.609+0000 7f20be000640 1 -- 172.21.15.2:0/1668650844 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20a8032440 con 0x7f20c00b4410 2024-09-10T08:47:16.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.609+0000 7f20be000640 1 -- 172.21.15.2:0/1668650844 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a8032810 con 0x7f20c00b4410 2024-09-10T08:47:16.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.608+0000 7f5a54a00640 1 --2- 172.21.15.2:0/3202531829 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a3c004ba0 0x7f5a3c004fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:16.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.608+0000 7f5a54a00640 1 --2- 172.21.15.2:0/3202531829 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a3c0037a0 0x7f5a3c003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:16.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.608+0000 7f5a54a00640 1 --2- 172.21.15.2:0/3202531829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a3c004160 0x7f5a3c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:16.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.608+0000 7f5a54a00640 1 -- 172.21.15.2:0/3202531829 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5a580d3290 con 0x7f5a3c004160 2024-09-10T08:47:16.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.608+0000 7f5a54a00640 1 -- 172.21.15.2:0/3202531829 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5a3c00bfb0 con 0x7f5a3c0037a0 2024-09-10T08:47:16.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.608+0000 7f5a54a00640 1 -- 172.21.15.2:0/3202531829 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5a3c00c180 con 0x7f5a3c004ba0 2024-09-10T08:47:16.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.609+0000 7f5a55e00640 1 --2- 172.21.15.2:0/3202531829 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a5815e690 0x7f5a580d0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:47:16.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.609+0000 7f3bacc00640 1 -- 172.21.15.2:0/3808242425 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3b9c046070 con 0x7f3bb008ba20 2024-09-10T08:47:16.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.609+0000 7f5a56800640 1 --2- 172.21.15.2:0/3202531829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a3c004160 0x7f5a3c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:16.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.609+0000 7f041c000640 1 -- 172.21.15.2:0/4017482509 shutdown_connections 2024-09-10T08:47:16.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.610+0000 7f20c6200640 1 -- 172.21.15.2:0/1668650844 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f20c00b4410 msgr2=0x7f20c00b47f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:16.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.610+0000 7f20c6200640 1 --2- 172.21.15.2:0/1668650844 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f20c00b4410 0x7f20c00b47f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f20c006dc70 tx=0x7f20a802a160 comp rx=0 tx=0).stop 2024-09-10T08:47:16.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.609+0000 7f5a55e00640 1 --2- 172.21.15.2:0/3202531829 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a3c004ba0 0x7f5a3c004fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:16.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.610+0000 7f74de600640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f74d80b4410 0x7f74d80b47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:16.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.610+0000 7f5a55400640 1 --2- 172.21.15.2:0/3202531829 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a3c0037a0 0x7f5a3c003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:16.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.610+0000 7f74de600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74d80ce1c0 0x7f74d806e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:16.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.610+0000 7f74de600640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74d80b4d30 con 0x7f74d80aec90 2024-09-10T08:47:16.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.610+0000 7f74de600640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f74d80adbf0 con 0x7f74d80b4410 2024-09-10T08:47:16.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.610+0000 7f74de600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f74d80aded0 con 0x7f74d80ce1c0 2024-09-10T08:47:16.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.610+0000 7f20c6200640 1 -- 172.21.15.2:0/1668650844 shutdown_connections 2024-09-10T08:47:16.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.610+0000 7f20c6200640 1 --2- 172.21.15.2:0/1668650844 >> v2:172.21.15.2:3300/0 conn(0x7f20c00ce1c0 0x7f20c006e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:16.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.610+0000 7f20c6200640 1 --2- 172.21.15.2:0/1668650844 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f20c00b4410 0x7f20c00b47f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:16.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.610+0000 7f20c6200640 1 -- 172.21.15.2:0/1668650844 >> 172.21.15.2:0/1668650844 conn(0x7f20c00d02c0 msgr2=0x7f20c00d06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:16.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.610+0000 7f74d6a00640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f74d80aec90 0x7f74d806df50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.2:44148/0 (socket says 172.21.15.2:44148) 2024-09-10T08:47:16.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.610+0000 7f74d6a00640 1 -- 172.21.15.2:0/3119170836 learned_addr learned my addr 172.21.15.2:0/3119170836 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:47:16.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.611+0000 7f5a56800640 1 -- 172.21.15.2:0/3202531829 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a3c004ba0 msgr2=0x7f5a3c004fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:16.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.611+0000 7f20c6200640 1 -- 172.21.15.2:0/1668650844 shutdown_connections 2024-09-10T08:47:16.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.611+0000 7f74d7400640 1 --2- 172.21.15.2:0/3119170836 >> v2:172.21.15.155:3300/0 conn(0x7f74d80b4410 0x7f74d80b47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:16.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.610+0000 7f3bacc00640 1 --2- 172.21.15.2:0/3808242425 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f3b9006bf00 0x7f3b9006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:16.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.611+0000 7f3bacc00640 1 -- 172.21.15.2:0/3808242425 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f3b9c0ab2b0 con 0x7f3bb008ba20 2024-09-10T08:47:16.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.611+0000 7f3bacc00640 1 --2- 172.21.15.2:0/3808242425 >> [v2:172.21.15.2:6820/298678486,v1:172.21.15.2:6822/298678486] conn(0x7f3b90075680 0x7f3b90077ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:16.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.611+0000 7f3bacc00640 1 -- 172.21.15.2:0/3808242425 --> [v2:172.21.15.2:6820/298678486,v1:172.21.15.2:6822/298678486] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3b9c032440 con 0x7f3b90075680 2024-09-10T08:47:16.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.611+0000 7f3bacc00640 1 -- 172.21.15.2:0/3808242425 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f3b9c0b2050 con 0x7f3bb008ba20 2024-09-10T08:47:16.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.611+0000 7f74d7e00640 1 --2- 172.21.15.2:0/3119170836 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74d80ce1c0 0x7f74d806e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:16.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.611+0000 7f5a56800640 1 --2- 172.21.15.2:0/3202531829 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a3c004ba0 0x7f5a3c004fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:16.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.611+0000 7f4bb2e00640 1 Processor -- start 2024-09-10T08:47:16.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.610+0000 7f041c000640 1 -- 172.21.15.2:0/4017482509 wait complete. 2024-09-10T08:47:16.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.611+0000 7f20c6200640 1 -- 172.21.15.2:0/1668650844 wait complete. 2024-09-10T08:47:16.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.611+0000 7f5a56800640 1 -- 172.21.15.2:0/3202531829 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a3c0037a0 msgr2=0x7f5a3c003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:16.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.611+0000 7f5a56800640 1 --2- 172.21.15.2:0/3202531829 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a3c0037a0 0x7f5a3c003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:16.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.611+0000 7f5a56800640 1 -- 172.21.15.2:0/3202531829 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a580d2960 con 0x7f5a3c004160 2024-09-10T08:47:16.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.612+0000 7f5a55e00640 1 --2- 172.21.15.2:0/3202531829 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a3c004ba0 0x7f5a3c004fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:47:16.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.612+0000 7f74d6000640 1 -- 172.21.15.2:0/3119170836 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 168754182 0 0) 0x7f74d80b4d30 con 0x7f74d80aec90 2024-09-10T08:47:16.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.612+0000 7f3bb5000640 1 --2- 172.21.15.2:0/3808242425 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f3b9006bf00 0x7f3b9006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:16.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.612+0000 7f3bb5a00640 1 --2- 172.21.15.2:0/3808242425 >> [v2:172.21.15.2:6820/298678486,v1:172.21.15.2:6822/298678486] conn(0x7f3b90075680 0x7f3b90077ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:16.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.613+0000 7f3bb5a00640 1 --2- 172.21.15.2:0/3808242425 >> [v2:172.21.15.2:6820/298678486,v1:172.21.15.2:6822/298678486] conn(0x7f3b90075680 0x7f3b90077ac0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:16.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.609+0000 7ff42cc00640 1 -- 172.21.15.2:0/3721512472 wait complete. 2024-09-10T08:47:16.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.612+0000 7ff42cc00640 1 Processor -- start 2024-09-10T08:47:16.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.613+0000 7f74d6000640 1 -- 172.21.15.2:0/3119170836 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f74bc003520 con 0x7f74d80aec90 2024-09-10T08:47:16.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.612+0000 7f4bb2e00640 1 -- start start 2024-09-10T08:47:16.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.613+0000 7f041c000640 1 Processor -- start 2024-09-10T08:47:16.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.613+0000 7f20c6200640 1 Processor -- start 2024-09-10T08:47:16.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.614+0000 7fe8f2000640 1 Processor -- start 2024-09-10T08:47:16.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.614+0000 7f041c000640 1 -- start start 2024-09-10T08:47:16.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.613+0000 7f5a56800640 1 --2- 172.21.15.2:0/3202531829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a3c004160 0x7f5a3c00b9c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5a4400c290 tx=0x7f5a3c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8978e6ef1b2166a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:16.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.614+0000 7f5a54a00640 1 -- 172.21.15.2:0/3202531829 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a44007d10 con 0x7f5a3c004160 2024-09-10T08:47:16.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.614+0000 7f5a54a00640 1 -- 172.21.15.2:0/3202531829 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a44005ad0 con 0x7f5a3c004160 2024-09-10T08:47:16.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.614+0000 7f4bb2e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4bac06e570 0x7f4bac169240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:16.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.614+0000 7f4bb2e00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bac0cfe50 con 0x7f4bac0d2d30 2024-09-10T08:47:16.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.614+0000 7f4bb2e00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bac0d0130 con 0x7f4bac161ca0 2024-09-10T08:47:16.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.614+0000 7f4bb2e00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f4bac0d34a0 con 0x7f4bac06e570 2024-09-10T08:47:16.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.614+0000 7fe8f2000640 1 -- start start 2024-09-10T08:47:16.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.615+0000 7f3bacc00640 1 -- 172.21.15.2:0/3808242425 <== osd.0 v2:172.21.15.2:6820/298678486 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3b9c032440 con 0x7f3b90075680 2024-09-10T08:47:16.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.612+0000 7ff42cc00640 1 -- start start 2024-09-10T08:47:16.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.615+0000 7f4babe00640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f4bac161ca0 0x7f4bac0d2620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.2:44162/0 (socket says 172.21.15.2:44162) 2024-09-10T08:47:16.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.615+0000 7f4babe00640 1 -- 172.21.15.2:0/2046381076 learned_addr learned my addr 172.21.15.2:0/2046381076 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:47:16.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.614+0000 7ff42cc00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4280d2f90 0x7ff4280b9c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:16.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.614+0000 7ff42cc00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4280d4a00 0x7ff428160ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:16.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.614+0000 7ff42cc00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff42815e770 0x7ff428160ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:16.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.615+0000 7f5a54a00640 1 -- 172.21.15.2:0/3202531829 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a44007070 con 0x7f5a3c004160 2024-09-10T08:47:16.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.614+0000 7f74d6000640 1 -- 172.21.15.2:0/3119170836 <== mon.1 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3456627523 0 0) 0x7f74bc003520 con 0x7f74d80aec90 2024-09-10T08:47:16.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.614+0000 7f74d6000640 1 -- 172.21.15.2:0/3119170836 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74d80ce1c0 msgr2=0x7f74d806e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:16.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.614+0000 7f74d6000640 1 --2- 172.21.15.2:0/3119170836 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74d80ce1c0 0x7f74d806e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:16.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.614+0000 7f74d6000640 1 -- 172.21.15.2:0/3119170836 >> v2:172.21.15.155:3300/0 conn(0x7f74d80b4410 msgr2=0x7f74d80b47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:16.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.614+0000 7f74d6000640 1 --2- 172.21.15.2:0/3119170836 >> v2:172.21.15.155:3300/0 conn(0x7f74d80b4410 0x7f74d80b47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:16.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.614+0000 7f74d6000640 1 -- 172.21.15.2:0/3119170836 --> v1:172.21.15.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74d80ae1b0 con 0x7f74d80aec90 2024-09-10T08:47:16.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.614+0000 7f74d6000640 1 -- 172.21.15.2:0/3119170836 <== mon.1 v1:172.21.15.155:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2345211856 0 0) 0x7f74c4001670 con 0x7f74d80aec90 2024-09-10T08:47:16.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.614+0000 7f74d6000640 1 -- 172.21.15.2:0/3119170836 >> v1:172.21.15.155:6789/0 conn(0x7f74d80aec90 legacy=0x7f74d806df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:16.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.614+0000 7f74d6000640 1 --2- 172.21.15.2:0/3119170836 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74bc0039b0 0x7f74bc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:16.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.614+0000 7f74d6000640 1 --2- 172.21.15.2:0/3119170836 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74bc004800 0x7f74bc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:16.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.614+0000 7f74d6000640 1 --2- 172.21.15.2:0/3119170836 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74bc0051c0 0x7f74bc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:16.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.614+0000 7f74d6000640 1 -- 172.21.15.2:0/3119170836 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f74d80adbf0 con 0x7f74bc0039b0 2024-09-10T08:47:16.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.614+0000 7f74d6000640 1 -- 172.21.15.2:0/3119170836 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f74d80aded0 con 0x7f74bc004800 2024-09-10T08:47:16.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.614+0000 7f74d6000640 1 -- 172.21.15.2:0/3119170836 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f74bc00c060 con 0x7f74bc0051c0 2024-09-10T08:47:16.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.614+0000 7f74d7e00640 1 --2- 172.21.15.2:0/3119170836 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74bc0051c0 0x7f74bc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:16.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.615+0000 7f4bb0e00640 1 --2- 172.21.15.2:0/2046381076 >> v2:172.21.15.2:3300/0 conn(0x7f4bac06e570 0x7f4bac169240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:16.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.615+0000 7ff42cc00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff4280cfe40 con 0x7ff4280d4a00 2024-09-10T08:47:16.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.616+0000 7f5a57200640 1 -- 172.21.15.2:0/3202531829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a3c004160 msgr2=0x7f5a3c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:16.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.616+0000 7f5a57200640 1 --2- 172.21.15.2:0/3202531829 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a3c004160 0x7f5a3c00b9c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5a4400c290 tx=0x7f5a3c005830 comp rx=0 tx=0).stop 2024-09-10T08:47:16.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.616+0000 7f4bb0e00640 1 -- 172.21.15.2:0/2046381076 >> v1:172.21.15.155:6789/0 conn(0x7f4bac161ca0 legacy=0x7f4bac0d2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:16.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.614+0000 7f20c6200640 1 -- start start 2024-09-10T08:47:16.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.616+0000 7f5a56800640 1 -- 172.21.15.2:0/3202531829 reap_dead start 2024-09-10T08:47:16.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.616+0000 7f20c6200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f20c00aec90 0x7f20c015d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:16.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.616+0000 7f20c6200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20c00b4410 0x7f20c00731b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:16.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.616+0000 7f20c6200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f20c00ce1c0 0x7f20c0159450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:16.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.616+0000 7f20c6200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f20c00b5170 con 0x7f20c00b4410 2024-09-10T08:47:16.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.616+0000 7f041c000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04140cf6f0 0x7f0414152990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:16.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.616+0000 7f20c6200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f20c00ae770 con 0x7f20c00ce1c0 2024-09-10T08:47:16.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.616+0000 7f20c6200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f20c0166350 con 0x7f20c00aec90 2024-09-10T08:47:16.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.616+0000 7f74d6a00640 1 --2- 172.21.15.2:0/3119170836 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74bc004800 0x7f74bc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:16.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.616+0000 7f74d7400640 1 --2- 172.21.15.2:0/3119170836 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74bc0039b0 0x7f74bc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:16.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.616+0000 7f041c000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04140d2b60 0x7f04140b2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:16.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.616+0000 7f041c000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0414161ca0 0x7f04140b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:16.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.616+0000 7f0419600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04140cf6f0 0x7f0414152990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:16.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.616+0000 7f0419600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04140cf6f0 0x7f0414152990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:50962/0 (socket says 172.21.15.2:50962) 2024-09-10T08:47:16.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.617+0000 7f041c000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f04140d0410 con 0x7f04140cf6f0 2024-09-10T08:47:16.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.617+0000 7f041c000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f04140d2fa0 con 0x7f0414161ca0 2024-09-10T08:47:16.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.617+0000 7f041c000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f041406d040 con 0x7f04140d2b60 2024-09-10T08:47:16.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.617+0000 7f0418c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04140d2b60 0x7f04140b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:16.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.617+0000 7f0418c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04140d2b60 0x7f04140b2060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.2:40432/0 (socket says 172.21.15.2:40432) 2024-09-10T08:47:16.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.616+0000 7f20bf400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f20c00aec90 0x7f20c015d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:16.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.616+0000 7f5a57200640 1 -- 172.21.15.2:0/3202531829 shutdown_connections 2024-09-10T08:47:16.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.616+0000 7f5a57200640 1 -- 172.21.15.2:0/3202531829 >> 172.21.15.2:0/3202531829 conn(0x7f5a5809d720 msgr2=0x7f5a580d4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:16.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.617+0000 7f0419600640 1 -- 172.21.15.2:0/3889523802 learned_addr learned my addr 172.21.15.2:0/3889523802 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:16.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.617+0000 7f3bb5000640 1 --2- 172.21.15.2:0/3808242425 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f3b9006bf00 0x7f3b9006e3c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3bb00cd120 tx=0x7f3ba4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:16.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.617+0000 7f041a000640 1 --2- 172.21.15.2:0/3889523802 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0414161ca0 0x7f04140b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:16.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.617+0000 7f0419600640 1 -- 172.21.15.2:0/3889523802 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04140d2b60 msgr2=0x7f04140b2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:16.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.617+0000 7f0419600640 1 --2- 172.21.15.2:0/3889523802 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04140d2b60 0x7f04140b2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:16.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.617+0000 7f0419600640 1 -- 172.21.15.2:0/3889523802 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0414161ca0 msgr2=0x7f04140b25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:16.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.617+0000 7f5a57200640 1 -- 172.21.15.2:0/3202531829 shutdown_connections 2024-09-10T08:47:16.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.617+0000 7f5a57200640 1 -- 172.21.15.2:0/3202531829 wait complete. 2024-09-10T08:47:16.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.618+0000 7f0418c00640 1 --2- 172.21.15.2:0/3889523802 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04140d2b60 0x7f04140b2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:47:16.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.618+0000 7f0419600640 1 --2- 172.21.15.2:0/3889523802 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0414161ca0 0x7f04140b25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:16.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.617+0000 7f20bf400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f20c00aec90 0x7f20c015d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.2:40422/0 (socket says 172.21.15.2:40422) 2024-09-10T08:47:16.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.617+0000 7f20bf400640 1 -- 172.21.15.2:0/644192674 learned_addr learned my addr 172.21.15.2:0/644192674 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:16.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.617+0000 7f20bea00640 1 --2- 172.21.15.2:0/644192674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20c00b4410 0x7f20c00731b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:16.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.618+0000 7f20bfe00640 1 --2- 172.21.15.2:0/644192674 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f20c00ce1c0 0x7f20c0159450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:16.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.617+0000 7f74d6a00640 1 -- 172.21.15.2:0/3119170836 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74bc0051c0 msgr2=0x7f74bc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:16.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.617+0000 7f74d6a00640 1 --2- 172.21.15.2:0/3119170836 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74bc0051c0 0x7f74bc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:16.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.618+0000 7f0419600640 1 -- 172.21.15.2:0/3889523802 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0414152ed0 con 0x7f04140cf6f0 2024-09-10T08:47:16.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.617+0000 7f74d6a00640 1 -- 172.21.15.2:0/3119170836 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74bc0039b0 msgr2=0x7f74bc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:16.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.617+0000 7f74d6a00640 1 --2- 172.21.15.2:0/3119170836 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74bc0039b0 0x7f74bc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:16.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.617+0000 7f74d6a00640 1 -- 172.21.15.2:0/3119170836 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74d80ae1b0 con 0x7f74bc004800 2024-09-10T08:47:16.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.617+0000 7fe8f2000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe8ec15b360 0x7fe8ec0b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:16.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.617+0000 7f74d7400640 1 --2- 172.21.15.2:0/3119170836 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74bc0039b0 0x7f74bc003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:47:16.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.617+0000 7fe8f2000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8ec15b7b0 0x7fe8ec0ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:16.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.617+0000 7fe8f2000640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8ec0d10d0 con 0x7fe8ec0d0950 2024-09-10T08:47:16.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.617+0000 7fe8f2000640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fe8ec0ce1f0 con 0x7fe8ec15b360 2024-09-10T08:47:16.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.617+0000 7fe8f2000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe8ec0d0df0 con 0x7fe8ec15b7b0 2024-09-10T08:47:16.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.618+0000 7fe8eb400640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fe8ec0d0950 0x7fe8ec15c5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.2:44176/0 (socket says 172.21.15.2:44176) 2024-09-10T08:47:16.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.618+0000 7fe8eb400640 1 -- 172.21.15.2:0/1390550023 learned_addr learned my addr 172.21.15.2:0/1390550023 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:47:16.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.616+0000 7f4baaa00640 1 -- 172.21.15.2:0/2046381076 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 200616780 0 0) 0x7f4bac0d0130 con 0x7f4bac161ca0 2024-09-10T08:47:16.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.616+0000 7f4bb0e00640 1 -- 172.21.15.2:0/2046381076 >> v1:172.21.15.2:6789/0 conn(0x7f4bac0d2d30 legacy=0x7f4bac0cf1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:16.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.616+0000 7f4bb0e00640 1 -- 172.21.15.2:0/2046381076 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bac0d0410 con 0x7f4bac06e570 2024-09-10T08:47:16.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.618+0000 7f041a000640 1 --2- 172.21.15.2:0/3889523802 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0414161ca0 0x7f04140b25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:47:16.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.615+0000 7ff42cc00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff4280cfb60 con 0x7ff4280d2f90 2024-09-10T08:47:16.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.615+0000 7ff42cc00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff4280d0120 con 0x7ff42815e770 2024-09-10T08:47:16.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.615+0000 7ff427e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff42815e770 0x7ff428160ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:16.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.616+0000 7ff427e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff42815e770 0x7ff428160ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.2:40414/0 (socket says 172.21.15.2:40414) 2024-09-10T08:47:16.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.616+0000 7ff427e00640 1 -- 172.21.15.2:0/266963874 learned_addr learned my addr 172.21.15.2:0/266963874 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:16.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.616+0000 7ff427400640 1 --2- 172.21.15.2:0/266963874 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4280d2f90 0x7ff4280b9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:16.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.618+0000 7ff427400640 1 -- 172.21.15.2:0/266963874 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff42815e770 msgr2=0x7ff428160ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:16.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.618+0000 7ff427400640 1 --2- 172.21.15.2:0/266963874 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff42815e770 0x7ff428160ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:16.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.618+0000 7ff427400640 1 -- 172.21.15.2:0/266963874 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4280d4a00 msgr2=0x7ff428160ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:16.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.618+0000 7ff427400640 1 --2- 172.21.15.2:0/266963874 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4280d4a00 0x7ff428160ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:16.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.618+0000 7ff427400640 1 -- 172.21.15.2:0/266963874 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4280b26a0 con 0x7ff4280d2f90 2024-09-10T08:47:16.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.618+0000 7f20bfe00640 1 -- 172.21.15.2:0/644192674 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f20c00aec90 msgr2=0x7f20c015d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:16.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.618+0000 7f0419600640 1 --2- 172.21.15.2:0/3889523802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04140cf6f0 0x7f0414152990 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f040800d800 tx=0x7f040800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:16.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.618+0000 7fe8ebe00640 1 --2- 172.21.15.2:0/1390550023 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8ec15b7b0 0x7fe8ec0ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:16.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.619+0000 7f74d6a00640 1 --2- 172.21.15.2:0/3119170836 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74bc004800 0x7f74bc004c80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f74c400c260 tx=0x7f74bc005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f9a8697b58c189a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:16.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.618+0000 7f20bfe00640 1 --2- 172.21.15.2:0/644192674 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f20c00aec90 0x7f20c015d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:16.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.619+0000 7f20bfe00640 1 -- 172.21.15.2:0/644192674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20c00b4410 msgr2=0x7f20c00731b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:16.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.619+0000 7f20bfe00640 1 --2- 172.21.15.2:0/644192674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20c00b4410 0x7f20c00731b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:16.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.619+0000 7f20bfe00640 1 -- 172.21.15.2:0/644192674 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20c015f270 con 0x7f20c00ce1c0 2024-09-10T08:47:16.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.619+0000 7f20bea00640 1 --2- 172.21.15.2:0/644192674 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f20c00b4410 0x7f20c00731b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:47:16.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.619+0000 7f74d6000640 1 -- 172.21.15.2:0/3119170836 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74c4007d70 con 0x7f74bc004800 2024-09-10T08:47:16.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.619+0000 7f74d6000640 1 -- 172.21.15.2:0/3119170836 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74c4005af0 con 0x7f74bc004800 2024-09-10T08:47:16.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.619+0000 7f74d6000640 1 -- 172.21.15.2:0/3119170836 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74c4007070 con 0x7f74bc004800 2024-09-10T08:47:16.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.619+0000 7fe8eaa00640 1 -- 172.21.15.2:0/1390550023 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1194110870 0 0) 0x7fe8ec0d10d0 con 0x7fe8ec0d0950 2024-09-10T08:47:16.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.619+0000 7fe8eaa00640 1 -- 172.21.15.2:0/1390550023 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8d0003520 con 0x7fe8ec0d0950 2024-09-10T08:47:16.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.619+0000 7f4bb0e00640 1 --2- 172.21.15.2:0/2046381076 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bac06e570 0x7f4bac169240 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4b980097a0 tx=0x7f4b9802a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a98e882cf2e51f1f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:16.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.619+0000 7fe8eaa00640 1 -- 172.21.15.2:0/1390550023 <== mon.1 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3607596318 0 0) 0x7fe8d0003520 con 0x7fe8ec0d0950 2024-09-10T08:47:16.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.619+0000 7f0411600640 1 -- 172.21.15.2:0/3889523802 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f040800b6c0 con 0x7f04140cf6f0 2024-09-10T08:47:16.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.619+0000 7fe8ebe00640 1 -- 172.21.15.2:0/1390550023 >> v2:172.21.15.2:3300/0 conn(0x7fe8ec15b360 msgr2=0x7fe8ec0b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:16.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.619+0000 7fe8ebe00640 1 --2- 172.21.15.2:0/1390550023 >> v2:172.21.15.2:3300/0 conn(0x7fe8ec15b360 0x7fe8ec0b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:16.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.619+0000 7fe8ebe00640 1 -- 172.21.15.2:0/1390550023 >> v1:172.21.15.155:6789/0 conn(0x7fe8ec0d0950 legacy=0x7fe8ec15c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:16.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.619+0000 7f0411600640 1 -- 172.21.15.2:0/3889523802 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0408019070 con 0x7f04140cf6f0 2024-09-10T08:47:16.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.620+0000 7f0411600640 1 -- 172.21.15.2:0/3889523802 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f040800ba80 con 0x7f04140cf6f0 2024-09-10T08:47:16.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.619+0000 7fe8ebe00640 1 -- 172.21.15.2:0/1390550023 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8ec0cdba0 con 0x7fe8ec15b7b0 2024-09-10T08:47:16.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.619+0000 7f20bfe00640 1 --2- 172.21.15.2:0/644192674 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f20c00ce1c0 0x7f20c0159450 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f20b000cc80 tx=0x7f20b000a5c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:16.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.620+0000 7f20b7400640 1 -- 172.21.15.2:0/644192674 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b000ce30 con 0x7f20c00ce1c0 2024-09-10T08:47:16.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.620+0000 7f20b7400640 1 -- 172.21.15.2:0/644192674 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20b0003990 con 0x7f20c00ce1c0 2024-09-10T08:47:16.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.620+0000 7f20b7400640 1 -- 172.21.15.2:0/644192674 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b0003d60 con 0x7f20c00ce1c0 2024-09-10T08:47:16.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.620+0000 7ff427400640 1 --2- 172.21.15.2:0/266963874 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4280d2f90 0x7ff4280b9c70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff41800b410 tx=0x7ff41800b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:16.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.620+0000 7f20c6200640 1 -- 172.21.15.2:0/644192674 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20c015e250 con 0x7f20c00ce1c0 2024-09-10T08:47:16.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.620+0000 7f20c6200640 1 -- 172.21.15.2:0/644192674 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20c015e810 con 0x7f20c00ce1c0 2024-09-10T08:47:16.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.620+0000 7f041c000640 1 -- 172.21.15.2:0/3889523802 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04140cb7a0 con 0x7f04140cf6f0 2024-09-10T08:47:16.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.620+0000 7f041c000640 1 -- 172.21.15.2:0/3889523802 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04140cbd60 con 0x7f04140cf6f0 2024-09-10T08:47:16.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.620+0000 7f4baaa00640 1 -- 172.21.15.2:0/2046381076 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b98037070 con 0x7f4bac06e570 2024-09-10T08:47:16.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.620+0000 7ff41f400640 1 -- 172.21.15.2:0/266963874 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff418015020 con 0x7ff4280d2f90 2024-09-10T08:47:16.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.620+0000 7ff41f400640 1 -- 172.21.15.2:0/266963874 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff418011850 con 0x7ff4280d2f90 2024-09-10T08:47:16.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.620+0000 7ff41f400640 1 -- 172.21.15.2:0/266963874 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff418011c80 con 0x7ff4280d2f90 2024-09-10T08:47:16.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.620+0000 7ff42cc00640 1 -- 172.21.15.2:0/266963874 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4280b2980 con 0x7ff4280d2f90 2024-09-10T08:47:16.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.621+0000 7f20c6200640 1 -- 172.21.15.2:0/644192674 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f20c00cd880 con 0x7f20c00ce1c0 2024-09-10T08:47:16.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.621+0000 7f74de600640 1 -- 172.21.15.2:0/3119170836 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74bc004800 msgr2=0x7f74bc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:16.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.621+0000 7f74de600640 1 --2- 172.21.15.2:0/3119170836 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74bc004800 0x7f74bc004c80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f74c400c260 tx=0x7f74bc005830 comp rx=0 tx=0).stop 2024-09-10T08:47:16.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.621+0000 7f74d7e00640 1 -- 172.21.15.2:0/3119170836 reap_dead start 2024-09-10T08:47:16.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.621+0000 7f4baaa00640 1 -- 172.21.15.2:0/2046381076 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b98032440 con 0x7f4bac06e570 2024-09-10T08:47:16.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.621+0000 7f4baaa00640 1 -- 172.21.15.2:0/2046381076 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b98032810 con 0x7f4bac06e570 2024-09-10T08:47:16.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.621+0000 7f041c000640 1 -- 172.21.15.2:0/3889523802 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f04140cdd20 con 0x7f04140cf6f0 2024-09-10T08:47:16.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.621+0000 7fe8ebe00640 1 --2- 172.21.15.2:0/1390550023 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8ec15b7b0 0x7fe8ec0ce680 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe8e40097a0 tx=0x7fe8e402a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=965143e1893c696a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:16.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.621+0000 7f4bb2e00640 1 -- 172.21.15.2:0/2046381076 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bac06e570 msgr2=0x7f4bac169240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:16.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.622+0000 7f4bb2e00640 1 --2- 172.21.15.2:0/2046381076 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bac06e570 0x7f4bac169240 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4b980097a0 tx=0x7f4b9802a160 comp rx=0 tx=0).stop 2024-09-10T08:47:16.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.622+0000 7ff42cc00640 1 -- 172.21.15.2:0/266963874 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4280c83a0 con 0x7ff4280d2f90 2024-09-10T08:47:16.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.622+0000 7f5a57200640 1 Processor -- start 2024-09-10T08:47:16.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.622+0000 7f74de600640 1 -- 172.21.15.2:0/3119170836 shutdown_connections 2024-09-10T08:47:16.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.622+0000 7f74de600640 1 -- 172.21.15.2:0/3119170836 >> 172.21.15.2:0/3119170836 conn(0x7f74d80d02c0 msgr2=0x7f74d80d06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:16.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.622+0000 7f5a57200640 1 -- start start 2024-09-10T08:47:16.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.622+0000 7f74de600640 1 -- 172.21.15.2:0/3119170836 shutdown_connections 2024-09-10T08:47:16.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.622+0000 7fe8eaa00640 1 -- 172.21.15.2:0/1390550023 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e4037070 con 0x7fe8ec15b7b0 2024-09-10T08:47:16.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.622+0000 7fe8eaa00640 1 -- 172.21.15.2:0/1390550023 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8e402aba0 con 0x7fe8ec15b7b0 2024-09-10T08:47:16.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.622+0000 7fe8eaa00640 1 -- 172.21.15.2:0/1390550023 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d4001650 con 0x7fe8ec15b7b0 2024-09-10T08:47:16.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.624+0000 7f20b7400640 1 -- 172.21.15.2:0/644192674 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f20b0003f00 con 0x7f20c00ce1c0 2024-09-10T08:47:16.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.624+0000 7fe8f2000640 1 -- 172.21.15.2:0/1390550023 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8ec15b7b0 msgr2=0x7fe8ec0ce680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:16.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.624+0000 7fe8f2000640 1 --2- 172.21.15.2:0/1390550023 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8ec15b7b0 0x7fe8ec0ce680 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe8e40097a0 tx=0x7fe8e402a110 comp rx=0 tx=0).stop 2024-09-10T08:47:16.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.622+0000 7f4bb2e00640 1 -- 172.21.15.2:0/2046381076 shutdown_connections 2024-09-10T08:47:16.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.622+0000 7f4bb2e00640 1 --2- 172.21.15.2:0/2046381076 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bac06e570 0x7f4bac169240 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:16.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.622+0000 7f4bb2e00640 1 -- 172.21.15.2:0/2046381076 >> 172.21.15.2:0/2046381076 conn(0x7f4bac08bfd0 msgr2=0x7f4bac0d45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:16.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.623+0000 7f5a57200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a3c004160 0x7f5a58161230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:16.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.623+0000 7f5a57200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a5809e090 0x7f5a581f51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:16.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.624+0000 7f5a57200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a5809e510 0x7f5a581f5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:16.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.624+0000 7f5a57200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5a5815ea70 con 0x7f5a5809e510 2024-09-10T08:47:16.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.624+0000 7f5a57200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5a580d2f20 con 0x7f5a3c004160 2024-09-10T08:47:16.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.624+0000 7f5a57200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5a580ce640 con 0x7f5a5809e090 2024-09-10T08:47:16.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.625+0000 7f20b7400640 1 --2- 172.21.15.2:0/644192674 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f209c06be80 0x7f209c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:16.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.625+0000 7f5a56800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a5809e510 0x7f5a581f5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:16.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.625+0000 7fe8f2000640 1 -- 172.21.15.2:0/1390550023 shutdown_connections 2024-09-10T08:47:16.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.625+0000 7fe8f2000640 1 --2- 172.21.15.2:0/1390550023 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8ec15b7b0 0x7fe8ec0ce680 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:16.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.625+0000 7fe8f2000640 1 --2- 172.21.15.2:0/1390550023 >> v2:172.21.15.2:3300/0 conn(0x7fe8ec15b360 0x7fe8ec0b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:16.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.625+0000 7fe8f2000640 1 -- 172.21.15.2:0/1390550023 >> 172.21.15.2:0/1390550023 conn(0x7fe8ec0b68e0 msgr2=0x7fe8ec0b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:16.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.625+0000 7f20b7400640 1 -- 172.21.15.2:0/644192674 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f20b008ba00 con 0x7f20c00ce1c0 2024-09-10T08:47:16.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.625+0000 7f4bb2e00640 1 -- 172.21.15.2:0/2046381076 shutdown_connections 2024-09-10T08:47:16.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.624+0000 7ff41f400640 1 -- 172.21.15.2:0/266963874 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff418018020 con 0x7ff4280d2f90 2024-09-10T08:47:16.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.623+0000 7f74de600640 1 -- 172.21.15.2:0/3119170836 wait complete. 2024-09-10T08:47:16.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.625+0000 7f5a56800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a5809e510 0x7f5a581f5700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51002/0 (socket says 172.21.15.2:51002) 2024-09-10T08:47:16.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.625+0000 7fe8f2000640 1 -- 172.21.15.2:0/1390550023 shutdown_connections 2024-09-10T08:47:16.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.625+0000 7f4bb2e00640 1 -- 172.21.15.2:0/2046381076 wait complete. 2024-09-10T08:47:16.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.625+0000 7f74de600640 1 Processor -- start 2024-09-10T08:47:16.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.625+0000 7f5a56800640 1 -- 172.21.15.2:0/3570341487 learned_addr learned my addr 172.21.15.2:0/3570341487 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:16.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.625+0000 7f5a55e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a3c004160 0x7f5a58161230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:16.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.626+0000 7ff42cc00640 1 -- 172.21.15.2:0/266963874 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff4280d5340 con 0x7ff4280d2f90 2024-09-10T08:47:16.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.625+0000 7f5a55400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a5809e090 0x7f5a581f51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:16.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.626+0000 7f74de600640 1 -- start start 2024-09-10T08:47:16.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.627+0000 7f5a55e00640 1 -- 172.21.15.2:0/3570341487 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a5809e090 msgr2=0x7f5a581f51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:16.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.625+0000 7f20b7400640 1 --2- 172.21.15.2:0/644192674 >> [v2:172.21.15.2:6816/1270626884,v1:172.21.15.2:6817/1270626884] conn(0x7f209c075600 0x7f209c077a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:16.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.625+0000 7f20b7400640 1 -- 172.21.15.2:0/644192674 --> [v2:172.21.15.2:6816/1270626884,v1:172.21.15.2:6817/1270626884] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f20b001ae50 con 0x7f209c075600 2024-09-10T08:47:16.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.625+0000 7f20b7400640 1 -- 172.21.15.2:0/644192674 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f20b008bee0 con 0x7f20c00ce1c0 2024-09-10T08:47:16.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.626+0000 7f20bea00640 1 --2- 172.21.15.2:0/644192674 >> [v2:172.21.15.2:6816/1270626884,v1:172.21.15.2:6817/1270626884] conn(0x7f209c075600 0x7f209c077a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:16.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.625+0000 7f0411600640 1 -- 172.21.15.2:0/3889523802 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f040800bc20 con 0x7f04140cf6f0 2024-09-10T08:47:16.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.626+0000 7f0411600640 1 --2- 172.21.15.2:0/3889523802 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f03f406be30 0x7f03f406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:16.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.627+0000 7f0411600640 1 -- 172.21.15.2:0/3889523802 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f040808b650 con 0x7f04140cf6f0 2024-09-10T08:47:16.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.627+0000 7f0411600640 1 --2- 172.21.15.2:0/3889523802 >> [v2:172.21.15.2:6808/1619566025,v1:172.21.15.2:6809/1619566025] conn(0x7f03f40755b0 0x7f03f40779f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:16.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.627+0000 7f0411600640 1 -- 172.21.15.2:0/3889523802 --> [v2:172.21.15.2:6808/1619566025,v1:172.21.15.2:6809/1619566025] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f03f40780c0 con 0x7f03f40755b0 2024-09-10T08:47:16.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.627+0000 7f0411600640 1 -- 172.21.15.2:0/3889523802 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f0408092050 con 0x7f04140cf6f0 2024-09-10T08:47:16.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.627+0000 7f0418c00640 1 --2- 172.21.15.2:0/3889523802 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f03f406be30 0x7f03f406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:16.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.627+0000 7f5a55e00640 1 --2- 172.21.15.2:0/3570341487 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a5809e090 0x7f5a581f51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:16.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.627+0000 7f5a55e00640 1 -- 172.21.15.2:0/3570341487 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a5809e510 msgr2=0x7f5a581f5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:16.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.627+0000 7f5a55e00640 1 --2- 172.21.15.2:0/3570341487 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a5809e510 0x7f5a581f5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:16.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.627+0000 7f20bf400640 1 --2- 172.21.15.2:0/644192674 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f209c06be80 0x7f209c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:16.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.627+0000 7f20bea00640 1 --2- 172.21.15.2:0/644192674 >> [v2:172.21.15.2:6816/1270626884,v1:172.21.15.2:6817/1270626884] conn(0x7f209c075600 0x7f209c077a40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:16.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.627+0000 7f5a55e00640 1 -- 172.21.15.2:0/3570341487 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a580cbcf0 con 0x7f5a3c004160 2024-09-10T08:47:16.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.627+0000 7f5a56800640 1 --2- 172.21.15.2:0/3570341487 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5a5809e510 0x7f5a581f5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:47:16.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.627+0000 7ff41f400640 1 --2- 172.21.15.2:0/266963874 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7ff40806bf00 0x7ff40806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:16.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.627+0000 7ff41f400640 1 -- 172.21.15.2:0/266963874 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff41808ab50 con 0x7ff4280d2f90 2024-09-10T08:47:16.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.627+0000 7ff41f400640 1 --2- 172.21.15.2:0/266963874 >> [v2:172.21.15.2:6800/3992427579,v1:172.21.15.2:6801/3992427579] conn(0x7ff408075600 0x7ff408077a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:16.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.627+0000 7ff41f400640 1 -- 172.21.15.2:0/266963874 --> [v2:172.21.15.2:6800/3992427579,v1:172.21.15.2:6801/3992427579] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff41800ce50 con 0x7ff408075600 2024-09-10T08:47:16.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.628+0000 7f74de600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74bc004800 0x7f74d815a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:16.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.628+0000 7f20bf400640 1 --2- 172.21.15.2:0/644192674 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f209c06be80 0x7f209c06e340 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f20a8009630 tx=0x7f20a802e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:16.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.628+0000 7f74de600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74d8150af0 0x7f74d80b0f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:16.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.628+0000 7ff426a00640 1 --2- 172.21.15.2:0/266963874 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7ff40806bf00 0x7ff40806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:16.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.628+0000 7f74de600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74d80b1470 0x7f74d81585f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:16.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.628+0000 7ff41f400640 1 -- 172.21.15.2:0/266963874 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff418091050 con 0x7ff4280d2f90 2024-09-10T08:47:16.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.628+0000 7f5a55e00640 1 --2- 172.21.15.2:0/3570341487 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a3c004160 0x7f5a58161230 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5a5000f410 tx=0x7f5a5000f8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:16.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.628+0000 7f041a000640 1 --2- 172.21.15.2:0/3889523802 >> [v2:172.21.15.2:6808/1619566025,v1:172.21.15.2:6809/1619566025] conn(0x7f03f40755b0 0x7f03f40779f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:16.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.628+0000 7f0418c00640 1 --2- 172.21.15.2:0/3889523802 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f03f406be30 0x7f03f406e2f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0400034000 tx=0x7f040002e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:16.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.628+0000 7ff427e00640 1 --2- 172.21.15.2:0/266963874 >> [v2:172.21.15.2:6800/3992427579,v1:172.21.15.2:6801/3992427579] conn(0x7ff408075600 0x7ff408077a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:16.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.628+0000 7f5a4e000640 1 -- 172.21.15.2:0/3570341487 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a50019070 con 0x7f5a3c004160 2024-09-10T08:47:16.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.629+0000 7f74de600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f74d80b5170 con 0x7f74d80b1470 2024-09-10T08:47:16.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.629+0000 7f74de600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f74d80ae770 con 0x7f74d8150af0 2024-09-10T08:47:16.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.629+0000 7f74de600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f74d8166350 con 0x7f74bc004800 2024-09-10T08:47:16.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.629+0000 7ff426a00640 1 --2- 172.21.15.2:0/266963874 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7ff40806bf00 0x7ff40806e3c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff414006a90 tx=0x7ff414006a20 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:16.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.629+0000 7f041a000640 1 --2- 172.21.15.2:0/3889523802 >> [v2:172.21.15.2:6808/1619566025,v1:172.21.15.2:6809/1619566025] conn(0x7f03f40755b0 0x7f03f40779f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:16.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.629+0000 7f4bb2e00640 1 Processor -- start 2024-09-10T08:47:16.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.629+0000 7f20b7400640 1 -- 172.21.15.2:0/644192674 <== osd.3 v2:172.21.15.2:6816/1270626884 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f20b001ae50 con 0x7f209c075600 2024-09-10T08:47:16.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.629+0000 7f74d7400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74bc004800 0x7f74d815a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:16.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.629+0000 7f74d6a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74d8150af0 0x7f74d80b0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:16.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.629+0000 7f74d7400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74bc004800 0x7f74d815a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.2:40454/0 (socket says 172.21.15.2:40454) 2024-09-10T08:47:16.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.629+0000 7f74d7400640 1 -- 172.21.15.2:0/1062381335 learned_addr learned my addr 172.21.15.2:0/1062381335 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:16.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.629+0000 7f74d7400640 1 -- 172.21.15.2:0/1062381335 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74d8150af0 msgr2=0x7f74d80b0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:16.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.629+0000 7f74d7400640 1 --2- 172.21.15.2:0/1062381335 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74d8150af0 0x7f74d80b0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:16.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.629+0000 7f74d7400640 1 -- 172.21.15.2:0/1062381335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74d80b1470 msgr2=0x7f74d81585f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:47:16.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.630+0000 7f74d7e00640 1 --2- 172.21.15.2:0/1062381335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74d80b1470 0x7f74d81585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:16.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.630+0000 7f74d7400640 1 --2- 172.21.15.2:0/1062381335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f74d80b1470 0x7f74d81585f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:16.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.630+0000 7f74d7400640 1 -- 172.21.15.2:0/1062381335 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74d815a7f0 con 0x7f74bc004800 2024-09-10T08:47:16.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.630+0000 7f74d6a00640 1 --2- 172.21.15.2:0/1062381335 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74d8150af0 0x7f74d80b0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:47:16.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.630+0000 7f74d7400640 1 --2- 172.21.15.2:0/1062381335 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74bc004800 0x7f74d815a2b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f74c80109d0 tx=0x7f74c8010e90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:16.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.629+0000 7f5a4e000640 1 -- 172.21.15.2:0/3570341487 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a50003da0 con 0x7f5a3c004160 2024-09-10T08:47:16.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.629+0000 7f5a4e000640 1 -- 172.21.15.2:0/3570341487 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a50004250 con 0x7f5a3c004160 2024-09-10T08:47:16.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.630+0000 7f5a57200640 1 -- 172.21.15.2:0/3570341487 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a580cbfd0 con 0x7f5a3c004160 2024-09-10T08:47:16.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.630+0000 7f5a57200640 1 -- 172.21.15.2:0/3570341487 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a58160a30 con 0x7f5a3c004160 2024-09-10T08:47:16.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.627+0000 7fe8f2000640 1 -- 172.21.15.2:0/1390550023 wait complete. 2024-09-10T08:47:16.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.630+0000 7f4bb2e00640 1 -- start start 2024-09-10T08:47:16.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.631+0000 7fe8f2000640 1 Processor -- start 2024-09-10T08:47:16.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.631+0000 7f4bb2e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4bac06e570 0x7f4bac1fb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:16.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.631+0000 7f0411600640 1 -- 172.21.15.2:0/3889523802 <== osd.1 v2:172.21.15.2:6808/1619566025 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f03f40780c0 con 0x7f03f40755b0 2024-09-10T08:47:16.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.631+0000 7ff427e00640 1 --2- 172.21.15.2:0/266963874 >> [v2:172.21.15.2:6800/3992427579,v1:172.21.15.2:6801/3992427579] conn(0x7ff408075600 0x7ff408077a40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:16.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.631+0000 7f4bb2e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4bac0d2d30 0x7f4bac1607c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:16.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.631+0000 7f4bb2e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bac161ca0 0x7f4bac160d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:16.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.631+0000 7f4bb2e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4bac0cf8c0 con 0x7f4bac161ca0 2024-09-10T08:47:16.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.631+0000 7f74cf400640 1 -- 172.21.15.2:0/1062381335 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74c800f040 con 0x7f74bc004800 2024-09-10T08:47:16.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.631+0000 7f4bb2e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4bac06cdf0 con 0x7f4bac06e570 2024-09-10T08:47:16.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.631+0000 7f4bb2e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4bac0cfa40 con 0x7f4bac0d2d30 2024-09-10T08:47:16.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.632+0000 7f74cf400640 1 -- 172.21.15.2:0/1062381335 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74c800ec20 con 0x7f74bc004800 2024-09-10T08:47:16.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.632+0000 7f74de600640 1 -- 172.21.15.2:0/1062381335 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74d81572a0 con 0x7f74bc004800 2024-09-10T08:47:16.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.632+0000 7f5a57200640 1 -- 172.21.15.2:0/3570341487 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5a58160e10 con 0x7f5a3c004160 2024-09-10T08:47:16.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.632+0000 7f4bb0e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bac161ca0 0x7f4bac160d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:16.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.632+0000 7f4bb0e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bac161ca0 0x7f4bac160d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51016/0 (socket says 172.21.15.2:51016) 2024-09-10T08:47:16.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.632+0000 7f4bb0e00640 1 -- 172.21.15.2:0/1768864344 learned_addr learned my addr 172.21.15.2:0/1768864344 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:16.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.633+0000 7f4bb0e00640 1 -- 172.21.15.2:0/1768864344 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4bac0d2d30 msgr2=0x7f4bac1607c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T08:47:16.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.633+0000 7f4bb0e00640 1 --2- 172.21.15.2:0/1768864344 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4bac0d2d30 0x7f4bac1607c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:16.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.633+0000 7f4bb0e00640 1 -- 172.21.15.2:0/1768864344 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4bac06e570 msgr2=0x7f4bac1fb8a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-10T08:47:16.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.633+0000 7f4bb0e00640 1 --2- 172.21.15.2:0/1768864344 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4bac06e570 0x7f4bac1fb8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:16.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.633+0000 7f4bb0e00640 1 -- 172.21.15.2:0/1768864344 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bac0c88e0 con 0x7f4bac161ca0 2024-09-10T08:47:16.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.633+0000 7ff41f400640 1 -- 172.21.15.2:0/266963874 <== osd.2 v2:172.21.15.2:6800/3992427579 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff41800ce50 con 0x7ff408075600 2024-09-10T08:47:16.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.634+0000 7f4bb0e00640 1 --2- 172.21.15.2:0/1768864344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bac161ca0 0x7f4bac160d00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4b980097a0 tx=0x7f4b980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:16.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.634+0000 7f4ba3e00640 1 -- 172.21.15.2:0/1768864344 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b98041020 con 0x7f4bac161ca0 2024-09-10T08:47:16.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.634+0000 7f4bb2e00640 1 -- 172.21.15.2:0/1768864344 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bac0c8bc0 con 0x7f4bac161ca0 2024-09-10T08:47:16.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.634+0000 7f4bb2e00640 1 -- 172.21.15.2:0/1768864344 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bac0c9180 con 0x7f4bac161ca0 2024-09-10T08:47:16.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.634+0000 7f4ba3e00640 1 -- 172.21.15.2:0/1768864344 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b98032440 con 0x7f4bac161ca0 2024-09-10T08:47:16.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.634+0000 7f4ba3e00640 1 -- 172.21.15.2:0/1768864344 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b98041020 con 0x7f4bac161ca0 2024-09-10T08:47:16.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.632+0000 7f74de600640 1 -- 172.21.15.2:0/1062381335 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f74d8157860 con 0x7f74bc004800 2024-09-10T08:47:16.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.633+0000 7f74cf400640 1 -- 172.21.15.2:0/1062381335 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74c801c400 con 0x7f74bc004800 2024-09-10T08:47:16.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.635+0000 7f74de600640 1 -- 172.21.15.2:0/1062381335 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f74b0001030 con 0x7f74bc004800 2024-09-10T08:47:16.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.633+0000 7f5a4e000640 1 -- 172.21.15.2:0/3570341487 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5a5001c070 con 0x7f5a3c004160 2024-09-10T08:47:16.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.635+0000 7f5a4e000640 1 --2- 172.21.15.2:0/3570341487 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f5a3806be60 0x7f5a3806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:16.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.635+0000 7f5a4e000640 1 -- 172.21.15.2:0/3570341487 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f5a5008c0a0 con 0x7f5a3c004160 2024-09-10T08:47:16.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.635+0000 7f5a4e000640 1 --2- 172.21.15.2:0/3570341487 >> [v2:172.21.15.155:6803/553254873,v1:172.21.15.155:6806/553254873] conn(0x7f5a380754e0 0x7f5a38077920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:16.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.635+0000 7f5a4e000640 1 -- 172.21.15.2:0/3570341487 --> [v2:172.21.15.155:6803/553254873,v1:172.21.15.155:6806/553254873] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5a38077ff0 con 0x7f5a380754e0 2024-09-10T08:47:16.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.635+0000 7f5a4e000640 1 -- 172.21.15.2:0/3570341487 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f5a50093050 con 0x7f5a3c004160 2024-09-10T08:47:16.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.636+0000 7f4bb2e00640 1 -- 172.21.15.2:0/1768864344 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4b84001030 con 0x7f4bac161ca0 2024-09-10T08:47:16.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.632+0000 7fe8f2000640 1 -- start start 2024-09-10T08:47:16.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.633+0000 7fe8f2000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe8ec0d0950 0x7fe8ec1414c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:16.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.636+0000 7fe8f2000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8ec15b360 0x7fe8ec0b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:16.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.636+0000 7fe8f2000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8ec0b52b0 0x7fe8ec1489b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:16.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.636+0000 7fe8f2000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe8ec0b4900 con 0x7fe8ec15b360 2024-09-10T08:47:16.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.636+0000 7fe8f2000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe8ec0d20c0 con 0x7fe8ec0d0950 2024-09-10T08:47:16.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.636+0000 7fe8f2000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe8ec0b4a80 con 0x7fe8ec0b52b0 2024-09-10T08:47:16.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.637+0000 7fe8e2a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8ec15b360 0x7fe8ec0b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:16.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.637+0000 7fe8e2a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8ec15b360 0x7fe8ec0b4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51026/0 (socket says 172.21.15.2:51026) 2024-09-10T08:47:16.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.637+0000 7fe8e2a00640 1 -- 172.21.15.2:0/3534790778 learned_addr learned my addr 172.21.15.2:0/3534790778 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:16.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.637+0000 7f5a56800640 1 --2- 172.21.15.2:0/3570341487 >> [v2:172.21.15.155:6803/553254873,v1:172.21.15.155:6806/553254873] conn(0x7f5a380754e0 0x7f5a38077920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:16.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.638+0000 7f5a55400640 1 --2- 172.21.15.2:0/3570341487 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f5a3806be60 0x7f5a3806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:16.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.638+0000 7fe8eb400640 1 --2- 172.21.15.2:0/3534790778 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe8ec0d0950 0x7fe8ec1414c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:16.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.638+0000 7fe8ebe00640 1 --2- 172.21.15.2:0/3534790778 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8ec0b52b0 0x7fe8ec1489b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:16.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.638+0000 7fe8e2a00640 1 -- 172.21.15.2:0/3534790778 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8ec0b52b0 msgr2=0x7fe8ec1489b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:16.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.638+0000 7fe8e2a00640 1 --2- 172.21.15.2:0/3534790778 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8ec0b52b0 0x7fe8ec1489b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:16.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.638+0000 7fe8e2a00640 1 -- 172.21.15.2:0/3534790778 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe8ec0d0950 msgr2=0x7fe8ec1414c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:16.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.638+0000 7fe8e2a00640 1 --2- 172.21.15.2:0/3534790778 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe8ec0d0950 0x7fe8ec1414c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:16.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.638+0000 7fe8e2a00640 1 -- 172.21.15.2:0/3534790778 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8ec1495c0 con 0x7fe8ec15b360 2024-09-10T08:47:16.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.638+0000 7f74cf400640 1 -- 172.21.15.2:0/1062381335 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f74c801c5a0 con 0x7f74bc004800 2024-09-10T08:47:16.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.638+0000 7fe8ebe00640 1 --2- 172.21.15.2:0/3534790778 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8ec0b52b0 0x7fe8ec1489b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:47:16.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.638+0000 7f5a56800640 1 --2- 172.21.15.2:0/3570341487 >> [v2:172.21.15.155:6803/553254873,v1:172.21.15.155:6806/553254873] conn(0x7f5a380754e0 0x7f5a38077920 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:16.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.638+0000 7fe8e2a00640 1 --2- 172.21.15.2:0/3534790778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8ec15b360 0x7fe8ec0b4d70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc00ba80 tx=0x7fe8dc00bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:16.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.639+0000 7f5a55400640 1 --2- 172.21.15.2:0/3570341487 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f5a3806be60 0x7f5a3806e320 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5a48007fd0 tx=0x7f5a48009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:16.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.638+0000 7f4ba3e00640 1 -- 172.21.15.2:0/1768864344 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4b98044020 con 0x7f4bac161ca0 2024-09-10T08:47:16.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.639+0000 7fe8e3e00640 1 -- 172.21.15.2:0/3534790778 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8dc019070 con 0x7fe8ec15b360 2024-09-10T08:47:16.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.639+0000 7fe8e3e00640 1 -- 172.21.15.2:0/3534790778 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8dc00cc20 con 0x7fe8ec15b360 2024-09-10T08:47:16.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.639+0000 7fe8f2000640 1 -- 172.21.15.2:0/3534790778 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8ec1498a0 con 0x7fe8ec15b360 2024-09-10T08:47:16.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.639+0000 7fe8e3e00640 1 -- 172.21.15.2:0/3534790778 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8dc014440 con 0x7fe8ec15b360 2024-09-10T08:47:16.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.640+0000 7f4ba3e00640 1 --2- 172.21.15.2:0/1768864344 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f4b8c06c030 0x7f4b8c06e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:16.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.640+0000 7f5a4e000640 1 -- 172.21.15.2:0/3570341487 <== osd.4 v2:172.21.15.155:6803/553254873 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5a38077ff0 con 0x7f5a380754e0 2024-09-10T08:47:16.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.640+0000 7f4ba3e00640 1 -- 172.21.15.2:0/1768864344 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f4b980ab790 con 0x7f4bac161ca0 2024-09-10T08:47:16.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.640+0000 7f4ba3e00640 1 --2- 172.21.15.2:0/1768864344 >> [v2:172.21.15.155:6800/2220093913,v1:172.21.15.155:6801/2220093913] conn(0x7f4b8c075720 0x7f4b8c077b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:16.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.640+0000 7f4ba3e00640 1 -- 172.21.15.2:0/1768864344 --> [v2:172.21.15.155:6800/2220093913,v1:172.21.15.155:6801/2220093913] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4b9802be50 con 0x7f4b8c075720 2024-09-10T08:47:16.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.640+0000 7f4ba3e00640 1 -- 172.21.15.2:0/1768864344 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4b980b2050 con 0x7f4bac161ca0 2024-09-10T08:47:16.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.642+0000 7f3bb6400640 1 -- 172.21.15.2:0/3808242425 --> [v2:172.21.15.2:6820/298678486,v1:172.21.15.2:6822/298678486] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3bb00b3e70 con 0x7f3b90075680 2024-09-10T08:47:16.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.642+0000 7f4babe00640 1 --2- 172.21.15.2:0/1768864344 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f4b8c06c030 0x7f4b8c06e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:16.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.641+0000 7f74cf400640 1 --2- 172.21.15.2:0/1062381335 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f74b806bf00 0x7f74b806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:16.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.641+0000 7f74cf400640 1 -- 172.21.15.2:0/1062381335 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f74c808c520 con 0x7f74bc004800 2024-09-10T08:47:16.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.641+0000 7f74d6a00640 1 --2- 172.21.15.2:0/1062381335 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f74b806bf00 0x7f74b806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:16.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.641+0000 7f74cf400640 1 --2- 172.21.15.2:0/1062381335 >> [v2:172.21.15.155:6802/2107688472,v1:172.21.15.155:6805/2107688472] conn(0x7f74b8075680 0x7f74b8077ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:16.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.641+0000 7f74cf400640 1 -- 172.21.15.2:0/1062381335 --> [v2:172.21.15.155:6802/2107688472,v1:172.21.15.155:6805/2107688472] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f74b8078190 con 0x7f74b8075680 2024-09-10T08:47:16.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.641+0000 7f74cf400640 1 -- 172.21.15.2:0/1062381335 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f74c808c910 con 0x7f74bc004800 2024-09-10T08:47:16.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.642+0000 7f3bacc00640 1 -- 172.21.15.2:0/3808242425 <== osd.0 v2:172.21.15.2:6820/298678486 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3bb00b3e70 con 0x7f3b90075680 2024-09-10T08:47:16.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.642+0000 7f74d7e00640 1 --2- 172.21.15.2:0/1062381335 >> [v2:172.21.15.155:6802/2107688472,v1:172.21.15.155:6805/2107688472] conn(0x7f74b8075680 0x7f74b8077ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:16.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.643+0000 7f4babe00640 1 --2- 172.21.15.2:0/1768864344 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f4b8c06c030 0x7f4b8c06e4f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4ba4001560 tx=0x7f4ba4007c30 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:16.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.643+0000 7f74d7e00640 1 --2- 172.21.15.2:0/1062381335 >> [v2:172.21.15.155:6802/2107688472,v1:172.21.15.155:6805/2107688472] conn(0x7f74b8075680 0x7f74b8077ac0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:16.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.643+0000 7f3bb6400640 1 -- 172.21.15.2:0/3808242425 >> [v2:172.21.15.2:6820/298678486,v1:172.21.15.2:6822/298678486] conn(0x7f3b90075680 msgr2=0x7f3b90077ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:16.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.643+0000 7f3bb6400640 1 --2- 172.21.15.2:0/3808242425 >> [v2:172.21.15.2:6820/298678486,v1:172.21.15.2:6822/298678486] conn(0x7f3b90075680 0x7f3b90077ac0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:16.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.643+0000 7f3bb6400640 1 -- 172.21.15.2:0/3808242425 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f3b9006bf00 msgr2=0x7f3b9006e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:16.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.643+0000 7f3bb6400640 1 --2- 172.21.15.2:0/3808242425 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f3b9006bf00 0x7f3b9006e3c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3bb00cd120 tx=0x7f3ba4008040 comp rx=0 tx=0).stop 2024-09-10T08:47:16.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.644+0000 7f3bb6400640 1 -- 172.21.15.2:0/3808242425 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3bb008ba20 msgr2=0x7f3bb0161540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:16.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.644+0000 7f3bb6400640 1 --2- 172.21.15.2:0/3808242425 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3bb008ba20 0x7f3bb0161540 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c0090b0 tx=0x7f3b9c0046c0 comp rx=0 tx=0).stop 2024-09-10T08:47:16.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.644+0000 7f74d6a00640 1 --2- 172.21.15.2:0/1062381335 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f74b806bf00 0x7f74b806e3c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f74c4033000 tx=0x7f74c4009030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:16.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.644+0000 7f3bb5a00640 1 -- 172.21.15.2:0/3808242425 reap_dead start 2024-09-10T08:47:16.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.642+0000 7fe8f2000640 1 -- 172.21.15.2:0/3534790778 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8ec141a00 con 0x7fe8ec15b360 2024-09-10T08:47:16.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.644+0000 7f3bb6400640 1 -- 172.21.15.2:0/3808242425 shutdown_connections 2024-09-10T08:47:16.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.644+0000 7f3bb6400640 1 -- 172.21.15.2:0/3808242425 >> 172.21.15.2:0/3808242425 conn(0x7f3bb006bdf0 msgr2=0x7f3bb015fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:16.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.643+0000 7fe8f2000640 1 -- 172.21.15.2:0/3534790778 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe8ec0b43c0 con 0x7fe8ec15b360 2024-09-10T08:47:16.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.644+0000 7fe8e3e00640 1 -- 172.21.15.2:0/3534790778 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe8dc01c070 con 0x7fe8ec15b360 2024-09-10T08:47:16.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.644+0000 7f4bab400640 1 --2- 172.21.15.2:0/1768864344 >> [v2:172.21.15.155:6800/2220093913,v1:172.21.15.155:6801/2220093913] conn(0x7f4b8c075720 0x7f4b8c077b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:16.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.645+0000 7f74cf400640 1 -- 172.21.15.2:0/1062381335 <== osd.5 v2:172.21.15.155:6802/2107688472 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f74b8078190 con 0x7f74b8075680 2024-09-10T08:47:16.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.645+0000 7f3bb6400640 1 -- 172.21.15.2:0/3808242425 shutdown_connections 2024-09-10T08:47:16.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.645+0000 7f3bb6400640 1 -- 172.21.15.2:0/3808242425 wait complete. 2024-09-10T08:47:16.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.645+0000 7fe8e3e00640 1 --2- 172.21.15.2:0/3534790778 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fe8c806beb0 0x7fe8c806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:16.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.645+0000 7fe8e3e00640 1 -- 172.21.15.2:0/3534790778 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe8dc08ad00 con 0x7fe8ec15b360 2024-09-10T08:47:16.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.646+0000 7fe8e3e00640 1 --2- 172.21.15.2:0/3534790778 >> [v2:172.21.15.155:6824/944542383,v1:172.21.15.155:6825/944542383] conn(0x7fe8c8075630 0x7fe8c8077a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:16.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.646+0000 7fe8e3e00640 1 -- 172.21.15.2:0/3534790778 --> [v2:172.21.15.155:6824/944542383,v1:172.21.15.155:6825/944542383] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe8c8078140 con 0x7fe8c8075630 2024-09-10T08:47:16.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.646+0000 7fe8e3e00640 1 -- 172.21.15.2:0/3534790778 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe8dc08b0c0 con 0x7fe8ec15b360 2024-09-10T08:47:16.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.646+0000 7fe8eb400640 1 --2- 172.21.15.2:0/3534790778 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fe8c806beb0 0x7fe8c806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:16.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.646+0000 7fe8ebe00640 1 --2- 172.21.15.2:0/3534790778 >> [v2:172.21.15.155:6824/944542383,v1:172.21.15.155:6825/944542383] conn(0x7fe8c8075630 0x7fe8c8077a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:16.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.647+0000 7fe8eb400640 1 --2- 172.21.15.2:0/3534790778 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fe8c806beb0 0x7fe8c806e370 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe8d4001eb0 tx=0x7fe8d4000ed0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:16.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.647+0000 7f4bab400640 1 --2- 172.21.15.2:0/1768864344 >> [v2:172.21.15.155:6800/2220093913,v1:172.21.15.155:6801/2220093913] conn(0x7f4b8c075720 0x7f4b8c077b60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:16.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.648+0000 7fe8ebe00640 1 --2- 172.21.15.2:0/3534790778 >> [v2:172.21.15.155:6824/944542383,v1:172.21.15.155:6825/944542383] conn(0x7fe8c8075630 0x7fe8c8077a70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:16.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.648+0000 7f4ba3e00640 1 -- 172.21.15.2:0/1768864344 <== osd.7 v2:172.21.15.155:6800/2220093913 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4b9802be50 con 0x7f4b8c075720 2024-09-10T08:47:16.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.653+0000 7fe8e3e00640 1 -- 172.21.15.2:0/3534790778 <== osd.6 v2:172.21.15.155:6824/944542383 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe8c8078140 con 0x7fe8c8075630 2024-09-10T08:47:16.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.655+0000 7f041c000640 1 -- 172.21.15.2:0/3889523802 --> [v2:172.21.15.2:6808/1619566025,v1:172.21.15.2:6809/1619566025] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f04140cf1b0 con 0x7f03f40755b0 2024-09-10T08:47:16.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.657+0000 7f20c6200640 1 -- 172.21.15.2:0/644192674 --> [v2:172.21.15.2:6816/1270626884,v1:172.21.15.2:6817/1270626884] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f20c015f440 con 0x7f209c075600 2024-09-10T08:47:16.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.657+0000 7f0411600640 1 -- 172.21.15.2:0/3889523802 <== osd.1 v2:172.21.15.2:6808/1619566025 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f04140cf1b0 con 0x7f03f40755b0 2024-09-10T08:47:16.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.657+0000 7f20b7400640 1 -- 172.21.15.2:0/644192674 <== osd.3 v2:172.21.15.2:6816/1270626884 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f20c015f440 con 0x7f209c075600 2024-09-10T08:47:16.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.657+0000 7f041c000640 1 -- 172.21.15.2:0/3889523802 >> [v2:172.21.15.2:6808/1619566025,v1:172.21.15.2:6809/1619566025] conn(0x7f03f40755b0 msgr2=0x7f03f40779f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:16.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.657+0000 7f041c000640 1 --2- 172.21.15.2:0/3889523802 >> [v2:172.21.15.2:6808/1619566025,v1:172.21.15.2:6809/1619566025] conn(0x7f03f40755b0 0x7f03f40779f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:16.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.658+0000 7f041c000640 1 -- 172.21.15.2:0/3889523802 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f03f406be30 msgr2=0x7f03f406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:16.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.658+0000 7f041c000640 1 --2- 172.21.15.2:0/3889523802 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f03f406be30 0x7f03f406e2f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0400034000 tx=0x7f040002e000 comp rx=0 tx=0).stop 2024-09-10T08:47:16.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.658+0000 7f041c000640 1 -- 172.21.15.2:0/3889523802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04140cf6f0 msgr2=0x7f0414152990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:16.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.658+0000 7f041c000640 1 --2- 172.21.15.2:0/3889523802 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04140cf6f0 0x7f0414152990 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f040800d800 tx=0x7f040800dcc0 comp rx=0 tx=0).stop 2024-09-10T08:47:16.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.658+0000 7f041a000640 1 -- 172.21.15.2:0/3889523802 reap_dead start 2024-09-10T08:47:16.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.658+0000 7f041c000640 1 -- 172.21.15.2:0/3889523802 shutdown_connections 2024-09-10T08:47:16.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.658+0000 7f041c000640 1 -- 172.21.15.2:0/3889523802 >> 172.21.15.2:0/3889523802 conn(0x7f041408bfd0 msgr2=0x7f04140b5750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:16.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.659+0000 7f041c000640 1 -- 172.21.15.2:0/3889523802 shutdown_connections 2024-09-10T08:47:16.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.659+0000 7f20c6200640 1 -- 172.21.15.2:0/644192674 >> [v2:172.21.15.2:6816/1270626884,v1:172.21.15.2:6817/1270626884] conn(0x7f209c075600 msgr2=0x7f209c077a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:16.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.659+0000 7f20c6200640 1 --2- 172.21.15.2:0/644192674 >> [v2:172.21.15.2:6816/1270626884,v1:172.21.15.2:6817/1270626884] conn(0x7f209c075600 0x7f209c077a40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:16.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.659+0000 7f041c000640 1 -- 172.21.15.2:0/3889523802 wait complete. 2024-09-10T08:47:16.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.659+0000 7f20c6200640 1 -- 172.21.15.2:0/644192674 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f209c06be80 msgr2=0x7f209c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:16.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.659+0000 7f20c6200640 1 --2- 172.21.15.2:0/644192674 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f209c06be80 0x7f209c06e340 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f20a8009630 tx=0x7f20a802e000 comp rx=0 tx=0).stop 2024-09-10T08:47:16.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.659+0000 7f20c6200640 1 -- 172.21.15.2:0/644192674 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f20c00ce1c0 msgr2=0x7f20c0159450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:16.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.659+0000 7f20c6200640 1 --2- 172.21.15.2:0/644192674 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f20c00ce1c0 0x7f20c0159450 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f20b000cc80 tx=0x7f20b000a5c0 comp rx=0 tx=0).stop 2024-09-10T08:47:16.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.659+0000 7f20bfe00640 1 -- 172.21.15.2:0/644192674 reap_dead start 2024-09-10T08:47:16.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.660+0000 7f20c6200640 1 -- 172.21.15.2:0/644192674 shutdown_connections 2024-09-10T08:47:16.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.660+0000 7f20c6200640 1 -- 172.21.15.2:0/644192674 >> 172.21.15.2:0/644192674 conn(0x7f20c00d02c0 msgr2=0x7f20c00ce650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:16.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.660+0000 7f20c6200640 1 -- 172.21.15.2:0/644192674 shutdown_connections 2024-09-10T08:47:16.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.660+0000 7f20c6200640 1 -- 172.21.15.2:0/644192674 wait complete. 2024-09-10T08:47:16.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.668+0000 7f5a57200640 1 -- 172.21.15.2:0/3570341487 --> [v2:172.21.15.155:6803/553254873,v1:172.21.15.155:6806/553254873] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5a580d5270 con 0x7f5a380754e0 2024-09-10T08:47:16.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.669+0000 7f5a4e000640 1 -- 172.21.15.2:0/3570341487 <== osd.4 v2:172.21.15.155:6803/553254873 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5a580d5270 con 0x7f5a380754e0 2024-09-10T08:47:16.705 INFO:teuthology.orchestra.run.smithi002.stdout:55834574857 2024-09-10T08:47:16.706 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-10T08:47:16.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.670+0000 7f5a57200640 1 -- 172.21.15.2:0/3570341487 >> [v2:172.21.15.155:6803/553254873,v1:172.21.15.155:6806/553254873] conn(0x7f5a380754e0 msgr2=0x7f5a38077920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:16.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.670+0000 7f5a57200640 1 --2- 172.21.15.2:0/3570341487 >> [v2:172.21.15.155:6803/553254873,v1:172.21.15.155:6806/553254873] conn(0x7f5a380754e0 0x7f5a38077920 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:16.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.671+0000 7f5a57200640 1 -- 172.21.15.2:0/3570341487 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f5a3806be60 msgr2=0x7f5a3806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:16.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.671+0000 7f5a57200640 1 --2- 172.21.15.2:0/3570341487 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f5a3806be60 0x7f5a3806e320 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5a48007fd0 tx=0x7f5a48009040 comp rx=0 tx=0).stop 2024-09-10T08:47:16.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.671+0000 7f5a57200640 1 -- 172.21.15.2:0/3570341487 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a3c004160 msgr2=0x7f5a58161230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:16.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.671+0000 7f5a57200640 1 --2- 172.21.15.2:0/3570341487 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a3c004160 0x7f5a58161230 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5a5000f410 tx=0x7f5a5000f8d0 comp rx=0 tx=0).stop 2024-09-10T08:47:16.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.671+0000 7f5a56800640 1 -- 172.21.15.2:0/3570341487 reap_dead start 2024-09-10T08:47:16.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.671+0000 7f5a57200640 1 -- 172.21.15.2:0/3570341487 shutdown_connections 2024-09-10T08:47:16.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.671+0000 7f5a57200640 1 -- 172.21.15.2:0/3570341487 >> 172.21.15.2:0/3570341487 conn(0x7f5a5809d720 msgr2=0x7f5a580b46a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:16.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.672+0000 7f5a57200640 1 -- 172.21.15.2:0/3570341487 shutdown_connections 2024-09-10T08:47:16.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.672+0000 7f5a57200640 1 -- 172.21.15.2:0/3570341487 wait complete. 2024-09-10T08:47:16.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.674+0000 7ff42cc00640 1 -- 172.21.15.2:0/266963874 --> [v2:172.21.15.2:6800/3992427579,v1:172.21.15.2:6801/3992427579] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff4280d44c0 con 0x7ff408075600 2024-09-10T08:47:16.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.675+0000 7ff41f400640 1 -- 172.21.15.2:0/266963874 <== osd.2 v2:172.21.15.2:6800/3992427579 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff4280d44c0 con 0x7ff408075600 2024-09-10T08:47:16.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.676+0000 7ff42cc00640 1 -- 172.21.15.2:0/266963874 >> [v2:172.21.15.2:6800/3992427579,v1:172.21.15.2:6801/3992427579] conn(0x7ff408075600 msgr2=0x7ff408077a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:16.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.676+0000 7ff42cc00640 1 --2- 172.21.15.2:0/266963874 >> [v2:172.21.15.2:6800/3992427579,v1:172.21.15.2:6801/3992427579] conn(0x7ff408075600 0x7ff408077a40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:16.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.676+0000 7ff42cc00640 1 -- 172.21.15.2:0/266963874 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7ff40806bf00 msgr2=0x7ff40806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:16.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.676+0000 7ff42cc00640 1 --2- 172.21.15.2:0/266963874 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7ff40806bf00 0x7ff40806e3c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff414006a90 tx=0x7ff414006a20 comp rx=0 tx=0).stop 2024-09-10T08:47:16.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.676+0000 7ff42cc00640 1 -- 172.21.15.2:0/266963874 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4280d2f90 msgr2=0x7ff4280b9c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:16.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.676+0000 7ff42cc00640 1 --2- 172.21.15.2:0/266963874 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4280d2f90 0x7ff4280b9c70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff41800b410 tx=0x7ff41800b8d0 comp rx=0 tx=0).stop 2024-09-10T08:47:16.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.676+0000 7ff427e00640 1 -- 172.21.15.2:0/266963874 reap_dead start 2024-09-10T08:47:16.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.677+0000 7ff42cc00640 1 -- 172.21.15.2:0/266963874 shutdown_connections 2024-09-10T08:47:16.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.677+0000 7ff42cc00640 1 -- 172.21.15.2:0/266963874 >> 172.21.15.2:0/266963874 conn(0x7ff42808bfd0 msgr2=0x7ff4280b5080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:16.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.677+0000 7ff42cc00640 1 -- 172.21.15.2:0/266963874 shutdown_connections 2024-09-10T08:47:16.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.677+0000 7ff42cc00640 1 -- 172.21.15.2:0/266963874 wait complete. 2024-09-10T08:47:16.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.677+0000 7fe8f2000640 1 -- 172.21.15.2:0/3534790778 --> [v2:172.21.15.155:6824/944542383,v1:172.21.15.155:6825/944542383] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe8ec0b56c0 con 0x7fe8c8075630 2024-09-10T08:47:16.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.677+0000 7f74de600640 1 -- 172.21.15.2:0/1062381335 --> [v2:172.21.15.155:6802/2107688472,v1:172.21.15.155:6805/2107688472] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f74b0002dd0 con 0x7f74b8075680 2024-09-10T08:47:16.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.678+0000 7fe8e3e00640 1 -- 172.21.15.2:0/3534790778 <== osd.6 v2:172.21.15.155:6824/944542383 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe8ec0b56c0 con 0x7fe8c8075630 2024-09-10T08:47:16.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.678+0000 7f74cf400640 1 -- 172.21.15.2:0/1062381335 <== osd.5 v2:172.21.15.155:6802/2107688472 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f74b0002dd0 con 0x7f74b8075680 2024-09-10T08:47:16.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.679+0000 7fe8f2000640 1 -- 172.21.15.2:0/3534790778 >> [v2:172.21.15.155:6824/944542383,v1:172.21.15.155:6825/944542383] conn(0x7fe8c8075630 msgr2=0x7fe8c8077a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:16.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.679+0000 7f74de600640 1 -- 172.21.15.2:0/1062381335 >> [v2:172.21.15.155:6802/2107688472,v1:172.21.15.155:6805/2107688472] conn(0x7f74b8075680 msgr2=0x7f74b8077ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:16.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.679+0000 7f74de600640 1 --2- 172.21.15.2:0/1062381335 >> [v2:172.21.15.155:6802/2107688472,v1:172.21.15.155:6805/2107688472] conn(0x7f74b8075680 0x7f74b8077ac0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:16.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.679+0000 7fe8f2000640 1 --2- 172.21.15.2:0/3534790778 >> [v2:172.21.15.155:6824/944542383,v1:172.21.15.155:6825/944542383] conn(0x7fe8c8075630 0x7fe8c8077a70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:16.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.679+0000 7f74de600640 1 -- 172.21.15.2:0/1062381335 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f74b806bf00 msgr2=0x7f74b806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:16.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.679+0000 7f74de600640 1 --2- 172.21.15.2:0/1062381335 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f74b806bf00 0x7f74b806e3c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f74c4033000 tx=0x7f74c4009030 comp rx=0 tx=0).stop 2024-09-10T08:47:16.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.679+0000 7f74de600640 1 -- 172.21.15.2:0/1062381335 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74bc004800 msgr2=0x7f74d815a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:16.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.679+0000 7f74de600640 1 --2- 172.21.15.2:0/1062381335 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74bc004800 0x7f74d815a2b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f74c80109d0 tx=0x7f74c8010e90 comp rx=0 tx=0).stop 2024-09-10T08:47:16.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.679+0000 7fe8f2000640 1 -- 172.21.15.2:0/3534790778 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fe8c806beb0 msgr2=0x7fe8c806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:16.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.679+0000 7fe8f2000640 1 --2- 172.21.15.2:0/3534790778 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fe8c806beb0 0x7fe8c806e370 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe8d4001eb0 tx=0x7fe8d4000ed0 comp rx=0 tx=0).stop 2024-09-10T08:47:16.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.679+0000 7fe8f2000640 1 -- 172.21.15.2:0/3534790778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8ec15b360 msgr2=0x7fe8ec0b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:16.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.679+0000 7fe8f2000640 1 --2- 172.21.15.2:0/3534790778 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe8ec15b360 0x7fe8ec0b4d70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc00ba80 tx=0x7fe8dc00bf40 comp rx=0 tx=0).stop 2024-09-10T08:47:16.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.679+0000 7fe8ebe00640 1 -- 172.21.15.2:0/3534790778 reap_dead start 2024-09-10T08:47:16.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.680+0000 7fe8f2000640 1 -- 172.21.15.2:0/3534790778 shutdown_connections 2024-09-10T08:47:16.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.679+0000 7f74d7e00640 1 -- 172.21.15.2:0/1062381335 reap_dead start 2024-09-10T08:47:16.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.679+0000 7f74de600640 1 -- 172.21.15.2:0/1062381335 shutdown_connections 2024-09-10T08:47:16.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.679+0000 7f74de600640 1 -- 172.21.15.2:0/1062381335 >> 172.21.15.2:0/1062381335 conn(0x7f74d80d02c0 msgr2=0x7f74d8164c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:16.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.680+0000 7fe8f2000640 1 -- 172.21.15.2:0/3534790778 >> 172.21.15.2:0/3534790778 conn(0x7fe8ec0b68e0 msgr2=0x7fe8ec157c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:16.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.680+0000 7f74de600640 1 -- 172.21.15.2:0/1062381335 shutdown_connections 2024-09-10T08:47:16.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.680+0000 7fe8f2000640 1 -- 172.21.15.2:0/3534790778 shutdown_connections 2024-09-10T08:47:16.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.681+0000 7f74de600640 1 -- 172.21.15.2:0/1062381335 wait complete. 2024-09-10T08:47:16.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.681+0000 7fe8f2000640 1 -- 172.21.15.2:0/3534790778 wait complete. 2024-09-10T08:47:16.716 INFO:teuthology.orchestra.run.smithi002.stdout:55834574857 2024-09-10T08:47:16.716 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-10T08:47:16.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.685+0000 7f4bb2e00640 1 -- 172.21.15.2:0/1768864344 --> [v2:172.21.15.155:6800/2220093913,v1:172.21.15.155:6801/2220093913] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4b84002dd0 con 0x7f4b8c075720 2024-09-10T08:47:16.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.686+0000 7f4ba3e00640 1 -- 172.21.15.2:0/1768864344 <== osd.7 v2:172.21.15.155:6800/2220093913 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4b84002dd0 con 0x7f4b8c075720 2024-09-10T08:47:16.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.687+0000 7f4bb2e00640 1 -- 172.21.15.2:0/1768864344 >> [v2:172.21.15.155:6800/2220093913,v1:172.21.15.155:6801/2220093913] conn(0x7f4b8c075720 msgr2=0x7f4b8c077b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:16.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.687+0000 7f4bb2e00640 1 --2- 172.21.15.2:0/1768864344 >> [v2:172.21.15.155:6800/2220093913,v1:172.21.15.155:6801/2220093913] conn(0x7f4b8c075720 0x7f4b8c077b60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:16.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.687+0000 7f4bb2e00640 1 -- 172.21.15.2:0/1768864344 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f4b8c06c030 msgr2=0x7f4b8c06e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:16.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.687+0000 7f4bb2e00640 1 --2- 172.21.15.2:0/1768864344 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f4b8c06c030 0x7f4b8c06e4f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4ba4001560 tx=0x7f4ba4007c30 comp rx=0 tx=0).stop 2024-09-10T08:47:16.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.687+0000 7f4bb2e00640 1 -- 172.21.15.2:0/1768864344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bac161ca0 msgr2=0x7f4bac160d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:16.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.687+0000 7f4bb2e00640 1 --2- 172.21.15.2:0/1768864344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bac161ca0 0x7f4bac160d00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4b980097a0 tx=0x7f4b980046c0 comp rx=0 tx=0).stop 2024-09-10T08:47:16.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.687+0000 7f4bb0e00640 1 -- 172.21.15.2:0/1768864344 reap_dead start 2024-09-10T08:47:16.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.687+0000 7f4bb2e00640 1 -- 172.21.15.2:0/1768864344 shutdown_connections 2024-09-10T08:47:16.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.688+0000 7f4bb2e00640 1 -- 172.21.15.2:0/1768864344 >> 172.21.15.2:0/1768864344 conn(0x7f4bac08bfd0 msgr2=0x7f4bac0d0910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:16.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.688+0000 7f4bb2e00640 1 -- 172.21.15.2:0/1768864344 shutdown_connections 2024-09-10T08:47:16.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:16.688+0000 7f4bb2e00640 1 -- 172.21.15.2:0/1768864344 wait complete. 2024-09-10T08:47:16.719 INFO:teuthology.orchestra.run.smithi002.stdout:55834574857 2024-09-10T08:47:16.719 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-10T08:47:16.720 INFO:teuthology.orchestra.run.smithi002.stdout:55834574857 2024-09-10T08:47:16.720 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-10T08:47:16.721 INFO:teuthology.orchestra.run.smithi002.stdout:55834574858 2024-09-10T08:47:16.721 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-10T08:47:16.722 INFO:teuthology.orchestra.run.smithi002.stdout:55834574857 2024-09-10T08:47:16.722 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-10T08:47:16.723 INFO:teuthology.orchestra.run.smithi002.stdout:55834574858 2024-09-10T08:47:16.723 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-10T08:47:16.724 INFO:teuthology.orchestra.run.smithi002.stdout:55834574857 2024-09-10T08:47:16.724 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-10T08:47:17.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.033+0000 7f343a200640 1 Processor -- start 2024-09-10T08:47:17.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.034+0000 7f343a200640 1 -- start start 2024-09-10T08:47:17.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.034+0000 7f2ad6800640 1 Processor -- start 2024-09-10T08:47:17.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.034+0000 7f2ad6800640 1 -- start start 2024-09-10T08:47:17.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.036+0000 7f343a200640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f343415e360 0x7f3434073950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:17.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.036+0000 7f343a200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34340b2f50 0x7f34340b3390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:17.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.036+0000 7f343a200640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f343415e740 con 0x7f34340b38d0 2024-09-10T08:47:17.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.036+0000 7f343a200640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f34340736e0 con 0x7f343415e360 2024-09-10T08:47:17.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.036+0000 7f343a200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f34340b3d40 con 0x7f34340b2f50 2024-09-10T08:47:17.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.036+0000 7f3439800640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f34340b38d0 0x7f3434161ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.2:44190/0 (socket says 172.21.15.2:44190) 2024-09-10T08:47:17.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.036+0000 7f3439800640 1 -- 172.21.15.2:0/2563515582 learned_addr learned my addr 172.21.15.2:0/2563515582 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:47:17.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.036+0000 7f3438e00640 1 --2- 172.21.15.2:0/2563515582 >> v2:172.21.15.155:3300/0 conn(0x7f343415e360 0x7f3434073950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:17.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.037+0000 7f3433400640 1 -- 172.21.15.2:0/2563515582 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2503870630 0 0) 0x7f343415e740 con 0x7f34340b38d0 2024-09-10T08:47:17.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.037+0000 7f3433400640 1 -- 172.21.15.2:0/2563515582 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3418003520 con 0x7f34340b38d0 2024-09-10T08:47:17.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.037+0000 7f3438e00640 1 -- 172.21.15.2:0/2563515582 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34340b2f50 msgr2=0x7f34340b3390 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T08:47:17.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.037+0000 7f3438e00640 1 --2- 172.21.15.2:0/2563515582 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34340b2f50 0x7f34340b3390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.037+0000 7f3438e00640 1 -- 172.21.15.2:0/2563515582 >> v1:172.21.15.155:6789/0 conn(0x7f34340b38d0 legacy=0x7f3434161ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:17.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.037+0000 7f3438e00640 1 -- 172.21.15.2:0/2563515582 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3434072790 con 0x7f343415e360 2024-09-10T08:47:17.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.038+0000 7f2ad6800640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2ac801dc40 0x7f2ac8053f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:17.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.038+0000 7f2ad6800640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ac8052330 con 0x7f2ac80e7120 2024-09-10T08:47:17.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.038+0000 7f2ad6800640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ac8006cd0 con 0x7f2ac8005ab0 2024-09-10T08:47:17.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.038+0000 7f2ad5400640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f2ac8005ab0 0x7f2ac8005e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.2:44194/0 (socket says 172.21.15.2:44194) 2024-09-10T08:47:17.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.038+0000 7f2ad5400640 1 -- 172.21.15.2:0/1453632029 learned_addr learned my addr 172.21.15.2:0/1453632029 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:47:17.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.038+0000 7f96cb000640 1 Processor -- start 2024-09-10T08:47:17.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.039+0000 7f2ad6800640 1 -- 172.21.15.2:0/1453632029 --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f2ac80520e0 con 0x7f2ac801dc40 2024-09-10T08:47:17.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.039+0000 7f3438e00640 1 --2- 172.21.15.2:0/2563515582 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f343415e360 0x7f3434073950 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f34200097a0 tx=0x7f342002a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e900bda93b480efd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:17.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.039+0000 7f2ad5e00640 1 --2- 172.21.15.2:0/1453632029 >> v2:172.21.15.155:3300/0 conn(0x7f2ac801dc40 0x7f2ac8053f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:17.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.039+0000 7f96cb000640 1 -- start start 2024-09-10T08:47:17.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.039+0000 7f2acfe00640 1 -- 172.21.15.2:0/1453632029 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2267114853 0 0) 0x7f2ac8006cd0 con 0x7f2ac8005ab0 2024-09-10T08:47:17.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.040+0000 7f2acfe00640 1 -- 172.21.15.2:0/1453632029 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ab8003520 con 0x7f2ac8005ab0 2024-09-10T08:47:17.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.040+0000 7f3433400640 1 -- 172.21.15.2:0/2563515582 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3420037070 con 0x7f343415e360 2024-09-10T08:47:17.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.040+0000 7f2ad5e00640 1 -- 172.21.15.2:0/1453632029 >> v1:172.21.15.155:6789/0 conn(0x7f2ac8005ab0 legacy=0x7f2ac8005e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:17.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.040+0000 7f2ad5e00640 1 -- 172.21.15.2:0/1453632029 >> v1:172.21.15.2:6789/0 conn(0x7f2ac80e7120 legacy=0x7f2ac801d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:17.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.040+0000 7f2ad5e00640 1 -- 172.21.15.2:0/1453632029 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ac8006fb0 con 0x7f2ac801dc40 2024-09-10T08:47:17.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.040+0000 7f3433400640 1 -- 172.21.15.2:0/2563515582 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3420032440 con 0x7f343415e360 2024-09-10T08:47:17.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.040+0000 7f3433400640 1 -- 172.21.15.2:0/2563515582 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f342002ae60 con 0x7f343415e360 2024-09-10T08:47:17.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.041+0000 7f343a200640 1 -- 172.21.15.2:0/2563515582 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f343415e360 msgr2=0x7f3434073950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:17.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.041+0000 7f343a200640 1 --2- 172.21.15.2:0/2563515582 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f343415e360 0x7f3434073950 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f34200097a0 tx=0x7f342002a110 comp rx=0 tx=0).stop 2024-09-10T08:47:17.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.041+0000 7f343a200640 1 -- 172.21.15.2:0/2563515582 shutdown_connections 2024-09-10T08:47:17.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.041+0000 7f343a200640 1 --2- 172.21.15.2:0/2563515582 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34340b2f50 0x7f34340b3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.041+0000 7f343a200640 1 --2- 172.21.15.2:0/2563515582 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f343415e360 0x7f3434073950 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.041+0000 7f343a200640 1 -- 172.21.15.2:0/2563515582 >> 172.21.15.2:0/2563515582 conn(0x7f343406bdf0 msgr2=0x7f343406c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:17.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.041+0000 7f96cb000640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f96bc0e0a30 0x7f96bc0553e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:17.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.041+0000 7f96cb000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f96bc053840 0x7f96bc0523f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:17.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.041+0000 7f96cb000640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96bc055920 con 0x7f96bc051f80 2024-09-10T08:47:17.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.041+0000 7f96cb000640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f96bc054380 con 0x7f96bc053840 2024-09-10T08:47:17.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.041+0000 7f96cb000640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f96bc054620 con 0x7f96bc0e0a30 2024-09-10T08:47:17.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.041+0000 7f343a200640 1 -- 172.21.15.2:0/2563515582 shutdown_connections 2024-09-10T08:47:17.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.042+0000 7f343a200640 1 -- 172.21.15.2:0/2563515582 wait complete. 2024-09-10T08:47:17.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.042+0000 7f96c3400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f96bc051f80 0x7f96bc053130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48404/0 (socket says 172.21.15.2:48404) 2024-09-10T08:47:17.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.042+0000 7f96c3400640 1 -- 172.21.15.2:0/3370699770 learned_addr learned my addr 172.21.15.2:0/3370699770 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:47:17.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.042+0000 7f96c9000640 1 --2- 172.21.15.2:0/3370699770 >> v2:172.21.15.2:3300/0 conn(0x7f96bc053840 0x7f96bc0523f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:17.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.042+0000 7f2ad5e00640 1 --2- 172.21.15.2:0/1453632029 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ac801dc40 0x7f2ac8053f50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2abc0097a0 tx=0x7f2abc02a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42e51f0d95202d9e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:17.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.042+0000 7f96c9000640 1 -- 172.21.15.2:0/3370699770 >> v2:172.21.15.155:3300/0 conn(0x7f96bc0e0a30 msgr2=0x7f96bc0553e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:17.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.042+0000 7f96c9000640 1 --2- 172.21.15.2:0/3370699770 >> v2:172.21.15.155:3300/0 conn(0x7f96bc0e0a30 0x7f96bc0553e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.042+0000 7f96c9000640 1 -- 172.21.15.2:0/3370699770 >> v1:172.21.15.2:6789/0 conn(0x7f96bc051f80 legacy=0x7f96bc053130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:17.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.042+0000 7f96c9000640 1 -- 172.21.15.2:0/3370699770 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96bc054900 con 0x7f96bc053840 2024-09-10T08:47:17.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.043+0000 7f2acfe00640 1 -- 172.21.15.2:0/1453632029 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2abc037070 con 0x7f2ac801dc40 2024-09-10T08:47:17.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.043+0000 7f2acfe00640 1 -- 172.21.15.2:0/1453632029 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2abc02ae50 con 0x7f2ac801dc40 2024-09-10T08:47:17.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.043+0000 7f2acfe00640 1 -- 172.21.15.2:0/1453632029 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2abc0328a0 con 0x7f2ac801dc40 2024-09-10T08:47:17.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.044+0000 7f2ad6800640 1 -- 172.21.15.2:0/1453632029 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ac801dc40 msgr2=0x7f2ac8053f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:17.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.044+0000 7f2ad6800640 1 --2- 172.21.15.2:0/1453632029 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ac801dc40 0x7f2ac8053f50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2abc0097a0 tx=0x7f2abc02a300 comp rx=0 tx=0).stop 2024-09-10T08:47:17.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.044+0000 7f96c9000640 1 --2- 172.21.15.2:0/3370699770 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96bc053840 0x7f96bc0523f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f96c4000b60 tx=0x7f96c40a6260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4742520f092ab507 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:17.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.045+0000 7f2ad6800640 1 -- 172.21.15.2:0/1453632029 shutdown_connections 2024-09-10T08:47:17.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.045+0000 7f2ad6800640 1 --2- 172.21.15.2:0/1453632029 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ac801dc40 0x7f2ac8053f50 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.045+0000 7f2ad6800640 1 -- 172.21.15.2:0/1453632029 >> 172.21.15.2:0/1453632029 conn(0x7f2ac8036090 msgr2=0x7f2ac80364a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:17.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.045+0000 7f4155000640 1 Processor -- start 2024-09-10T08:47:17.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.045+0000 7f96c2a00640 1 -- 172.21.15.2:0/3370699770 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c40b3070 con 0x7f96bc053840 2024-09-10T08:47:17.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.045+0000 7fcddd200640 1 Processor -- start 2024-09-10T08:47:17.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.044+0000 7f343a200640 1 Processor -- start 2024-09-10T08:47:17.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.045+0000 7f4155000640 1 -- start start 2024-09-10T08:47:17.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.045+0000 7f343a200640 1 -- start start 2024-09-10T08:47:17.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.045+0000 7f2ad6800640 1 -- 172.21.15.2:0/1453632029 shutdown_connections 2024-09-10T08:47:17.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.045+0000 7f2ad6800640 1 -- 172.21.15.2:0/1453632029 wait complete. 2024-09-10T08:47:17.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.045+0000 7f96c2a00640 1 -- 172.21.15.2:0/3370699770 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96c40ae640 con 0x7f96bc053840 2024-09-10T08:47:17.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.045+0000 7f96c2a00640 1 -- 172.21.15.2:0/3370699770 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c40b3070 con 0x7f96bc053840 2024-09-10T08:47:17.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.046+0000 7f96cb000640 1 -- 172.21.15.2:0/3370699770 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96bc053840 msgr2=0x7f96bc0523f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:17.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.046+0000 7f96cb000640 1 --2- 172.21.15.2:0/3370699770 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96bc053840 0x7f96bc0523f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f96c4000b60 tx=0x7f96c40a6260 comp rx=0 tx=0).stop 2024-09-10T08:47:17.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.046+0000 7fcddd200640 1 -- start start 2024-09-10T08:47:17.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.047+0000 7f4155000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4150161ca0 0x7f41500d2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:17.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.047+0000 7f4155000640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f41500cf8c0 0x7f415006d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:17.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.047+0000 7f4155000640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41500cfe50 con 0x7f41500d2b60 2024-09-10T08:47:17.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.047+0000 7f4155000640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f41500d2fd0 con 0x7f4150161ca0 2024-09-10T08:47:17.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.047+0000 7f4155000640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f41500d34a0 con 0x7f41500cf8c0 2024-09-10T08:47:17.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.047+0000 7f343a200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34340b2f50 0x7f343415e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:17.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.047+0000 7f343a200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34340b38d0 0x7f343415b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:17.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.047+0000 7f343a200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f343415e360 0x7f343409cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:17.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.047+0000 7f343a200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f343406dd70 con 0x7f343415e360 2024-09-10T08:47:17.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.047+0000 7f343a200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3434072d50 con 0x7f34340b38d0 2024-09-10T08:47:17.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.047+0000 7f343a200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f343406f2a0 con 0x7f34340b2f50 2024-09-10T08:47:17.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.048+0000 7f2ad6800640 1 Processor -- start 2024-09-10T08:47:17.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.048+0000 7f5ab0a00640 1 Processor -- start 2024-09-10T08:47:17.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.048+0000 7f3439800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f343415e360 0x7f343409cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:17.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.048+0000 7f96cb000640 1 -- 172.21.15.2:0/3370699770 shutdown_connections 2024-09-10T08:47:17.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.048+0000 7f96cb000640 1 --2- 172.21.15.2:0/3370699770 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96bc053840 0x7f96bc0523f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.048+0000 7f96cb000640 1 --2- 172.21.15.2:0/3370699770 >> v2:172.21.15.155:3300/0 conn(0x7f96bc0e0a30 0x7f96bc0553e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.048+0000 7f2ad6800640 1 -- start start 2024-09-10T08:47:17.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.048+0000 7f96cb000640 1 -- 172.21.15.2:0/3370699770 >> 172.21.15.2:0/3370699770 conn(0x7f96bc01fb40 msgr2=0x7f96bc0567b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:17.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.048+0000 7f3439800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f343415e360 0x7f343409cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51050/0 (socket says 172.21.15.2:51050) 2024-09-10T08:47:17.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.048+0000 7f3439800640 1 -- 172.21.15.2:0/2575719733 learned_addr learned my addr 172.21.15.2:0/2575719733 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:17.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.048+0000 7f414de00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4150161ca0 0x7f41500d2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:17.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.048+0000 7f414de00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4150161ca0 0x7f41500d2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51042/0 (socket says 172.21.15.2:51042) 2024-09-10T08:47:17.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.048+0000 7f414de00640 1 -- 172.21.15.2:0/889334248 learned_addr learned my addr 172.21.15.2:0/889334248 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:17.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.048+0000 7f414e800640 1 --2- 172.21.15.2:0/889334248 >> v2:172.21.15.155:3300/0 conn(0x7f41500cf8c0 0x7f415006d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:17.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.049+0000 7f3438e00640 1 --2- 172.21.15.2:0/2575719733 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34340b2f50 0x7f343415e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:17.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.049+0000 7f3439800640 1 -- 172.21.15.2:0/2575719733 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34340b2f50 msgr2=0x7f343415e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:17.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.049+0000 7f3439800640 1 --2- 172.21.15.2:0/2575719733 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34340b2f50 0x7f343415e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.049+0000 7f3439800640 1 -- 172.21.15.2:0/2575719733 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34340b38d0 msgr2=0x7f343415b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:17.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.049+0000 7f3439800640 1 --2- 172.21.15.2:0/2575719733 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34340b38d0 0x7f343415b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.049+0000 7f8a27400640 1 Processor -- start 2024-09-10T08:47:17.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.049+0000 7f8a27400640 1 -- start start 2024-09-10T08:47:17.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.049+0000 7f414de00640 1 -- 172.21.15.2:0/889334248 >> v2:172.21.15.155:3300/0 conn(0x7f41500cf8c0 msgr2=0x7f415006d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:17.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.049+0000 7f414de00640 1 --2- 172.21.15.2:0/889334248 >> v2:172.21.15.155:3300/0 conn(0x7f41500cf8c0 0x7f415006d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.049+0000 7f414de00640 1 -- 172.21.15.2:0/889334248 >> v1:172.21.15.155:6789/0 conn(0x7f41500d2b60 legacy=0x7f41500cf1b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-10T08:47:17.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.049+0000 7f414de00640 1 -- 172.21.15.2:0/889334248 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41500d0130 con 0x7f4150161ca0 2024-09-10T08:47:17.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.050+0000 7f3439800640 1 -- 172.21.15.2:0/2575719733 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3434151bf0 con 0x7f343415e360 2024-09-10T08:47:17.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.050+0000 7f2ad6800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ac8005ab0 0x7f2ac800afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:17.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.050+0000 7f2ad6800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ac801dc40 0x7f2ac80e7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:17.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.050+0000 7f2ad6800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2ac80e7120 0x7f2ac80e9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:17.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.048+0000 7f96cb000640 1 -- 172.21.15.2:0/3370699770 shutdown_connections 2024-09-10T08:47:17.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.048+0000 7f96cb000640 1 -- 172.21.15.2:0/3370699770 wait complete. 2024-09-10T08:47:17.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.050+0000 7f414de00640 1 --2- 172.21.15.2:0/889334248 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4150161ca0 0x7f41500d2620 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f415008e610 tx=0x7f414002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8870892106b7a9a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:17.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.050+0000 7f3439800640 1 --2- 172.21.15.2:0/2575719733 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f343415e360 0x7f343409cc10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f342c00cb30 tx=0x7f342c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:17.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.048+0000 7f5ab0a00640 1 -- start start 2024-09-10T08:47:17.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.050+0000 7f5ab0a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5aac0d2f90 0x7f5aac0d44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:17.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.050+0000 7f5ab0a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5aac0d4a00 0x7f5aac0d0920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:17.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.050+0000 7f5ab0a00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5aac15eb50 con 0x7f5aac15e770 2024-09-10T08:47:17.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.050+0000 7f5ab0a00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f5aac0cf640 con 0x7f5aac0d4a00 2024-09-10T08:47:17.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.050+0000 7f5ab0a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5aac0d4e50 con 0x7f5aac0d2f90 2024-09-10T08:47:17.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.051+0000 7f8a27400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8a200d2b80 0x7f8a200d2f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:17.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.051+0000 7fcddd200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcdd8161be0 0x7fcdd80d4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:17.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.051+0000 7fcddd200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcdd80d2140 0x7fcdd80d0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:17.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.051+0000 7fcddd200640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fcdd80d05a0 0x7fcdd80b1220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:17.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.051+0000 7fcddd200640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fcdd8161fc0 con 0x7fcdd80d2140 2024-09-10T08:47:17.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.051+0000 7fcddd200640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fcdd80b3940 con 0x7fcdd80d05a0 2024-09-10T08:47:17.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.051+0000 7fcddd200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fcdd80d26b0 con 0x7fcdd8161be0 2024-09-10T08:47:17.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.051+0000 7f5aaa800640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f5aac15e770 0x7f5aac0cef30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48416/0 (socket says 172.21.15.2:48416) 2024-09-10T08:47:17.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.051+0000 7f5aaa800640 1 -- 172.21.15.2:0/553562162 learned_addr learned my addr 172.21.15.2:0/553562162 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:47:17.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.050+0000 7f2ad6800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2ac804eb60 con 0x7f2ac801dc40 2024-09-10T08:47:17.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.050+0000 7f2ad6800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2ac8053a10 con 0x7f2ac8005ab0 2024-09-10T08:47:17.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.050+0000 7f2ad6800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2ac804ece0 con 0x7f2ac80e7120 2024-09-10T08:47:17.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.051+0000 7f2ad4a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ac801dc40 0x7f2ac80e7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:17.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.051+0000 7f8a27400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a200d5100 0x7f8a200d15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:17.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.051+0000 7f8a27400640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a200d34a0 con 0x7f8a200d4cb0 2024-09-10T08:47:17.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.051+0000 7f8a27400640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f8a200d05d0 con 0x7f8a200d2b80 2024-09-10T08:47:17.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.051+0000 7f8a27400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8a200cf530 con 0x7f8a200d5100 2024-09-10T08:47:17.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.051+0000 7f5aa9e00640 1 --2- 172.21.15.2:0/553562162 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5aac0d2f90 0x7f5aac0d44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:17.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.051+0000 7f414ca00640 1 -- 172.21.15.2:0/889334248 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4140036070 con 0x7f4150161ca0 2024-09-10T08:47:17.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.051+0000 7f414ca00640 1 -- 172.21.15.2:0/889334248 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4140031600 con 0x7f4150161ca0 2024-09-10T08:47:17.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.051+0000 7f414ca00640 1 -- 172.21.15.2:0/889334248 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f414002ae60 con 0x7f4150161ca0 2024-09-10T08:47:17.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.052+0000 7f96cb000640 1 Processor -- start 2024-09-10T08:47:17.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.052+0000 7f8a24a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8a200d2b80 0x7f8a200d2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:17.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.052+0000 7f8a24a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8a200d2b80 0x7f8a200d2f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51080/0 (socket says 172.21.15.2:51080) 2024-09-10T08:47:17.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.052+0000 7f8a24a00640 1 -- 172.21.15.2:0/1435618577 learned_addr learned my addr 172.21.15.2:0/1435618577 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:17.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.052+0000 7f96cb000640 1 -- start start 2024-09-10T08:47:17.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.052+0000 7f8a25400640 1 --2- 172.21.15.2:0/1435618577 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a200d5100 0x7f8a200d15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:17.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.052+0000 7f5aab200640 1 --2- 172.21.15.2:0/553562162 >> v2:172.21.15.2:3300/0 conn(0x7f5aac0d4a00 0x7f5aac0d0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:17.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.052+0000 7f2ad5400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ac8005ab0 0x7f2ac800afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:17.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.052+0000 7f2ad5400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ac8005ab0 0x7f2ac800afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.2:45514/0 (socket says 172.21.15.2:45514) 2024-09-10T08:47:17.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.052+0000 7f2ad5400640 1 -- 172.21.15.2:0/2344908170 learned_addr learned my addr 172.21.15.2:0/2344908170 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:17.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.052+0000 7f2ad5e00640 1 --2- 172.21.15.2:0/2344908170 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2ac80e7120 0x7f2ac80e9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:17.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.052+0000 7f8a1f400640 1 -- 172.21.15.2:0/1435618577 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3022140284 0 0) 0x7f8a200d34a0 con 0x7f8a200d4cb0 2024-09-10T08:47:17.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.052+0000 7f8a1f400640 1 -- 172.21.15.2:0/1435618577 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a08003520 con 0x7f8a200d4cb0 2024-09-10T08:47:17.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.053+0000 7f8a25400640 1 -- 172.21.15.2:0/1435618577 >> v2:172.21.15.2:3300/0 conn(0x7f8a200d2b80 msgr2=0x7f8a200d2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:17.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.053+0000 7f8a25400640 1 --2- 172.21.15.2:0/1435618577 >> v2:172.21.15.2:3300/0 conn(0x7f8a200d2b80 0x7f8a200d2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.053+0000 7f8a25400640 1 -- 172.21.15.2:0/1435618577 >> v1:172.21.15.155:6789/0 conn(0x7f8a200d4cb0 legacy=0x7f8a200d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:17.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.053+0000 7f8a25400640 1 -- 172.21.15.2:0/1435618577 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a200cf810 con 0x7f8a200d5100 2024-09-10T08:47:17.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.053+0000 7f4155000640 1 -- 172.21.15.2:0/889334248 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4150161ca0 msgr2=0x7f41500d2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:17.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.053+0000 7f4155000640 1 --2- 172.21.15.2:0/889334248 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4150161ca0 0x7f41500d2620 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f415008e610 tx=0x7f414002a680 comp rx=0 tx=0).stop 2024-09-10T08:47:17.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.052+0000 7fcdd5e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcdd8161be0 0x7fcdd80d4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:17.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.053+0000 7f4155000640 1 -- 172.21.15.2:0/889334248 shutdown_connections 2024-09-10T08:47:17.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.053+0000 7f4155000640 1 --2- 172.21.15.2:0/889334248 >> v2:172.21.15.155:3300/0 conn(0x7f41500cf8c0 0x7f415006d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.053+0000 7f4155000640 1 --2- 172.21.15.2:0/889334248 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4150161ca0 0x7f41500d2620 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.053+0000 7f4155000640 1 -- 172.21.15.2:0/889334248 >> 172.21.15.2:0/889334248 conn(0x7f415008bfd0 msgr2=0x7f41500d45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:17.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.053+0000 7f4155000640 1 -- 172.21.15.2:0/889334248 shutdown_connections 2024-09-10T08:47:17.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.052+0000 7fcdd5400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcdd80d2140 0x7fcdd80d0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:17.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.053+0000 7fcdd5400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcdd80d2140 0x7fcdd80d0060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51092/0 (socket says 172.21.15.2:51092) 2024-09-10T08:47:17.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.053+0000 7fcdd5400640 1 -- 172.21.15.2:0/345633272 learned_addr learned my addr 172.21.15.2:0/345633272 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:17.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.053+0000 7fcdd6800640 1 --2- 172.21.15.2:0/345633272 >> v2:172.21.15.155:3300/0 conn(0x7fcdd80d05a0 0x7fcdd80b1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:17.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.054+0000 7f3430c00640 1 -- 172.21.15.2:0/2575719733 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f342c017070 con 0x7f343415e360 2024-09-10T08:47:17.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.054+0000 7f96cb000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96bc051f80 0x7f96bc0d6be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:17.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.054+0000 7f4155000640 1 -- 172.21.15.2:0/889334248 wait complete. 2024-09-10T08:47:17.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.054+0000 7f3430c00640 1 -- 172.21.15.2:0/2575719733 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f342c00aca0 con 0x7f343415e360 2024-09-10T08:47:17.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.054+0000 7f3430c00640 1 -- 172.21.15.2:0/2575719733 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f342c012600 con 0x7f343415e360 2024-09-10T08:47:17.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.055+0000 7f96cb000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96bc053840 0x7f96bc04a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:17.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.055+0000 7f96cb000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96bc0e0a30 0x7f96bc03a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:17.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.054+0000 7fcdd6800640 1 -- 172.21.15.2:0/345633272 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcdd8161be0 msgr2=0x7fcdd80d4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:17.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.054+0000 7fcdd6800640 1 --2- 172.21.15.2:0/345633272 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcdd8161be0 0x7fcdd80d4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.054+0000 7fcdd6800640 1 -- 172.21.15.2:0/345633272 >> v2:172.21.15.2:3300/0 conn(0x7fcdd80d2140 msgr2=0x7fcdd80d0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:17.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.054+0000 7fcdd6800640 1 --2- 172.21.15.2:0/345633272 >> v2:172.21.15.2:3300/0 conn(0x7fcdd80d2140 0x7fcdd80d0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.054+0000 7fcdd6800640 1 -- 172.21.15.2:0/345633272 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdd80cf580 con 0x7fcdd80d05a0 2024-09-10T08:47:17.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.054+0000 7f5aab200640 1 -- 172.21.15.2:0/553562162 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5aac0d2f90 msgr2=0x7f5aac0d44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:17.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.054+0000 7f5aab200640 1 --2- 172.21.15.2:0/553562162 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5aac0d2f90 0x7f5aac0d44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.054+0000 7f5aab200640 1 -- 172.21.15.2:0/553562162 >> v1:172.21.15.2:6789/0 conn(0x7f5aac15e770 legacy=0x7f5aac0cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:17.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.054+0000 7f5aab200640 1 -- 172.21.15.2:0/553562162 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5aac0d33f0 con 0x7f5aac0d4a00 2024-09-10T08:47:17.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.054+0000 7f5aa9e00640 1 --2- 172.21.15.2:0/553562162 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5aac0d2f90 0x7f5aac0d44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:47:17.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.055+0000 7f5aab200640 1 --2- 172.21.15.2:0/553562162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5aac0d4a00 0x7f5aac0d0920 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5aa4009dc0 tx=0x7f5aa402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=447882ec75d62ab2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:17.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.055+0000 7f96c3400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96bc053840 0x7f96bc04a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:17.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.055+0000 7f96c3400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96bc053840 0x7f96bc04a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.2:45518/0 (socket says 172.21.15.2:45518) 2024-09-10T08:47:17.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.055+0000 7f96c3400640 1 -- 172.21.15.2:0/381223815 learned_addr learned my addr 172.21.15.2:0/381223815 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:17.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.055+0000 7f2ad5400640 1 -- 172.21.15.2:0/2344908170 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2ac80e7120 msgr2=0x7f2ac80e9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:17.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.055+0000 7f2ad5400640 1 --2- 172.21.15.2:0/2344908170 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2ac80e7120 0x7f2ac80e9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.055+0000 7f2ad5400640 1 -- 172.21.15.2:0/2344908170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ac801dc40 msgr2=0x7f2ac80e7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:17.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.055+0000 7f2ad5400640 1 --2- 172.21.15.2:0/2344908170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ac801dc40 0x7f2ac80e7500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.055+0000 7f8a25400640 1 --2- 172.21.15.2:0/1435618577 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a200d5100 0x7f8a200d15d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8a18009d90 tx=0x7f8a1802a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d112595fd30d5cb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:17.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.056+0000 7f8a1f400640 1 -- 172.21.15.2:0/1435618577 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a18007740 con 0x7f8a200d5100 2024-09-10T08:47:17.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.056+0000 7f8a1f400640 1 -- 172.21.15.2:0/1435618577 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a180078e0 con 0x7f8a200d5100 2024-09-10T08:47:17.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.056+0000 7f8a1f400640 1 -- 172.21.15.2:0/1435618577 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a18007cb0 con 0x7f8a200d5100 2024-09-10T08:47:17.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.056+0000 7fcdd6800640 1 --2- 172.21.15.2:0/345633272 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcdd80d05a0 0x7fcdd80b1220 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcdd80b3640 tx=0x7fcdc402a070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=317badf417c4da96 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:17.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.056+0000 7f5aa9400640 1 -- 172.21.15.2:0/553562162 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aa4007740 con 0x7f5aac0d4a00 2024-09-10T08:47:17.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.056+0000 7f343a200640 1 -- 172.21.15.2:0/2575719733 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f343415f040 con 0x7f343415e360 2024-09-10T08:47:17.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.056+0000 7f343a200640 1 -- 172.21.15.2:0/2575719733 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f343415f600 con 0x7f343415e360 2024-09-10T08:47:17.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.056+0000 7f2ad5400640 1 -- 172.21.15.2:0/2344908170 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ac80e7a40 con 0x7f2ac8005ab0 2024-09-10T08:47:17.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.056+0000 7f96cb000640 1 -- 172.21.15.2:0/381223815 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f96bc0e0e10 con 0x7f96bc051f80 2024-09-10T08:47:17.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.056+0000 7f96cb000640 1 -- 172.21.15.2:0/381223815 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f96bc054ec0 con 0x7f96bc053840 2024-09-10T08:47:17.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.056+0000 7f96cb000640 1 -- 172.21.15.2:0/381223815 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f96bc0570e0 con 0x7f96bc0e0a30 2024-09-10T08:47:17.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.056+0000 7f96c9000640 1 --2- 172.21.15.2:0/381223815 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96bc0e0a30 0x7f96bc03a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:17.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.056+0000 7f5aa9400640 1 -- 172.21.15.2:0/553562162 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5aa40078e0 con 0x7f5aac0d4a00 2024-09-10T08:47:17.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.056+0000 7f5aa9400640 1 -- 172.21.15.2:0/553562162 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aa4007cb0 con 0x7f5aac0d4a00 2024-09-10T08:47:17.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.057+0000 7f2ad5400640 1 --2- 172.21.15.2:0/2344908170 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ac8005ab0 0x7f2ac800afa0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2ac400c730 tx=0x7f2ac400cb30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:17.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.057+0000 7f96c3e00640 1 --2- 172.21.15.2:0/381223815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96bc051f80 0x7f96bc0d6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:17.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.057+0000 7f8a27400640 1 -- 172.21.15.2:0/1435618577 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a200d5100 msgr2=0x7f8a200d15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:17.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.057+0000 7f8a27400640 1 --2- 172.21.15.2:0/1435618577 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a200d5100 0x7f8a200d15d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8a18009d90 tx=0x7f8a1802a660 comp rx=0 tx=0).stop 2024-09-10T08:47:17.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.057+0000 7f8a27400640 1 -- 172.21.15.2:0/1435618577 shutdown_connections 2024-09-10T08:47:17.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.057+0000 7f8a27400640 1 --2- 172.21.15.2:0/1435618577 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a200d5100 0x7f8a200d15d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.057+0000 7f8a27400640 1 --2- 172.21.15.2:0/1435618577 >> v2:172.21.15.2:3300/0 conn(0x7f8a200d2b80 0x7f8a200d2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.057+0000 7f8a27400640 1 -- 172.21.15.2:0/1435618577 >> 172.21.15.2:0/1435618577 conn(0x7f8a2008bfd0 msgr2=0x7f8a200d45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:17.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.057+0000 7f4155000640 1 Processor -- start 2024-09-10T08:47:17.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.057+0000 7fcdd4a00640 1 -- 172.21.15.2:0/345633272 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc4037070 con 0x7fcdd80d05a0 2024-09-10T08:47:17.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.057+0000 7fcdd4a00640 1 -- 172.21.15.2:0/345633272 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdc402adc0 con 0x7fcdd80d05a0 2024-09-10T08:47:17.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.057+0000 7fcdd4a00640 1 -- 172.21.15.2:0/345633272 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc4032660 con 0x7fcdd80d05a0 2024-09-10T08:47:17.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.057+0000 7f5ab0a00640 1 -- 172.21.15.2:0/553562162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5aac0d4a00 msgr2=0x7f5aac0d0920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:17.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.057+0000 7f5ab0a00640 1 --2- 172.21.15.2:0/553562162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5aac0d4a00 0x7f5aac0d0920 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5aa4009dc0 tx=0x7f5aa402a710 comp rx=0 tx=0).stop 2024-09-10T08:47:17.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.057+0000 7f2acd600640 1 -- 172.21.15.2:0/2344908170 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ac4017070 con 0x7f2ac8005ab0 2024-09-10T08:47:17.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.057+0000 7f2acd600640 1 -- 172.21.15.2:0/2344908170 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ac4007290 con 0x7f2ac8005ab0 2024-09-10T08:47:17.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.057+0000 7f5ab0a00640 1 -- 172.21.15.2:0/553562162 shutdown_connections 2024-09-10T08:47:17.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.057+0000 7f5ab0a00640 1 --2- 172.21.15.2:0/553562162 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5aac0d4a00 0x7f5aac0d0920 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.057+0000 7f5ab0a00640 1 --2- 172.21.15.2:0/553562162 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5aac0d2f90 0x7f5aac0d44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.057+0000 7f5ab0a00640 1 -- 172.21.15.2:0/553562162 >> 172.21.15.2:0/553562162 conn(0x7f5aac08bfd0 msgr2=0x7f5aac09d7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:17.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.057+0000 7f4155000640 1 -- start start 2024-09-10T08:47:17.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.058+0000 7f8e6ea00640 1 Processor -- start 2024-09-10T08:47:17.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.057+0000 7f2acd600640 1 -- 172.21.15.2:0/2344908170 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ac4001d40 con 0x7f2ac8005ab0 2024-09-10T08:47:17.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.057+0000 7f2ad6800640 1 -- 172.21.15.2:0/2344908170 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ac80e7ce0 con 0x7f2ac8005ab0 2024-09-10T08:47:17.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.058+0000 7f2ad6800640 1 -- 172.21.15.2:0/2344908170 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ac804c030 con 0x7f2ac8005ab0 2024-09-10T08:47:17.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.057+0000 7f96c3400640 1 -- 172.21.15.2:0/381223815 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96bc0e0a30 msgr2=0x7f96bc03a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:17.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.057+0000 7f96c3400640 1 --2- 172.21.15.2:0/381223815 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96bc0e0a30 0x7f96bc03a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.057+0000 7f96c3400640 1 -- 172.21.15.2:0/381223815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96bc051f80 msgr2=0x7f96bc0d6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:17.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.057+0000 7f96c3400640 1 --2- 172.21.15.2:0/381223815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96bc051f80 0x7f96bc0d6be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.057+0000 7f96c3400640 1 -- 172.21.15.2:0/381223815 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96bc04ad60 con 0x7f96bc053840 2024-09-10T08:47:17.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.058+0000 7f96c3e00640 1 --2- 172.21.15.2:0/381223815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96bc051f80 0x7f96bc0d6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:47:17.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.058+0000 7fcddd200640 1 -- 172.21.15.2:0/345633272 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcdd80d05a0 msgr2=0x7fcdd80b1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:17.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.058+0000 7fcddd200640 1 --2- 172.21.15.2:0/345633272 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcdd80d05a0 0x7fcdd80b1220 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcdd80b3640 tx=0x7fcdc402a070 comp rx=0 tx=0).stop 2024-09-10T08:47:17.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.058+0000 7f8a27400640 1 -- 172.21.15.2:0/1435618577 shutdown_connections 2024-09-10T08:47:17.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.058+0000 7f5ab0a00640 1 -- 172.21.15.2:0/553562162 shutdown_connections 2024-09-10T08:47:17.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.058+0000 7f343a200640 1 -- 172.21.15.2:0/2575719733 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34340b3390 con 0x7f343415e360 2024-09-10T08:47:17.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.059+0000 7f96c3400640 1 --2- 172.21.15.2:0/381223815 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96bc053840 0x7f96bc04a2e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f96b000b460 tx=0x7f96b000b920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:17.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.059+0000 7f8a27400640 1 -- 172.21.15.2:0/1435618577 wait complete. 2024-09-10T08:47:17.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.058+0000 7f8e6ea00640 1 -- start start 2024-09-10T08:47:17.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.058+0000 7f5ab0a00640 1 -- 172.21.15.2:0/553562162 wait complete. 2024-09-10T08:47:17.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.059+0000 7fcddd200640 1 -- 172.21.15.2:0/345633272 shutdown_connections 2024-09-10T08:47:17.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.059+0000 7fcddd200640 1 --2- 172.21.15.2:0/345633272 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcdd80d05a0 0x7fcdd80b1220 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.059+0000 7fcddd200640 1 --2- 172.21.15.2:0/345633272 >> v2:172.21.15.2:3300/0 conn(0x7fcdd80d2140 0x7fcdd80d0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.059+0000 7fcddd200640 1 --2- 172.21.15.2:0/345633272 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcdd8161be0 0x7fcdd80d4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.059+0000 7fcddd200640 1 -- 172.21.15.2:0/345633272 >> 172.21.15.2:0/345633272 conn(0x7fcdd808bfd0 msgr2=0x7fcdd80d4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:17.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.059+0000 7f2ad6800640 1 -- 172.21.15.2:0/2344908170 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ac80e8200 con 0x7f2ac8005ab0 2024-09-10T08:47:17.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.059+0000 7f96b7e00640 1 -- 172.21.15.2:0/381223815 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b0015020 con 0x7f96bc053840 2024-09-10T08:47:17.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.059+0000 7fcddd200640 1 -- 172.21.15.2:0/345633272 shutdown_connections 2024-09-10T08:47:17.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.059+0000 7f4155000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41500cf8c0 0x7f4150158750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:17.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.059+0000 7f4155000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41500d2b60 0x7f41500cac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:17.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.059+0000 7f4155000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4150161ca0 0x7f41501f4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:17.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.059+0000 7f4155000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f415006d040 con 0x7f41500d2b60 2024-09-10T08:47:17.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.059+0000 7f4155000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f415006cdf0 con 0x7f41500cf8c0 2024-09-10T08:47:17.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.059+0000 7f4155000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f415006daa0 con 0x7f4150161ca0 2024-09-10T08:47:17.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.060+0000 7f414e800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4150161ca0 0x7f41501f4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:17.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.060+0000 7f414d400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41500d2b60 0x7f41500cac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:17.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.060+0000 7f8e6ea00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8e680d2b80 0x7f8e680d2f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:17.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.060+0000 7f8e6ea00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8e680d5100 0x7f8e680d15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:17.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.060+0000 7f8e6ea00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e680d34a0 con 0x7f8e680d4cb0 2024-09-10T08:47:17.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.060+0000 7f8e6ea00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f8e680d05d0 con 0x7f8e680d2b80 2024-09-10T08:47:17.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.060+0000 7f8e6ea00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8e680cf530 con 0x7f8e680d5100 2024-09-10T08:47:17.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.060+0000 7f96cb000640 1 -- 172.21.15.2:0/381223815 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96bc04b040 con 0x7f96bc053840 2024-09-10T08:47:17.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.060+0000 7f96cb000640 1 -- 172.21.15.2:0/381223815 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96bc0d7120 con 0x7f96bc053840 2024-09-10T08:47:17.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.060+0000 7f96b7e00640 1 -- 172.21.15.2:0/381223815 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96b00118b0 con 0x7f96bc053840 2024-09-10T08:47:17.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.060+0000 7f96b7e00640 1 -- 172.21.15.2:0/381223815 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b0011ca0 con 0x7f96bc053840 2024-09-10T08:47:17.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.061+0000 7fcddd200640 1 -- 172.21.15.2:0/345633272 wait complete. 2024-09-10T08:47:17.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.060+0000 7f5ab0a00640 1 Processor -- start 2024-09-10T08:47:17.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.061+0000 7f5ab0a00640 1 -- start start 2024-09-10T08:47:17.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.060+0000 7f414e800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4150161ca0 0x7f41501f4f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.2:40544/0 (socket says 172.21.15.2:40544) 2024-09-10T08:47:17.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.060+0000 7f414e800640 1 -- 172.21.15.2:0/3098957134 learned_addr learned my addr 172.21.15.2:0/3098957134 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:17.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.061+0000 7f414de00640 1 --2- 172.21.15.2:0/3098957134 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41500cf8c0 0x7f4150158750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:17.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.061+0000 7f8e6ca00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8e680d5100 0x7f8e680d15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:17.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.061+0000 7f8e6ca00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8e680d5100 0x7f8e680d15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.2:40548/0 (socket says 172.21.15.2:40548) 2024-09-10T08:47:17.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.061+0000 7f8e6ca00640 1 -- 172.21.15.2:0/1519772089 learned_addr learned my addr 172.21.15.2:0/1519772089 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:17.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.061+0000 7f3430c00640 1 -- 172.21.15.2:0/2575719733 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f342c01a070 con 0x7f343415e360 2024-09-10T08:47:17.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.062+0000 7f5ab0a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5aac0d2f90 0x7f5aac200d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:17.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.062+0000 7f5ab0a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5aac0d4a00 0x7f5aac0b8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:17.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.062+0000 7f414e800640 1 -- 172.21.15.2:0/3098957134 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41500cf8c0 msgr2=0x7f4150158750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:17.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.062+0000 7f5ab0a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5aac15e770 0x7f5aac160a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:17.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.062+0000 7f5ab0a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5aac0cfe40 con 0x7f5aac0d2f90 2024-09-10T08:47:17.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.062+0000 7f5ab0a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5aac0cfb60 con 0x7f5aac0d4a00 2024-09-10T08:47:17.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.062+0000 7f5ab0a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5aac0d0120 con 0x7f5aac15e770 2024-09-10T08:47:17.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.062+0000 7f414e800640 1 --2- 172.21.15.2:0/3098957134 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41500cf8c0 0x7f4150158750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.062+0000 7f414e800640 1 -- 172.21.15.2:0/3098957134 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41500d2b60 msgr2=0x7f41500cac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:17.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.062+0000 7f414e800640 1 --2- 172.21.15.2:0/3098957134 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41500d2b60 0x7f41500cac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.062+0000 7f414e800640 1 -- 172.21.15.2:0/3098957134 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41500b9590 con 0x7f4150161ca0 2024-09-10T08:47:17.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.063+0000 7f5aab200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5aac15e770 0x7f5aac160a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:17.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.063+0000 7f8a27400640 1 Processor -- start 2024-09-10T08:47:17.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.063+0000 7f5aab200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5aac15e770 0x7f5aac160a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.2:40562/0 (socket says 172.21.15.2:40562) 2024-09-10T08:47:17.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.063+0000 7f5aab200640 1 -- 172.21.15.2:0/2661499424 learned_addr learned my addr 172.21.15.2:0/2661499424 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:17.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.063+0000 7f414e800640 1 --2- 172.21.15.2:0/3098957134 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4150161ca0 0x7f41501f4f40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f414800d830 tx=0x7f414800dcf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:17.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.063+0000 7f8a27400640 1 -- start start 2024-09-10T08:47:17.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.064+0000 7f5aab200640 1 -- 172.21.15.2:0/2661499424 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5aac0d4a00 msgr2=0x7f5aac0b8610 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:47:17.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.064+0000 7f5aab200640 1 --2- 172.21.15.2:0/2661499424 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5aac0d4a00 0x7f5aac0b8610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.064+0000 7f5aab200640 1 -- 172.21.15.2:0/2661499424 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5aac0d2f90 msgr2=0x7f5aac200d10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:47:17.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.064+0000 7f5aab200640 1 --2- 172.21.15.2:0/2661499424 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5aac0d2f90 0x7f5aac200d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.064+0000 7f5aab200640 1 -- 172.21.15.2:0/2661499424 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5aac201640 con 0x7f5aac15e770 2024-09-10T08:47:17.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.064+0000 7f8e6ca00640 1 -- 172.21.15.2:0/1519772089 >> v2:172.21.15.2:3300/0 conn(0x7f8e680d2b80 msgr2=0x7f8e680d2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:17.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.062+0000 7f8e67e00640 1 --2- 172.21.15.2:0/1519772089 >> v2:172.21.15.2:3300/0 conn(0x7f8e680d2b80 0x7f8e680d2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:17.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.064+0000 7f5aab200640 1 --2- 172.21.15.2:0/2661499424 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5aac15e770 0x7f5aac160a70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5aa4009ee0 tx=0x7f5aa4004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:17.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.064+0000 7f3430c00640 1 --2- 172.21.15.2:0/2575719733 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f341406be80 0x7f341406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:17.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.064+0000 7fcddd200640 1 Processor -- start 2024-09-10T08:47:17.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.064+0000 7f96b7e00640 1 -- 172.21.15.2:0/381223815 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f96b0018020 con 0x7f96bc053840 2024-09-10T08:47:17.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.065+0000 7f4146000640 1 -- 172.21.15.2:0/3098957134 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f414800b6c0 con 0x7f4150161ca0 2024-09-10T08:47:17.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.065+0000 7f4146000640 1 -- 172.21.15.2:0/3098957134 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4148019070 con 0x7f4150161ca0 2024-09-10T08:47:17.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.065+0000 7f4146000640 1 -- 172.21.15.2:0/3098957134 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f414800baa0 con 0x7f4150161ca0 2024-09-10T08:47:17.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.065+0000 7f4155000640 1 -- 172.21.15.2:0/3098957134 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41500b9870 con 0x7f4150161ca0 2024-09-10T08:47:17.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.065+0000 7f8a27400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a200d2b80 0x7f8a201e5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:17.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.065+0000 7f8a27400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a200d4cb0 0x7f8a200b3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:17.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.065+0000 7f8a27400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a200d5100 0x7f8a200b4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:17.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.065+0000 7f8a27400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8a200d00b0 con 0x7f8a200d4cb0 2024-09-10T08:47:17.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.065+0000 7f8a27400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8a200cfdd0 con 0x7f8a200d5100 2024-09-10T08:47:17.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.065+0000 7f8a27400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8a200cf1b0 con 0x7f8a200d2b80 2024-09-10T08:47:17.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.065+0000 7f4155000640 1 -- 172.21.15.2:0/3098957134 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f41501f4740 con 0x7f4150161ca0 2024-09-10T08:47:17.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.065+0000 7f5aa2a00640 1 -- 172.21.15.2:0/2661499424 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aa4041030 con 0x7f5aac15e770 2024-09-10T08:47:17.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.065+0000 7f5aa2a00640 1 -- 172.21.15.2:0/2661499424 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5aa40318c0 con 0x7f5aac15e770 2024-09-10T08:47:17.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.065+0000 7f5aa2a00640 1 -- 172.21.15.2:0/2661499424 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aa4031c70 con 0x7f5aac15e770 2024-09-10T08:47:17.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.065+0000 7f5ab0a00640 1 -- 172.21.15.2:0/2661499424 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5aac201920 con 0x7f5aac15e770 2024-09-10T08:47:17.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.064+0000 7f96cb000640 1 -- 172.21.15.2:0/381223815 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96a0005290 con 0x7f96bc053840 2024-09-10T08:47:17.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.065+0000 7f96b7e00640 1 --2- 172.21.15.2:0/381223815 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f96a4070310 0x7f96a40727d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:17.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.065+0000 7f96b7e00640 1 -- 172.21.15.2:0/381223815 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f96b008b1c0 con 0x7f96bc053840 2024-09-10T08:47:17.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.065+0000 7f96c3e00640 1 --2- 172.21.15.2:0/381223815 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f96a4070310 0x7f96a40727d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:17.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.065+0000 7f3430c00640 1 -- 172.21.15.2:0/2575719733 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f342c08ad10 con 0x7f343415e360 2024-09-10T08:47:17.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.062+0000 7f2acd600640 1 -- 172.21.15.2:0/2344908170 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2ac401a070 con 0x7f2ac8005ab0 2024-09-10T08:47:17.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.063+0000 7f2acd600640 1 --2- 172.21.15.2:0/2344908170 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f2ab006beb0 0x7f2ab006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:17.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.063+0000 7f2acd600640 1 -- 172.21.15.2:0/2344908170 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f2ac408a3e0 con 0x7f2ac8005ab0 2024-09-10T08:47:17.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.064+0000 7f2ad4a00640 1 --2- 172.21.15.2:0/2344908170 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f2ab006beb0 0x7f2ab006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:17.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.065+0000 7f2ad4a00640 1 --2- 172.21.15.2:0/2344908170 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f2ab006beb0 0x7f2ab006e370 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2ad00504d0 tx=0x7f2ad0069a00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:17.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.064+0000 7f8e6ca00640 1 --2- 172.21.15.2:0/1519772089 >> v2:172.21.15.2:3300/0 conn(0x7f8e680d2b80 0x7f8e680d2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.064+0000 7f8e6ca00640 1 -- 172.21.15.2:0/1519772089 >> v1:172.21.15.2:6789/0 conn(0x7f8e680d4cb0 legacy=0x7f8e680d0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:17.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.064+0000 7f8e6ca00640 1 -- 172.21.15.2:0/1519772089 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e680cf810 con 0x7f8e680d5100 2024-09-10T08:47:17.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.064+0000 7f8e67e00640 1 --2- 172.21.15.2:0/1519772089 >> v2:172.21.15.2:3300/0 conn(0x7f8e680d2b80 0x7f8e680d2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:47:17.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.065+0000 7f5ab0a00640 1 -- 172.21.15.2:0/2661499424 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5aac202400 con 0x7f5aac15e770 2024-09-10T08:47:17.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.066+0000 7fcddd200640 1 -- start start 2024-09-10T08:47:17.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.066+0000 7f8a24a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a200d2b80 0x7f8a201e5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:17.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.066+0000 7f8e6ca00640 1 --2- 172.21.15.2:0/1519772089 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8e680d5100 0x7f8e680d15d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8e60009870 tx=0x7f8e6002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e5e4a428742212c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:17.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.066+0000 7f3438e00640 1 --2- 172.21.15.2:0/2575719733 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f341406be80 0x7f341406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:17.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.066+0000 7f8a25400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a200d5100 0x7f8a200b4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:17.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.066+0000 7f8a25400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a200d5100 0x7f8a200b4290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.2:45534/0 (socket says 172.21.15.2:45534) 2024-09-10T08:47:17.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.066+0000 7f8a25400640 1 -- 172.21.15.2:0/4057945637 learned_addr learned my addr 172.21.15.2:0/4057945637 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:17.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.067+0000 7f96c3e00640 1 --2- 172.21.15.2:0/381223815 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f96a4070310 0x7f96a40727d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f96b8007920 tx=0x7f96b8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:17.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.066+0000 7f8a1fe00640 1 --2- 172.21.15.2:0/4057945637 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a200d4cb0 0x7f8a200b3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:17.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.067+0000 7f8a24a00640 1 -- 172.21.15.2:0/4057945637 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a200d5100 msgr2=0x7f8a200b4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:17.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.067+0000 7f8a24a00640 1 --2- 172.21.15.2:0/4057945637 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a200d5100 0x7f8a200b4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.067+0000 7f8a24a00640 1 -- 172.21.15.2:0/4057945637 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a200d4cb0 msgr2=0x7f8a200b3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:17.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.067+0000 7f8a24a00640 1 --2- 172.21.15.2:0/4057945637 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a200d4cb0 0x7f8a200b3d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.067+0000 7f8a24a00640 1 -- 172.21.15.2:0/4057945637 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a201e5d50 con 0x7f8a200d2b80 2024-09-10T08:47:17.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.067+0000 7f8a1fe00640 1 --2- 172.21.15.2:0/4057945637 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a200d4cb0 0x7f8a200b3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:47:17.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.068+0000 7f8a24a00640 1 --2- 172.21.15.2:0/4057945637 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a200d2b80 0x7f8a201e5810 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8a1400d5d0 tx=0x7f8a1400da90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:17.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.068+0000 7f8e66a00640 1 -- 172.21.15.2:0/1519772089 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e60037070 con 0x7f8e680d5100 2024-09-10T08:47:17.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.068+0000 7f8e66a00640 1 -- 172.21.15.2:0/1519772089 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e60032440 con 0x7f8e680d5100 2024-09-10T08:47:17.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.068+0000 7f3438e00640 1 --2- 172.21.15.2:0/2575719733 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f341406be80 0x7f341406e340 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3420034000 tx=0x7f342002e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:17.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.068+0000 7f8e66a00640 1 -- 172.21.15.2:0/1519772089 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e60032810 con 0x7f8e680d5100 2024-09-10T08:47:17.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.069+0000 7f2acd600640 1 -- 172.21.15.2:0/2344908170 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2ac80e8200 con 0x7f2ac8005ab0 2024-09-10T08:47:17.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.069+0000 7f8e6ea00640 1 -- 172.21.15.2:0/1519772089 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8e680d5100 msgr2=0x7f8e680d15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:17.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.069+0000 7f8e6ea00640 1 --2- 172.21.15.2:0/1519772089 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8e680d5100 0x7f8e680d15d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8e60009870 tx=0x7f8e6002a210 comp rx=0 tx=0).stop 2024-09-10T08:47:17.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.069+0000 7f8e6ea00640 1 -- 172.21.15.2:0/1519772089 shutdown_connections 2024-09-10T08:47:17.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.069+0000 7f8e6ea00640 1 --2- 172.21.15.2:0/1519772089 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8e680d5100 0x7f8e680d15d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.069+0000 7f8e6ea00640 1 --2- 172.21.15.2:0/1519772089 >> v2:172.21.15.2:3300/0 conn(0x7f8e680d2b80 0x7f8e680d2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.069+0000 7f8e6ea00640 1 -- 172.21.15.2:0/1519772089 >> 172.21.15.2:0/1519772089 conn(0x7f8e6808bfd0 msgr2=0x7f8e680d45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:17.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.069+0000 7f8a1cc00640 1 -- 172.21.15.2:0/4057945637 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a14018020 con 0x7f8a200d2b80 2024-09-10T08:47:17.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.069+0000 7f8a1cc00640 1 -- 172.21.15.2:0/4057945637 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a14014620 con 0x7f8a200d2b80 2024-09-10T08:47:17.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.069+0000 7f8a1cc00640 1 -- 172.21.15.2:0/4057945637 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a140149d0 con 0x7f8a200d2b80 2024-09-10T08:47:17.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.070+0000 7f4155000640 1 -- 172.21.15.2:0/3098957134 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f415006d560 con 0x7f4150161ca0 2024-09-10T08:47:17.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.070+0000 7f8e6ea00640 1 -- 172.21.15.2:0/1519772089 shutdown_connections 2024-09-10T08:47:17.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.067+0000 7f5ab0a00640 1 -- 172.21.15.2:0/2661499424 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5aac201af0 con 0x7f5aac15e770 2024-09-10T08:47:17.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.070+0000 7f5aa2a00640 1 -- 172.21.15.2:0/2661499424 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5aa4044030 con 0x7f5aac15e770 2024-09-10T08:47:17.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.068+0000 7fcddd200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcdd80d2140 0x7fcdd8151ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:17.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.068+0000 7fcddd200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcdd8161be0 0x7fcdd80cc450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:17.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.068+0000 7fcddd200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcdd80cc990 0x7fcdd81582f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:17.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.068+0000 7fcddd200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd80cf230 con 0x7fcdd80cc990 2024-09-10T08:47:17.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.068+0000 7fcddd200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd80cfb40 con 0x7fcdd8161be0 2024-09-10T08:47:17.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.068+0000 7fcddd200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fcdd80b1760 con 0x7fcdd80d2140 2024-09-10T08:47:17.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.068+0000 7fcdd5e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcdd80d2140 0x7fcdd8151ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:17.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.068+0000 7fcdd5e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcdd80d2140 0x7fcdd8151ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.2:40582/0 (socket says 172.21.15.2:40582) 2024-09-10T08:47:17.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.068+0000 7fcdd5e00640 1 -- 172.21.15.2:0/584993980 learned_addr learned my addr 172.21.15.2:0/584993980 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:17.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.068+0000 7fcdd6800640 1 --2- 172.21.15.2:0/584993980 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcdd80cc990 0x7fcdd81582f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:17.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.068+0000 7fcdd5400640 1 --2- 172.21.15.2:0/584993980 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcdd8161be0 0x7fcdd80cc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:17.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.070+0000 7f8a27400640 1 -- 172.21.15.2:0/4057945637 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a200b5b10 con 0x7f8a200d2b80 2024-09-10T08:47:17.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.070+0000 7f8a27400640 1 -- 172.21.15.2:0/4057945637 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a200b60d0 con 0x7f8a200d2b80 2024-09-10T08:47:17.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.070+0000 7fcdd5e00640 1 -- 172.21.15.2:0/584993980 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcdd8161be0 msgr2=0x7fcdd80cc450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:17.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.070+0000 7fcdd5e00640 1 --2- 172.21.15.2:0/584993980 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcdd8161be0 0x7fcdd80cc450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.070+0000 7fcdd5e00640 1 -- 172.21.15.2:0/584993980 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcdd80cc990 msgr2=0x7fcdd81582f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:17.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.070+0000 7fcdd5e00640 1 --2- 172.21.15.2:0/584993980 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcdd80cc990 0x7fcdd81582f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.070+0000 7fcdd5e00640 1 -- 172.21.15.2:0/584993980 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdd80cced0 con 0x7fcdd80d2140 2024-09-10T08:47:17.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.070+0000 7f8e6ea00640 1 -- 172.21.15.2:0/1519772089 wait complete. 2024-09-10T08:47:17.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.071+0000 7fcdd6800640 1 --2- 172.21.15.2:0/584993980 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcdd80cc990 0x7fcdd81582f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:47:17.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.071+0000 7f5aa2a00640 1 --2- 172.21.15.2:0/2661499424 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f5a8c06bf00 0x7f5a8c06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:17.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.071+0000 7f5aa2a00640 1 -- 172.21.15.2:0/2661499424 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f5aa40ac4d0 con 0x7f5aac15e770 2024-09-10T08:47:17.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.072+0000 7fcdd5e00640 1 --2- 172.21.15.2:0/584993980 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcdd80d2140 0x7fcdd8151ea0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fcdd0007e40 tx=0x7fcdd000e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:17.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.072+0000 7f5aaa800640 1 --2- 172.21.15.2:0/2661499424 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f5a8c06bf00 0x7f5a8c06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:17.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.072+0000 7f4146000640 1 -- 172.21.15.2:0/3098957134 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f414800bc40 con 0x7f4150161ca0 2024-09-10T08:47:17.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.072+0000 7f8a27400640 1 -- 172.21.15.2:0/4057945637 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a2006eac0 con 0x7f8a200d2b80 2024-09-10T08:47:17.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.072+0000 7f8e6ea00640 1 Processor -- start 2024-09-10T08:47:17.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.072+0000 7f8e6ea00640 1 -- start start 2024-09-10T08:47:17.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.073+0000 7f4146000640 1 --2- 172.21.15.2:0/3098957134 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f413006bf00 0x7f413006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:17.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.073+0000 7f5aaa800640 1 --2- 172.21.15.2:0/2661499424 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f5a8c06bf00 0x7f5a8c06e3c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c0014e0 tx=0x7f5a9c007a40 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:17.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.073+0000 7f4146000640 1 -- 172.21.15.2:0/3098957134 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f414808b5c0 con 0x7f4150161ca0 2024-09-10T08:47:17.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.073+0000 7f3430c00640 1 -- 172.21.15.2:0/2575719733 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3434151bf0 con 0x7f343415e360 2024-09-10T08:47:17.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.073+0000 7f414de00640 1 --2- 172.21.15.2:0/3098957134 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f413006bf00 0x7f413006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:17.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.074+0000 7f8e6ea00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e680d2b80 0x7f8e680b8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:17.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.074+0000 7f8e6ea00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8e680d4cb0 0x7f8e680b5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:17.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.074+0000 7f8e6ea00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e680d5100 0x7f8e681e54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:17.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.074+0000 7f8e6ea00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8e680d00b0 con 0x7f8e680d2b80 2024-09-10T08:47:17.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.074+0000 7f8e6ea00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8e680cfdd0 con 0x7f8e680d5100 2024-09-10T08:47:17.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.074+0000 7f8e6ea00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8e680cf1b0 con 0x7f8e680d4cb0 2024-09-10T08:47:17.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.074+0000 7f8e67e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e680d2b80 0x7f8e680b8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:17.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.074+0000 7f414de00640 1 --2- 172.21.15.2:0/3098957134 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f413006bf00 0x7f413006e3c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4140033000 tx=0x7f4140009000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:17.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.074+0000 7f8e6ca00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e680d5100 0x7f8e681e54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:17.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.074+0000 7f8e6ca00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e680d5100 0x7f8e681e54e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.2:45550/0 (socket says 172.21.15.2:45550) 2024-09-10T08:47:17.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.074+0000 7f8e6ca00640 1 -- 172.21.15.2:0/2992280537 learned_addr learned my addr 172.21.15.2:0/2992280537 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:17.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.074+0000 7f8e67400640 1 --2- 172.21.15.2:0/2992280537 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8e680d4cb0 0x7f8e680b5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:17.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.075+0000 7f8e67e00640 1 -- 172.21.15.2:0/2992280537 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8e680d4cb0 msgr2=0x7f8e680b5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:17.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.075+0000 7f8e67e00640 1 --2- 172.21.15.2:0/2992280537 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8e680d4cb0 0x7f8e680b5b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.075+0000 7f8e67e00640 1 -- 172.21.15.2:0/2992280537 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e680d5100 msgr2=0x7f8e681e54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:17.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.075+0000 7f8e67e00640 1 --2- 172.21.15.2:0/2992280537 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e680d5100 0x7f8e681e54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.075+0000 7f8e67e00640 1 -- 172.21.15.2:0/2992280537 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e680b8fe0 con 0x7f8e680d2b80 2024-09-10T08:47:17.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.075+0000 7f8e67e00640 1 --2- 172.21.15.2:0/2992280537 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e680d2b80 0x7f8e680b8900 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8e5800cd80 tx=0x7f8e5800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:17.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.076+0000 7f8e5fe00640 1 -- 172.21.15.2:0/2992280537 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e5800f680 con 0x7f8e680d2b80 2024-09-10T08:47:17.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.076+0000 7f8e5fe00640 1 -- 172.21.15.2:0/2992280537 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e5800f820 con 0x7f8e680d2b80 2024-09-10T08:47:17.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.076+0000 7f8e5fe00640 1 -- 172.21.15.2:0/2992280537 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e5800fbf0 con 0x7f8e680d2b80 2024-09-10T08:47:17.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.077+0000 7f8e6ea00640 1 -- 172.21.15.2:0/2992280537 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e680b92c0 con 0x7f8e680d2b80 2024-09-10T08:47:17.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.077+0000 7f8e6ea00640 1 -- 172.21.15.2:0/2992280537 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e680b4030 con 0x7f8e680d2b80 2024-09-10T08:47:17.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.077+0000 7f96b7e00640 1 -- 172.21.15.2:0/381223815 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f96b001f020 con 0x7f96bc053840 2024-09-10T08:47:17.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.078+0000 7f8e6ea00640 1 -- 172.21.15.2:0/2992280537 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e6806eac0 con 0x7f8e680d2b80 2024-09-10T08:47:17.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.079+0000 7f5aa2a00640 1 -- 172.21.15.2:0/2661499424 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5aa407abb0 con 0x7f5aac15e770 2024-09-10T08:47:17.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.080+0000 7f8e5fe00640 1 -- 172.21.15.2:0/2992280537 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8e58018400 con 0x7f8e680d2b80 2024-09-10T08:47:17.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.081+0000 7f8e5fe00640 1 --2- 172.21.15.2:0/2992280537 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f8e4406be80 0x7f8e4406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:17.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.082+0000 7f8e5fe00640 1 -- 172.21.15.2:0/2992280537 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f8e5808be80 con 0x7f8e680d2b80 2024-09-10T08:47:17.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.082+0000 7f8e67400640 1 --2- 172.21.15.2:0/2992280537 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f8e4406be80 0x7f8e4406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:17.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.083+0000 7f8e67400640 1 --2- 172.21.15.2:0/2992280537 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f8e4406be80 0x7f8e4406e340 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8e680c8120 tx=0x7f8e50009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:17.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.084+0000 7f4146000640 1 -- 172.21.15.2:0/3098957134 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4148059c10 con 0x7f4150161ca0 2024-09-10T08:47:17.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.085+0000 7fcdce000640 1 -- 172.21.15.2:0/584993980 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd0014420 con 0x7fcdd80d2140 2024-09-10T08:47:17.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.085+0000 7fcdce000640 1 -- 172.21.15.2:0/584993980 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdd0019070 con 0x7fcdd80d2140 2024-09-10T08:47:17.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.085+0000 7fcdce000640 1 -- 172.21.15.2:0/584993980 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd0014800 con 0x7fcdd80d2140 2024-09-10T08:47:17.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.086+0000 7fcddd200640 1 -- 172.21.15.2:0/584993980 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdd80cd1b0 con 0x7fcdd80d2140 2024-09-10T08:47:17.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.086+0000 7fcddd200640 1 -- 172.21.15.2:0/584993980 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdd80cd770 con 0x7fcdd80d2140 2024-09-10T08:47:17.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.087+0000 7f8a1cc00640 1 -- 172.21.15.2:0/4057945637 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8a1401b020 con 0x7f8a200d2b80 2024-09-10T08:47:17.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.088+0000 7f8a1cc00640 1 --2- 172.21.15.2:0/4057945637 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f8a0006be30 0x7f8a0006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:17.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.088+0000 7fcddd200640 1 -- 172.21.15.2:0/584993980 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdd80d0210 con 0x7fcdd80d2140 2024-09-10T08:47:17.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.089+0000 7f8a1fe00640 1 --2- 172.21.15.2:0/4057945637 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f8a0006be30 0x7f8a0006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:17.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.090+0000 7f8a1cc00640 1 -- 172.21.15.2:0/4057945637 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f8a14057bb0 con 0x7f8a200d2b80 2024-09-10T08:47:17.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.091+0000 7f8a1fe00640 1 --2- 172.21.15.2:0/4057945637 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f8a0006be30 0x7f8a0006e2f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c007fd0 tx=0x7f8a0c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:17.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.090+0000 7f8a1cc00640 1 -- 172.21.15.2:0/4057945637 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8a14022020 con 0x7f8a200d2b80 2024-09-10T08:47:17.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.091+0000 7fcdce000640 1 -- 172.21.15.2:0/584993980 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcdd00149a0 con 0x7fcdd80d2140 2024-09-10T08:47:17.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.091+0000 7f8e5fe00640 1 -- 172.21.15.2:0/2992280537 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8e58014030 con 0x7f8e680d2b80 2024-09-10T08:47:17.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.093+0000 7fcdce000640 1 --2- 172.21.15.2:0/584993980 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fcdb806beb0 0x7fcdb806e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:17.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.094+0000 7fcdce000640 1 -- 172.21.15.2:0/584993980 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fcdd008c3e0 con 0x7fcdd80d2140 2024-09-10T08:47:17.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.094+0000 7fcdce000640 1 -- 172.21.15.2:0/584993980 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcdd80d0210 con 0x7fcdd80d2140 2024-09-10T08:47:17.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.096+0000 7fcdd5400640 1 --2- 172.21.15.2:0/584993980 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fcdb806beb0 0x7fcdb806e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:17.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.097+0000 7fcdd5400640 1 --2- 172.21.15.2:0/584993980 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fcdb806beb0 0x7fcdb806e370 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcdd80ce2b0 tx=0x7fcdc8009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:17.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.488+0000 7f2ad6800640 1 -- 172.21.15.2:0/2344908170 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f2ac8047b50 con 0x7f2ac8005ab0 2024-09-10T08:47:17.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.489+0000 7f343a200640 1 -- 172.21.15.2:0/2575719733 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f34340b0d50 con 0x7f343415e360 2024-09-10T08:47:17.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.489+0000 7f2acd600640 1 -- 172.21.15.2:0/2344908170 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2ac40583e0 con 0x7f2ac8005ab0 2024-09-10T08:47:17.495 INFO:teuthology.orchestra.run.smithi002.stdout:55834574857 2024-09-10T08:47:17.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.490+0000 7f3430c00640 1 -- 172.21.15.2:0/2575719733 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f342c058ea0 con 0x7f343415e360 2024-09-10T08:47:17.496 INFO:teuthology.orchestra.run.smithi002.stdout:55834574857 2024-09-10T08:47:17.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.494+0000 7f2ad6800640 1 -- 172.21.15.2:0/2344908170 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f2ab006beb0 msgr2=0x7f2ab006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:17.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.494+0000 7f2ad6800640 1 --2- 172.21.15.2:0/2344908170 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f2ab006beb0 0x7f2ab006e370 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2ad00504d0 tx=0x7f2ad0069a00 comp rx=0 tx=0).stop 2024-09-10T08:47:17.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.494+0000 7f2ad6800640 1 -- 172.21.15.2:0/2344908170 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ac8005ab0 msgr2=0x7f2ac800afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:17.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.494+0000 7f2ad6800640 1 --2- 172.21.15.2:0/2344908170 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ac8005ab0 0x7f2ac800afa0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2ac400c730 tx=0x7f2ac400cb30 comp rx=0 tx=0).stop 2024-09-10T08:47:17.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.494+0000 7f2ad6800640 1 -- 172.21.15.2:0/2344908170 shutdown_connections 2024-09-10T08:47:17.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.494+0000 7f2ad6800640 1 --2- 172.21.15.2:0/2344908170 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f2ab006beb0 0x7f2ab006e370 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.494+0000 7f2ad6800640 1 --2- 172.21.15.2:0/2344908170 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2ac80e7120 0x7f2ac80e9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.494+0000 7f2ad6800640 1 --2- 172.21.15.2:0/2344908170 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ac801dc40 0x7f2ac80e7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.494+0000 7f2ad6800640 1 --2- 172.21.15.2:0/2344908170 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ac8005ab0 0x7f2ac800afa0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.494+0000 7f2ad6800640 1 -- 172.21.15.2:0/2344908170 >> 172.21.15.2:0/2344908170 conn(0x7f2ac8036090 msgr2=0x7f2ac804fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:17.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.494+0000 7f2ad6800640 1 -- 172.21.15.2:0/2344908170 shutdown_connections 2024-09-10T08:47:17.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.494+0000 7f2ad6800640 1 -- 172.21.15.2:0/2344908170 wait complete. 2024-09-10T08:47:17.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.497+0000 7f343a200640 1 -- 172.21.15.2:0/2575719733 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f341406be80 msgr2=0x7f341406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:17.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.497+0000 7f343a200640 1 --2- 172.21.15.2:0/2575719733 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f341406be80 0x7f341406e340 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3420034000 tx=0x7f342002e000 comp rx=0 tx=0).stop 2024-09-10T08:47:17.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.497+0000 7f343a200640 1 -- 172.21.15.2:0/2575719733 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f343415e360 msgr2=0x7f343409cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:17.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.497+0000 7f343a200640 1 --2- 172.21.15.2:0/2575719733 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f343415e360 0x7f343409cc10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f342c00cb30 tx=0x7f342c00a060 comp rx=0 tx=0).stop 2024-09-10T08:47:17.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.498+0000 7f343a200640 1 -- 172.21.15.2:0/2575719733 shutdown_connections 2024-09-10T08:47:17.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.498+0000 7f343a200640 1 --2- 172.21.15.2:0/2575719733 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f343415e360 0x7f343409cc10 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.498+0000 7f343a200640 1 --2- 172.21.15.2:0/2575719733 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34340b38d0 0x7f343415b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.498+0000 7f343a200640 1 --2- 172.21.15.2:0/2575719733 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f341406be80 0x7f341406e340 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.498+0000 7f343a200640 1 --2- 172.21.15.2:0/2575719733 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f34340b2f50 0x7f343415e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.498+0000 7f343a200640 1 -- 172.21.15.2:0/2575719733 >> 172.21.15.2:0/2575719733 conn(0x7f343406bdf0 msgr2=0x7f3434168400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:17.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.498+0000 7f343a200640 1 -- 172.21.15.2:0/2575719733 shutdown_connections 2024-09-10T08:47:17.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.498+0000 7f343a200640 1 -- 172.21.15.2:0/2575719733 wait complete. 2024-09-10T08:47:17.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.502+0000 7f96cb000640 1 -- 172.21.15.2:0/381223815 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f96a0005580 con 0x7f96bc053840 2024-09-10T08:47:17.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.505+0000 7f96b7e00640 1 -- 172.21.15.2:0/381223815 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f96b001f020 con 0x7f96bc053840 2024-09-10T08:47:17.506 INFO:teuthology.orchestra.run.smithi002.stdout:55834574857 2024-09-10T08:47:17.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.507+0000 7f5ab0a00640 1 -- 172.21.15.2:0/2661499424 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f5aac0d44c0 con 0x7f5aac15e770 2024-09-10T08:47:17.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.507+0000 7f5aa2a00640 1 -- 172.21.15.2:0/2661499424 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5aa407a4b0 con 0x7f5aac15e770 2024-09-10T08:47:17.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.510+0000 7f96cb000640 1 -- 172.21.15.2:0/381223815 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f96a4070310 msgr2=0x7f96a40727d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:17.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.510+0000 7f96cb000640 1 --2- 172.21.15.2:0/381223815 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f96a4070310 0x7f96a40727d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f96b8007920 tx=0x7f96b8008040 comp rx=0 tx=0).stop 2024-09-10T08:47:17.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.510+0000 7f96cb000640 1 -- 172.21.15.2:0/381223815 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96bc053840 msgr2=0x7f96bc04a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:17.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.510+0000 7f96cb000640 1 --2- 172.21.15.2:0/381223815 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96bc053840 0x7f96bc04a2e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f96b000b460 tx=0x7f96b000b920 comp rx=0 tx=0).stop 2024-09-10T08:47:17.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.510+0000 7f96cb000640 1 -- 172.21.15.2:0/381223815 shutdown_connections 2024-09-10T08:47:17.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.510+0000 7f96cb000640 1 --2- 172.21.15.2:0/381223815 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f96a4070310 0x7f96a40727d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.510+0000 7f96cb000640 1 --2- 172.21.15.2:0/381223815 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96bc0e0a30 0x7f96bc03a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.510+0000 7f96cb000640 1 --2- 172.21.15.2:0/381223815 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96bc053840 0x7f96bc04a2e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.510+0000 7f96cb000640 1 --2- 172.21.15.2:0/381223815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96bc051f80 0x7f96bc0d6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.510+0000 7f96cb000640 1 -- 172.21.15.2:0/381223815 >> 172.21.15.2:0/381223815 conn(0x7f96bc01fb40 msgr2=0x7f96bc0decf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:17.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.510+0000 7f96cb000640 1 -- 172.21.15.2:0/381223815 shutdown_connections 2024-09-10T08:47:17.513 INFO:teuthology.orchestra.run.smithi002.stdout:55834574857 2024-09-10T08:47:17.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.510+0000 7f96cb000640 1 -- 172.21.15.2:0/381223815 wait complete. 2024-09-10T08:47:17.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.512+0000 7f5ab0a00640 1 -- 172.21.15.2:0/2661499424 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f5a8c06bf00 msgr2=0x7f5a8c06e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:17.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.512+0000 7f5ab0a00640 1 --2- 172.21.15.2:0/2661499424 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f5a8c06bf00 0x7f5a8c06e3c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c0014e0 tx=0x7f5a9c007a40 comp rx=0 tx=0).stop 2024-09-10T08:47:17.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.512+0000 7f5ab0a00640 1 -- 172.21.15.2:0/2661499424 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5aac15e770 msgr2=0x7f5aac160a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:17.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.512+0000 7f5ab0a00640 1 --2- 172.21.15.2:0/2661499424 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5aac15e770 0x7f5aac160a70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5aa4009ee0 tx=0x7f5aa4004a40 comp rx=0 tx=0).stop 2024-09-10T08:47:17.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.513+0000 7f5ab0a00640 1 -- 172.21.15.2:0/2661499424 shutdown_connections 2024-09-10T08:47:17.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.513+0000 7f5ab0a00640 1 --2- 172.21.15.2:0/2661499424 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f5a8c06bf00 0x7f5a8c06e3c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.513+0000 7f5ab0a00640 1 --2- 172.21.15.2:0/2661499424 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5aac15e770 0x7f5aac160a70 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.513+0000 7f5ab0a00640 1 --2- 172.21.15.2:0/2661499424 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5aac0d4a00 0x7f5aac0b8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.513+0000 7f5ab0a00640 1 --2- 172.21.15.2:0/2661499424 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5aac0d2f90 0x7f5aac200d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.513+0000 7f5ab0a00640 1 -- 172.21.15.2:0/2661499424 >> 172.21.15.2:0/2661499424 conn(0x7f5aac08bfd0 msgr2=0x7f5aac0b4ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:17.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.514+0000 7f5ab0a00640 1 -- 172.21.15.2:0/2661499424 shutdown_connections 2024-09-10T08:47:17.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.514+0000 7f5ab0a00640 1 -- 172.21.15.2:0/2661499424 wait complete. 2024-09-10T08:47:17.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.515+0000 7f4155000640 1 -- 172.21.15.2:0/3098957134 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f41500b4680 con 0x7f4150161ca0 2024-09-10T08:47:17.519 INFO:teuthology.orchestra.run.smithi002.stdout:55834574858 2024-09-10T08:47:17.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.516+0000 7f4146000640 1 -- 172.21.15.2:0/3098957134 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4148059510 con 0x7f4150161ca0 2024-09-10T08:47:17.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.518+0000 7fcddd200640 1 -- 172.21.15.2:0/584993980 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fcdd80b1b90 con 0x7fcdd80d2140 2024-09-10T08:47:17.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.518+0000 7fcdce000640 1 -- 172.21.15.2:0/584993980 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fcdd005aa30 con 0x7fcdd80d2140 2024-09-10T08:47:17.523 INFO:teuthology.orchestra.run.smithi002.stdout:55834574857 2024-09-10T08:47:17.523 INFO:teuthology.orchestra.run.smithi002.stdout:55834574858 2024-09-10T08:47:17.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.519+0000 7f8a27400640 1 -- 172.21.15.2:0/4057945637 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f8a200d0fa0 con 0x7f8a200d2b80 2024-09-10T08:47:17.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.520+0000 7f8a1cc00640 1 -- 172.21.15.2:0/4057945637 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8a14059b10 con 0x7f8a200d2b80 2024-09-10T08:47:17.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.520+0000 7f4155000640 1 -- 172.21.15.2:0/3098957134 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f413006bf00 msgr2=0x7f413006e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:17.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.520+0000 7f4155000640 1 --2- 172.21.15.2:0/3098957134 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f413006bf00 0x7f413006e3c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4140033000 tx=0x7f4140009000 comp rx=0 tx=0).stop 2024-09-10T08:47:17.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.520+0000 7f4155000640 1 -- 172.21.15.2:0/3098957134 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4150161ca0 msgr2=0x7f41501f4f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:17.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.520+0000 7f4155000640 1 --2- 172.21.15.2:0/3098957134 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4150161ca0 0x7f41501f4f40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f414800d830 tx=0x7f414800dcf0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.522+0000 7f4155000640 1 -- 172.21.15.2:0/3098957134 shutdown_connections 2024-09-10T08:47:17.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.522+0000 7f4155000640 1 --2- 172.21.15.2:0/3098957134 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f413006bf00 0x7f413006e3c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.522+0000 7f4155000640 1 --2- 172.21.15.2:0/3098957134 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4150161ca0 0x7f41501f4f40 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.522+0000 7f4155000640 1 --2- 172.21.15.2:0/3098957134 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41500d2b60 0x7f41500cac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.522+0000 7f4155000640 1 --2- 172.21.15.2:0/3098957134 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41500cf8c0 0x7f4150158750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.522+0000 7f4155000640 1 -- 172.21.15.2:0/3098957134 >> 172.21.15.2:0/3098957134 conn(0x7f415008bfd0 msgr2=0x7f41500b13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:17.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.522+0000 7fcddd200640 1 -- 172.21.15.2:0/584993980 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fcdb806beb0 msgr2=0x7fcdb806e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:17.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.522+0000 7fcddd200640 1 --2- 172.21.15.2:0/584993980 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fcdb806beb0 0x7fcdb806e370 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcdd80ce2b0 tx=0x7fcdc8009240 comp rx=0 tx=0).stop 2024-09-10T08:47:17.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.522+0000 7fcddd200640 1 -- 172.21.15.2:0/584993980 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcdd80d2140 msgr2=0x7fcdd8151ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:17.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.522+0000 7fcddd200640 1 --2- 172.21.15.2:0/584993980 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcdd80d2140 0x7fcdd8151ea0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fcdd0007e40 tx=0x7fcdd000e4b0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.523+0000 7f4155000640 1 -- 172.21.15.2:0/3098957134 shutdown_connections 2024-09-10T08:47:17.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.523+0000 7fcddd200640 1 -- 172.21.15.2:0/584993980 shutdown_connections 2024-09-10T08:47:17.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.523+0000 7fcddd200640 1 --2- 172.21.15.2:0/584993980 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcdd80cc990 0x7fcdd81582f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.523+0000 7fcddd200640 1 --2- 172.21.15.2:0/584993980 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcdd8161be0 0x7fcdd80cc450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.523+0000 7fcddd200640 1 --2- 172.21.15.2:0/584993980 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fcdb806beb0 0x7fcdb806e370 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.523+0000 7fcddd200640 1 --2- 172.21.15.2:0/584993980 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcdd80d2140 0x7fcdd8151ea0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.523+0000 7fcddd200640 1 -- 172.21.15.2:0/584993980 >> 172.21.15.2:0/584993980 conn(0x7fcdd808bfd0 msgr2=0x7fcdd80b7dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:17.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.523+0000 7f4155000640 1 -- 172.21.15.2:0/3098957134 wait complete. 2024-09-10T08:47:17.530 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.1 2024-09-10T08:47:17.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.523+0000 7fcddd200640 1 -- 172.21.15.2:0/584993980 shutdown_connections 2024-09-10T08:47:17.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.523+0000 7fcddd200640 1 -- 172.21.15.2:0/584993980 wait complete. 2024-09-10T08:47:17.531 DEBUG:teuthology.parallel:result is None 2024-09-10T08:47:17.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.524+0000 7f8a27400640 1 -- 172.21.15.2:0/4057945637 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f8a0006be30 msgr2=0x7f8a0006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:17.532 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.0 2024-09-10T08:47:17.533 DEBUG:teuthology.parallel:result is None 2024-09-10T08:47:17.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.524+0000 7f8a27400640 1 --2- 172.21.15.2:0/4057945637 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f8a0006be30 0x7f8a0006e2f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c007fd0 tx=0x7f8a0c009040 comp rx=0 tx=0).stop 2024-09-10T08:47:17.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.524+0000 7f8a27400640 1 -- 172.21.15.2:0/4057945637 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a200d2b80 msgr2=0x7f8a201e5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:17.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.524+0000 7f8a27400640 1 --2- 172.21.15.2:0/4057945637 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a200d2b80 0x7f8a201e5810 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8a1400d5d0 tx=0x7f8a1400da90 comp rx=0 tx=0).stop 2024-09-10T08:47:17.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.524+0000 7f8a27400640 1 -- 172.21.15.2:0/4057945637 shutdown_connections 2024-09-10T08:47:17.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.524+0000 7f8a27400640 1 --2- 172.21.15.2:0/4057945637 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a200d5100 0x7f8a200b4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.524+0000 7f8a27400640 1 --2- 172.21.15.2:0/4057945637 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8a200d4cb0 0x7f8a200b3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.524+0000 7f8a27400640 1 --2- 172.21.15.2:0/4057945637 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f8a0006be30 0x7f8a0006e2f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.524+0000 7f8a27400640 1 --2- 172.21.15.2:0/4057945637 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a200d2b80 0x7f8a201e5810 secure :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8a1400d5d0 tx=0x7f8a1400da90 comp rx=0 tx=0).stop 2024-09-10T08:47:17.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.524+0000 7f8a27400640 1 -- 172.21.15.2:0/4057945637 >> 172.21.15.2:0/4057945637 conn(0x7f8a2008bfd0 msgr2=0x7f8a200b1170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:17.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.525+0000 7f8a27400640 1 -- 172.21.15.2:0/4057945637 shutdown_connections 2024-09-10T08:47:17.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.525+0000 7f8a27400640 1 -- 172.21.15.2:0/4057945637 wait complete. 2024-09-10T08:47:17.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.529+0000 7f8e6ea00640 1 -- 172.21.15.2:0/2992280537 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f8e680b6040 con 0x7f8e680d2b80 2024-09-10T08:47:17.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.529+0000 7f8e5fe00640 1 -- 172.21.15.2:0/2992280537 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8e5805a4d0 con 0x7f8e680d2b80 2024-09-10T08:47:17.536 INFO:teuthology.orchestra.run.smithi002.stdout:55834574857 2024-09-10T08:47:17.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.533+0000 7f8e6ea00640 1 -- 172.21.15.2:0/2992280537 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f8e4406be80 msgr2=0x7f8e4406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:17.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.533+0000 7f8e6ea00640 1 --2- 172.21.15.2:0/2992280537 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f8e4406be80 0x7f8e4406e340 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8e680c8120 tx=0x7f8e50009040 comp rx=0 tx=0).stop 2024-09-10T08:47:17.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.533+0000 7f8e6ea00640 1 -- 172.21.15.2:0/2992280537 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e680d2b80 msgr2=0x7f8e680b8900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:17.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.533+0000 7f8e6ea00640 1 --2- 172.21.15.2:0/2992280537 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e680d2b80 0x7f8e680b8900 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8e5800cd80 tx=0x7f8e5800a650 comp rx=0 tx=0).stop 2024-09-10T08:47:17.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.533+0000 7f8e6ea00640 1 -- 172.21.15.2:0/2992280537 shutdown_connections 2024-09-10T08:47:17.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.533+0000 7f8e6ea00640 1 --2- 172.21.15.2:0/2992280537 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e680d5100 0x7f8e681e54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.533+0000 7f8e6ea00640 1 --2- 172.21.15.2:0/2992280537 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f8e4406be80 0x7f8e4406e340 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.533+0000 7f8e6ea00640 1 --2- 172.21.15.2:0/2992280537 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8e680d4cb0 0x7f8e680b5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.533+0000 7f8e6ea00640 1 --2- 172.21.15.2:0/2992280537 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e680d2b80 0x7f8e680b8900 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.533+0000 7f8e6ea00640 1 -- 172.21.15.2:0/2992280537 >> 172.21.15.2:0/2992280537 conn(0x7f8e6808bfd0 msgr2=0x7f8e680cc8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:17.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.534+0000 7f8e6ea00640 1 -- 172.21.15.2:0/2992280537 shutdown_connections 2024-09-10T08:47:17.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.534+0000 7f8e6ea00640 1 -- 172.21.15.2:0/2992280537 wait complete. 2024-09-10T08:47:17.539 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.3 2024-09-10T08:47:17.540 DEBUG:teuthology.parallel:result is None 2024-09-10T08:47:17.543 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.2 2024-09-10T08:47:17.543 DEBUG:teuthology.parallel:result is None 2024-09-10T08:47:17.550 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.4 2024-09-10T08:47:17.550 DEBUG:teuthology.parallel:result is None 2024-09-10T08:47:17.551 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.5 2024-09-10T08:47:17.551 DEBUG:teuthology.parallel:result is None 2024-09-10T08:47:17.555 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.6 2024-09-10T08:47:17.555 DEBUG:teuthology.parallel:result is None 2024-09-10T08:47:17.556 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.7 2024-09-10T08:47:17.556 DEBUG:teuthology.parallel:result is None 2024-09-10T08:47:17.556 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T08:47:17.557 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:47:17.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.752+0000 7f4f9b800640 1 Processor -- start 2024-09-10T08:47:17.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.752+0000 7f4f9b800640 1 -- start start 2024-09-10T08:47:17.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.753+0000 7f4f9b800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4f94145d20 0x7f4f9415c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:17.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.753+0000 7f4f9b800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f940cd460 0x7f4f94160980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:17.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.753+0000 7f4f9b800640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f9406e4d0 con 0x7f4f9406df80 2024-09-10T08:47:17.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.754+0000 7f4f9b800640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f4f94146100 con 0x7f4f94145d20 2024-09-10T08:47:17.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.754+0000 7f4f9b800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4f94160ec0 con 0x7f4f940cd460 2024-09-10T08:47:17.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.754+0000 7f4f98e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4f94145d20 0x7f4f9415c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:17.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.754+0000 7f4f98e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4f94145d20 0x7f4f9415c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51160/0 (socket says 172.21.15.2:51160) 2024-09-10T08:47:17.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.754+0000 7f4f98e00640 1 -- 172.21.15.2:0/1278951565 learned_addr learned my addr 172.21.15.2:0/1278951565 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:17.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.754+0000 7f4f93e00640 1 --1- 172.21.15.2:0/1278951565 >> v1:172.21.15.2:6789/0 conn(0x7f4f9406df80 0x7f4f940ccd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48440/0 (socket says 172.21.15.2:48440) 2024-09-10T08:47:17.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.754+0000 7f4f99800640 1 --2- 172.21.15.2:0/1278951565 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f940cd460 0x7f4f94160980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:17.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.754+0000 7f4f98e00640 1 -- 172.21.15.2:0/1278951565 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f940cd460 msgr2=0x7f4f94160980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:17.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.754+0000 7f4f98e00640 1 --2- 172.21.15.2:0/1278951565 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f940cd460 0x7f4f94160980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.754+0000 7f4f98e00640 1 -- 172.21.15.2:0/1278951565 >> v1:172.21.15.2:6789/0 conn(0x7f4f9406df80 legacy=0x7f4f940ccd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:17.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.754+0000 7f4f98e00640 1 -- 172.21.15.2:0/1278951565 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f9406e7b0 con 0x7f4f94145d20 2024-09-10T08:47:17.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.754+0000 7f4f93400640 1 -- 172.21.15.2:0/1278951565 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1658193322 0 0) 0x7f4f9406e4d0 con 0x7f4f9406df80 2024-09-10T08:47:17.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.755+0000 7f4f98e00640 1 --2- 172.21.15.2:0/1278951565 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f94145d20 0x7f4f9415c9e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4f880098a0 tx=0x7f4f8802a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=912b8507bba9ecc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:17.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.755+0000 7f4f93400640 1 -- 172.21.15.2:0/1278951565 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f88037070 con 0x7f4f94145d20 2024-09-10T08:47:17.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.755+0000 7f4f93400640 1 -- 172.21.15.2:0/1278951565 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f88032440 con 0x7f4f94145d20 2024-09-10T08:47:17.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.755+0000 7f4f93400640 1 -- 172.21.15.2:0/1278951565 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f88032810 con 0x7f4f94145d20 2024-09-10T08:47:17.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.756+0000 7f4f9b800640 1 -- 172.21.15.2:0/1278951565 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f94145d20 msgr2=0x7f4f9415c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:17.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.756+0000 7f4f9b800640 1 --2- 172.21.15.2:0/1278951565 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f94145d20 0x7f4f9415c9e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4f880098a0 tx=0x7f4f8802a160 comp rx=0 tx=0).stop 2024-09-10T08:47:17.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.756+0000 7f4f9b800640 1 -- 172.21.15.2:0/1278951565 shutdown_connections 2024-09-10T08:47:17.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.756+0000 7f4f9b800640 1 --2- 172.21.15.2:0/1278951565 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f940cd460 0x7f4f94160980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.756+0000 7f4f9b800640 1 --2- 172.21.15.2:0/1278951565 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f94145d20 0x7f4f9415c9e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.756+0000 7f4f9b800640 1 -- 172.21.15.2:0/1278951565 >> 172.21.15.2:0/1278951565 conn(0x7f4f9406bc10 msgr2=0x7f4f9406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:17.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.756+0000 7f4f9b800640 1 -- 172.21.15.2:0/1278951565 shutdown_connections 2024-09-10T08:47:17.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.756+0000 7f4f9b800640 1 -- 172.21.15.2:0/1278951565 wait complete. 2024-09-10T08:47:17.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.758+0000 7f4f9b800640 1 Processor -- start 2024-09-10T08:47:17.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.758+0000 7f4f9b800640 1 -- start start 2024-09-10T08:47:17.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.759+0000 7f4f9b800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f9406df80 0x7f4f9413d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:17.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.759+0000 7f4f9b800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f940cd460 0x7f4f9415f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:17.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.759+0000 7f4f9b800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f94145d20 0x7f4f9415f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:17.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.759+0000 7f4f9b800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4f9406ed70 con 0x7f4f940cd460 2024-09-10T08:47:17.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.759+0000 7f4f9b800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4f940ce6b0 con 0x7f4f9406df80 2024-09-10T08:47:17.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.759+0000 7f4f9b800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4f940ceb40 con 0x7f4f94145d20 2024-09-10T08:47:17.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.759+0000 7f4f93e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f940cd460 0x7f4f9415f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:17.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.759+0000 7f4f93e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f940cd460 0x7f4f9415f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51164/0 (socket says 172.21.15.2:51164) 2024-09-10T08:47:17.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.759+0000 7f4f93e00640 1 -- 172.21.15.2:0/3790721967 learned_addr learned my addr 172.21.15.2:0/3790721967 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:17.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.759+0000 7f4f98e00640 1 --2- 172.21.15.2:0/3790721967 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f9406df80 0x7f4f9413d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:17.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.759+0000 7f4f99800640 1 --2- 172.21.15.2:0/3790721967 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f94145d20 0x7f4f9415f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:17.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.759+0000 7f4f93e00640 1 -- 172.21.15.2:0/3790721967 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f94145d20 msgr2=0x7f4f9415f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:17.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.759+0000 7f4f93e00640 1 --2- 172.21.15.2:0/3790721967 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f94145d20 0x7f4f9415f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.759+0000 7f4f93e00640 1 -- 172.21.15.2:0/3790721967 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f9406df80 msgr2=0x7f4f9413d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:17.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.759+0000 7f4f93e00640 1 --2- 172.21.15.2:0/3790721967 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f9406df80 0x7f4f9413d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.759+0000 7f4f93e00640 1 -- 172.21.15.2:0/3790721967 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f941f7ac0 con 0x7f4f940cd460 2024-09-10T08:47:17.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.759+0000 7f4f99800640 1 --2- 172.21.15.2:0/3790721967 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f94145d20 0x7f4f9415f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:47:17.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.760+0000 7f4f93e00640 1 --2- 172.21.15.2:0/3790721967 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f940cd460 0x7f4f9415f490 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4f8000c4d0 tx=0x7f4f8000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:17.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.760+0000 7f4f90c00640 1 -- 172.21.15.2:0/3790721967 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f80018070 con 0x7f4f940cd460 2024-09-10T08:47:17.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.760+0000 7f4f90c00640 1 -- 172.21.15.2:0/3790721967 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f80007500 con 0x7f4f940cd460 2024-09-10T08:47:17.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.760+0000 7f4f90c00640 1 -- 172.21.15.2:0/3790721967 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f80004a20 con 0x7f4f940cd460 2024-09-10T08:47:17.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.760+0000 7f4f9b800640 1 -- 172.21.15.2:0/3790721967 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f941f7da0 con 0x7f4f940cd460 2024-09-10T08:47:17.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.760+0000 7f4f9b800640 1 -- 172.21.15.2:0/3790721967 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f941f8360 con 0x7f4f940cd460 2024-09-10T08:47:17.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.761+0000 7f4f9b800640 1 -- 172.21.15.2:0/3790721967 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f94068480 con 0x7f4f940cd460 2024-09-10T08:47:17.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.762+0000 7f4f90c00640 1 -- 172.21.15.2:0/3790721967 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4f8001b070 con 0x7f4f940cd460 2024-09-10T08:47:17.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.763+0000 7f4f90c00640 1 --2- 172.21.15.2:0/3790721967 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f4f7406be30 0x7f4f7406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:17.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.763+0000 7f4f90c00640 1 -- 172.21.15.2:0/3790721967 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f4f8008a410 con 0x7f4f940cd460 2024-09-10T08:47:17.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.763+0000 7f4f98e00640 1 --2- 172.21.15.2:0/3790721967 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f4f7406be30 0x7f4f7406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:17.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.764+0000 7f4f98e00640 1 --2- 172.21.15.2:0/3790721967 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f4f7406be30 0x7f4f7406e2f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4f88034000 tx=0x7f4f8802e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:17.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.767+0000 7f4f90c00640 1 -- 172.21.15.2:0/3790721967 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4f94068480 con 0x7f4f940cd460 2024-09-10T08:47:17.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.949+0000 7f4f9b800640 1 -- 172.21.15.2:0/3790721967 --> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4f94140520 con 0x7f4f7406be30 2024-09-10T08:47:17.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.958+0000 7f4f90c00640 1 -- 172.21.15.2:0/3790721967 <== mgr.4099 v2:172.21.15.155:6832/2611418382 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332531 (secure 0 0 0) 0x7f4f94140520 con 0x7f4f7406be30 2024-09-10T08:47:17.963 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:47:17.965 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-10T08:47:17.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.963+0000 7f4f9b800640 1 -- 172.21.15.2:0/3790721967 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f4f7406be30 msgr2=0x7f4f7406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:17.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.963+0000 7f4f9b800640 1 --2- 172.21.15.2:0/3790721967 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f4f7406be30 0x7f4f7406e2f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4f88034000 tx=0x7f4f8802e000 comp rx=0 tx=0).stop 2024-09-10T08:47:17.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.963+0000 7f4f9b800640 1 -- 172.21.15.2:0/3790721967 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f940cd460 msgr2=0x7f4f9415f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:17.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.963+0000 7f4f9b800640 1 --2- 172.21.15.2:0/3790721967 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f940cd460 0x7f4f9415f490 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4f8000c4d0 tx=0x7f4f8000c990 comp rx=0 tx=0).stop 2024-09-10T08:47:17.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.963+0000 7f4f9b800640 1 -- 172.21.15.2:0/3790721967 shutdown_connections 2024-09-10T08:47:17.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.963+0000 7f4f9b800640 1 --2- 172.21.15.2:0/3790721967 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f4f7406be30 0x7f4f7406e2f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.963+0000 7f4f9b800640 1 --2- 172.21.15.2:0/3790721967 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f94145d20 0x7f4f9415f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.963+0000 7f4f9b800640 1 --2- 172.21.15.2:0/3790721967 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f940cd460 0x7f4f9415f490 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.963+0000 7f4f9b800640 1 --2- 172.21.15.2:0/3790721967 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f9406df80 0x7f4f9413d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:17.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.963+0000 7f4f9b800640 1 -- 172.21.15.2:0/3790721967 >> 172.21.15.2:0/3790721967 conn(0x7f4f9406bc10 msgr2=0x7f4f940b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:17.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.963+0000 7f4f9b800640 1 -- 172.21.15.2:0/3790721967 shutdown_connections 2024-09-10T08:47:17.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:17.963+0000 7f4f9b800640 1 -- 172.21.15.2:0/3790721967 wait complete. 2024-09-10T08:47:17.979 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-09-10T08:47:17.378049+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595010,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231916,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754742804,"statfs":{"total":773094113280,"available":772856631296,"internally_reserved":0,"allocated":3284992,"data_stored":1992068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":234016304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003877"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.569663+0000","last_change":"2024-09-10T08:46:50.757068+0000","last_active":"2024-09-10T08:46:57.569663+0000","last_peered":"2024-09-10T08:46:57.569663+0000","last_clean":"2024-09-10T08:46:57.569663+0000","last_became_active":"2024-09-10T08:46:50.754880+0000","last_became_peered":"2024-09-10T08:46:50.754880+0000","last_unstale":"2024-09-10T08:46:57.569663+0000","last_undegraded":"2024-09-10T08:46:57.569663+0000","last_fullsized":"2024-09-10T08:46:57.569663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:56:12.627990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.084163+0000","last_change":"2024-09-10T08:46:51.773476+0000","last_active":"2024-09-10T08:46:58.084163+0000","last_peered":"2024-09-10T08:46:58.084163+0000","last_clean":"2024-09-10T08:46:58.084163+0000","last_became_active":"2024-09-10T08:46:51.773221+0000","last_became_peered":"2024-09-10T08:46:51.773221+0000","last_unstale":"2024-09-10T08:46:58.084163+0000","last_undegraded":"2024-09-10T08:46:58.084163+0000","last_fullsized":"2024-09-10T08:46:58.084163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:24.242861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082454+0000","last_change":"2024-09-10T08:46:55.882294+0000","last_active":"2024-09-10T08:46:58.082454+0000","last_peered":"2024-09-10T08:46:58.082454+0000","last_clean":"2024-09-10T08:46:58.082454+0000","last_became_active":"2024-09-10T08:46:55.881924+0000","last_became_peered":"2024-09-10T08:46:55.881924+0000","last_unstale":"2024-09-10T08:46:58.082454+0000","last_undegraded":"2024-09-10T08:46:58.082454+0000","last_fullsized":"2024-09-10T08:46:58.082454+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:09:55.956737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.084247+0000","last_change":"2024-09-10T08:46:50.763493+0000","last_active":"2024-09-10T08:46:58.084247+0000","last_peered":"2024-09-10T08:46:58.084247+0000","last_clean":"2024-09-10T08:46:58.084247+0000","last_became_active":"2024-09-10T08:46:50.761280+0000","last_became_peered":"2024-09-10T08:46:50.761280+0000","last_unstale":"2024-09-10T08:46:58.084247+0000","last_undegraded":"2024-09-10T08:46:58.084247+0000","last_fullsized":"2024-09-10T08:46:58.084247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:38:26.709117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.569396+0000","last_change":"2024-09-10T08:46:51.794099+0000","last_active":"2024-09-10T08:46:57.569396+0000","last_peered":"2024-09-10T08:46:57.569396+0000","last_clean":"2024-09-10T08:46:57.569396+0000","last_became_active":"2024-09-10T08:46:51.793831+0000","last_became_peered":"2024-09-10T08:46:51.793831+0000","last_unstale":"2024-09-10T08:46:57.569396+0000","last_undegraded":"2024-09-10T08:46:57.569396+0000","last_fullsized":"2024-09-10T08:46:57.569396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:17:48.493127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.805298+0000","last_change":"2024-09-10T08:46:55.835850+0000","last_active":"2024-09-10T08:46:56.805298+0000","last_peered":"2024-09-10T08:46:56.805298+0000","last_clean":"2024-09-10T08:46:56.805298+0000","last_became_active":"2024-09-10T08:46:55.834778+0000","last_became_peered":"2024-09-10T08:46:55.834778+0000","last_unstale":"2024-09-10T08:46:56.805298+0000","last_undegraded":"2024-09-10T08:46:56.805298+0000","last_fullsized":"2024-09-10T08:46:56.805298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:17:52.547720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.962530+0000","last_change":"2024-09-10T08:46:50.762150+0000","last_active":"2024-09-10T08:46:57.962530+0000","last_peered":"2024-09-10T08:46:57.962530+0000","last_clean":"2024-09-10T08:46:57.962530+0000","last_became_active":"2024-09-10T08:46:50.761706+0000","last_became_peered":"2024-09-10T08:46:50.761706+0000","last_unstale":"2024-09-10T08:46:57.962530+0000","last_undegraded":"2024-09-10T08:46:57.962530+0000","last_fullsized":"2024-09-10T08:46:57.962530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:23:06.043116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082889+0000","last_change":"2024-09-10T08:46:51.795776+0000","last_active":"2024-09-10T08:46:58.082889+0000","last_peered":"2024-09-10T08:46:58.082889+0000","last_clean":"2024-09-10T08:46:58.082889+0000","last_became_active":"2024-09-10T08:46:51.795503+0000","last_became_peered":"2024-09-10T08:46:51.795503+0000","last_unstale":"2024-09-10T08:46:58.082889+0000","last_undegraded":"2024-09-10T08:46:58.082889+0000","last_fullsized":"2024-09-10T08:46:58.082889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:17:50.559065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.806427+0000","last_change":"2024-09-10T08:46:55.836120+0000","last_active":"2024-09-10T08:46:56.806427+0000","last_peered":"2024-09-10T08:46:56.806427+0000","last_clean":"2024-09-10T08:46:56.806427+0000","last_became_active":"2024-09-10T08:46:55.834616+0000","last_became_peered":"2024-09-10T08:46:55.834616+0000","last_unstale":"2024-09-10T08:46:56.806427+0000","last_undegraded":"2024-09-10T08:46:56.806427+0000","last_fullsized":"2024-09-10T08:46:56.806427+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:02.411540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.962107+0000","last_change":"2024-09-10T08:46:50.775708+0000","last_active":"2024-09-10T08:46:57.962107+0000","last_peered":"2024-09-10T08:46:57.962107+0000","last_clean":"2024-09-10T08:46:57.962107+0000","last_became_active":"2024-09-10T08:46:50.775448+0000","last_became_peered":"2024-09-10T08:46:50.775448+0000","last_unstale":"2024-09-10T08:46:57.962107+0000","last_undegraded":"2024-09-10T08:46:57.962107+0000","last_fullsized":"2024-09-10T08:46:57.962107+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:27:43.187268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083129+0000","last_change":"2024-09-10T08:46:51.791061+0000","last_active":"2024-09-10T08:46:58.083129+0000","last_peered":"2024-09-10T08:46:58.083129+0000","last_clean":"2024-09-10T08:46:58.083129+0000","last_became_active":"2024-09-10T08:46:51.790526+0000","last_became_peered":"2024-09-10T08:46:51.790526+0000","last_unstale":"2024-09-10T08:46:58.083129+0000","last_undegraded":"2024-09-10T08:46:58.083129+0000","last_fullsized":"2024-09-10T08:46:58.083129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:48:03.814114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.805699+0000","last_change":"2024-09-10T08:46:55.823814+0000","last_active":"2024-09-10T08:46:56.805699+0000","last_peered":"2024-09-10T08:46:56.805699+0000","last_clean":"2024-09-10T08:46:56.805699+0000","last_became_active":"2024-09-10T08:46:55.823335+0000","last_became_peered":"2024-09-10T08:46:55.823335+0000","last_unstale":"2024-09-10T08:46:56.805699+0000","last_undegraded":"2024-09-10T08:46:56.805699+0000","last_fullsized":"2024-09-10T08:46:56.805699+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:41:12.315749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.805058+0000","last_change":"2024-09-10T08:46:51.781024+0000","last_active":"2024-09-10T08:46:56.805058+0000","last_peered":"2024-09-10T08:46:56.805058+0000","last_clean":"2024-09-10T08:46:56.805058+0000","last_became_active":"2024-09-10T08:46:51.780735+0000","last_became_peered":"2024-09-10T08:46:51.780735+0000","last_unstale":"2024-09-10T08:46:56.805058+0000","last_undegraded":"2024-09-10T08:46:56.805058+0000","last_fullsized":"2024-09-10T08:46:56.805058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:49:28.950554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.962318+0000","last_change":"2024-09-10T08:46:50.772598+0000","last_active":"2024-09-10T08:46:57.962318+0000","last_peered":"2024-09-10T08:46:57.962318+0000","last_clean":"2024-09-10T08:46:57.962318+0000","last_became_active":"2024-09-10T08:46:50.770687+0000","last_became_peered":"2024-09-10T08:46:50.770687+0000","last_unstale":"2024-09-10T08:46:57.962318+0000","last_undegraded":"2024-09-10T08:46:57.962318+0000","last_fullsized":"2024-09-10T08:46:57.962318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:55.305892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.806573+0000","last_change":"2024-09-10T08:46:55.831028+0000","last_active":"2024-09-10T08:46:56.806573+0000","last_peered":"2024-09-10T08:46:56.806573+0000","last_clean":"2024-09-10T08:46:56.806573+0000","last_became_active":"2024-09-10T08:46:55.830439+0000","last_became_peered":"2024-09-10T08:46:55.830439+0000","last_unstale":"2024-09-10T08:46:56.806573+0000","last_undegraded":"2024-09-10T08:46:56.806573+0000","last_fullsized":"2024-09-10T08:46:56.806573+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:17:54.613658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082547+0000","last_change":"2024-09-10T08:46:51.781312+0000","last_active":"2024-09-10T08:46:58.082547+0000","last_peered":"2024-09-10T08:46:58.082547+0000","last_clean":"2024-09-10T08:46:58.082547+0000","last_became_active":"2024-09-10T08:46:51.779810+0000","last_became_peered":"2024-09-10T08:46:51.779810+0000","last_unstale":"2024-09-10T08:46:58.082547+0000","last_undegraded":"2024-09-10T08:46:58.082547+0000","last_fullsized":"2024-09-10T08:46:58.082547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:55:01.331346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083271+0000","last_change":"2024-09-10T08:46:50.766807+0000","last_active":"2024-09-10T08:46:58.083271+0000","last_peered":"2024-09-10T08:46:58.083271+0000","last_clean":"2024-09-10T08:46:58.083271+0000","last_became_active":"2024-09-10T08:46:50.766511+0000","last_became_peered":"2024-09-10T08:46:50.766511+0000","last_unstale":"2024-09-10T08:46:58.083271+0000","last_undegraded":"2024-09-10T08:46:58.083271+0000","last_fullsized":"2024-09-10T08:46:58.083271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:02:43.005946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.805396+0000","last_change":"2024-09-10T08:46:55.835018+0000","last_active":"2024-09-10T08:46:56.805396+0000","last_peered":"2024-09-10T08:46:56.805396+0000","last_clean":"2024-09-10T08:46:56.805396+0000","last_became_active":"2024-09-10T08:46:55.834507+0000","last_became_peered":"2024-09-10T08:46:55.834507+0000","last_unstale":"2024-09-10T08:46:56.805396+0000","last_undegraded":"2024-09-10T08:46:56.805396+0000","last_fullsized":"2024-09-10T08:46:56.805396+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:12:33.767988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082297+0000","last_change":"2024-09-10T08:46:51.771494+0000","last_active":"2024-09-10T08:46:58.082297+0000","last_peered":"2024-09-10T08:46:58.082297+0000","last_clean":"2024-09-10T08:46:58.082297+0000","last_became_active":"2024-09-10T08:46:51.771158+0000","last_became_peered":"2024-09-10T08:46:51.771158+0000","last_unstale":"2024-09-10T08:46:58.082297+0000","last_undegraded":"2024-09-10T08:46:58.082297+0000","last_fullsized":"2024-09-10T08:46:58.082297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:41:08.261156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082874+0000","last_change":"2024-09-10T08:46:50.767844+0000","last_active":"2024-09-10T08:46:58.082874+0000","last_peered":"2024-09-10T08:46:58.082874+0000","last_clean":"2024-09-10T08:46:58.082874+0000","last_became_active":"2024-09-10T08:46:50.767532+0000","last_became_peered":"2024-09-10T08:46:50.767532+0000","last_unstale":"2024-09-10T08:46:58.082874+0000","last_undegraded":"2024-09-10T08:46:58.082874+0000","last_fullsized":"2024-09-10T08:46:58.082874+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:55.305892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083798+0000","last_change":"2024-09-10T08:46:55.881275+0000","last_active":"2024-09-10T08:46:58.083798+0000","last_peered":"2024-09-10T08:46:58.083798+0000","last_clean":"2024-09-10T08:46:58.083798+0000","last_became_active":"2024-09-10T08:46:55.880859+0000","last_became_peered":"2024-09-10T08:46:55.880859+0000","last_unstale":"2024-09-10T08:46:58.083798+0000","last_undegraded":"2024-09-10T08:46:58.083798+0000","last_fullsized":"2024-09-10T08:46:58.083798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:32:51.937086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.806377+0000","last_change":"2024-09-10T08:46:51.768270+0000","last_active":"2024-09-10T08:46:56.806377+0000","last_peered":"2024-09-10T08:46:56.806377+0000","last_clean":"2024-09-10T08:46:56.806377+0000","last_became_active":"2024-09-10T08:46:51.767974+0000","last_became_peered":"2024-09-10T08:46:51.767974+0000","last_unstale":"2024-09-10T08:46:56.806377+0000","last_undegraded":"2024-09-10T08:46:56.806377+0000","last_fullsized":"2024-09-10T08:46:56.806377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:13:17.725125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.961838+0000","last_change":"2024-09-10T08:46:50.768755+0000","last_active":"2024-09-10T08:46:57.961838+0000","last_peered":"2024-09-10T08:46:57.961838+0000","last_clean":"2024-09-10T08:46:57.961838+0000","last_became_active":"2024-09-10T08:46:50.768090+0000","last_became_peered":"2024-09-10T08:46:50.768090+0000","last_unstale":"2024-09-10T08:46:57.961838+0000","last_undegraded":"2024-09-10T08:46:57.961838+0000","last_fullsized":"2024-09-10T08:46:57.961838+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:13:16.717444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.806723+0000","last_change":"2024-09-10T08:46:55.823983+0000","last_active":"2024-09-10T08:46:56.806723+0000","last_peered":"2024-09-10T08:46:56.806723+0000","last_clean":"2024-09-10T08:46:56.806723+0000","last_became_active":"2024-09-10T08:46:55.823590+0000","last_became_peered":"2024-09-10T08:46:55.823590+0000","last_unstale":"2024-09-10T08:46:56.806723+0000","last_undegraded":"2024-09-10T08:46:56.806723+0000","last_fullsized":"2024-09-10T08:46:56.806723+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:48:07.868707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.569487+0000","last_change":"2024-09-10T08:46:51.776329+0000","last_active":"2024-09-10T08:46:57.569487+0000","last_peered":"2024-09-10T08:46:57.569487+0000","last_clean":"2024-09-10T08:46:57.569487+0000","last_became_active":"2024-09-10T08:46:51.775407+0000","last_became_peered":"2024-09-10T08:46:51.775407+0000","last_unstale":"2024-09-10T08:46:57.569487+0000","last_undegraded":"2024-09-10T08:46:57.569487+0000","last_fullsized":"2024-09-10T08:46:57.569487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:56:12.749632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.807054+0000","last_change":"2024-09-10T08:46:50.756330+0000","last_active":"2024-09-10T08:46:56.807054+0000","last_peered":"2024-09-10T08:46:56.807054+0000","last_clean":"2024-09-10T08:46:56.807054+0000","last_became_active":"2024-09-10T08:46:50.755912+0000","last_became_peered":"2024-09-10T08:46:50.755912+0000","last_unstale":"2024-09-10T08:46:56.807054+0000","last_undegraded":"2024-09-10T08:46:56.807054+0000","last_fullsized":"2024-09-10T08:46:56.807054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:13:16.717444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.806363+0000","last_change":"2024-09-10T08:46:55.881993+0000","last_active":"2024-09-10T08:46:56.806363+0000","last_peered":"2024-09-10T08:46:56.806363+0000","last_clean":"2024-09-10T08:46:56.806363+0000","last_became_active":"2024-09-10T08:46:55.881654+0000","last_became_peered":"2024-09-10T08:46:55.881654+0000","last_unstale":"2024-09-10T08:46:56.806363+0000","last_undegraded":"2024-09-10T08:46:56.806363+0000","last_fullsized":"2024-09-10T08:46:56.806363+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:28.652609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.084400+0000","last_change":"2024-09-10T08:46:51.791470+0000","last_active":"2024-09-10T08:46:58.084400+0000","last_peered":"2024-09-10T08:46:58.084400+0000","last_clean":"2024-09-10T08:46:58.084400+0000","last_became_active":"2024-09-10T08:46:51.789315+0000","last_became_peered":"2024-09-10T08:46:51.789315+0000","last_unstale":"2024-09-10T08:46:58.084400+0000","last_undegraded":"2024-09-10T08:46:58.084400+0000","last_fullsized":"2024-09-10T08:46:58.084400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:35:58.356947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083695+0000","last_change":"2024-09-10T08:46:50.763200+0000","last_active":"2024-09-10T08:46:58.083695+0000","last_peered":"2024-09-10T08:46:58.083695+0000","last_clean":"2024-09-10T08:46:58.083695+0000","last_became_active":"2024-09-10T08:46:50.761919+0000","last_became_peered":"2024-09-10T08:46:50.761919+0000","last_unstale":"2024-09-10T08:46:58.083695+0000","last_undegraded":"2024-09-10T08:46:58.083695+0000","last_fullsized":"2024-09-10T08:46:58.083695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:27:43.187268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082087+0000","last_change":"2024-09-10T08:46:55.879120+0000","last_active":"2024-09-10T08:46:58.082087+0000","last_peered":"2024-09-10T08:46:58.082087+0000","last_clean":"2024-09-10T08:46:58.082087+0000","last_became_active":"2024-09-10T08:46:55.878150+0000","last_became_peered":"2024-09-10T08:46:55.878150+0000","last_unstale":"2024-09-10T08:46:58.082087+0000","last_undegraded":"2024-09-10T08:46:58.082087+0000","last_fullsized":"2024-09-10T08:46:58.082087+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:49:07.750480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083493+0000","last_change":"2024-09-10T08:46:51.764062+0000","last_active":"2024-09-10T08:46:58.083493+0000","last_peered":"2024-09-10T08:46:58.083493+0000","last_clean":"2024-09-10T08:46:58.083493+0000","last_became_active":"2024-09-10T08:46:51.763032+0000","last_became_peered":"2024-09-10T08:46:51.763032+0000","last_unstale":"2024-09-10T08:46:58.083493+0000","last_undegraded":"2024-09-10T08:46:58.083493+0000","last_fullsized":"2024-09-10T08:46:58.083493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:12:29.713395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.962641+0000","last_change":"2024-09-10T08:46:50.774433+0000","last_active":"2024-09-10T08:46:57.962641+0000","last_peered":"2024-09-10T08:46:57.962641+0000","last_clean":"2024-09-10T08:46:57.962641+0000","last_became_active":"2024-09-10T08:46:50.774032+0000","last_became_peered":"2024-09-10T08:46:50.774032+0000","last_unstale":"2024-09-10T08:46:57.962641+0000","last_undegraded":"2024-09-10T08:46:57.962641+0000","last_fullsized":"2024-09-10T08:46:57.962641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:20:23.136708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.569437+0000","last_change":"2024-09-10T08:46:55.884303+0000","last_active":"2024-09-10T08:46:57.569437+0000","last_peered":"2024-09-10T08:46:57.569437+0000","last_clean":"2024-09-10T08:46:57.569437+0000","last_became_active":"2024-09-10T08:46:55.880606+0000","last_became_peered":"2024-09-10T08:46:55.880606+0000","last_unstale":"2024-09-10T08:46:57.569437+0000","last_undegraded":"2024-09-10T08:46:57.569437+0000","last_fullsized":"2024-09-10T08:46:57.569437+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:28.966981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083135+0000","last_change":"2024-09-10T08:46:51.782882+0000","last_active":"2024-09-10T08:46:58.083135+0000","last_peered":"2024-09-10T08:46:58.083135+0000","last_clean":"2024-09-10T08:46:58.083135+0000","last_became_active":"2024-09-10T08:46:51.782618+0000","last_became_peered":"2024-09-10T08:46:51.782618+0000","last_unstale":"2024-09-10T08:46:58.083135+0000","last_undegraded":"2024-09-10T08:46:58.083135+0000","last_fullsized":"2024-09-10T08:46:58.083135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:53:54.788208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083587+0000","last_change":"2024-09-10T08:46:50.771532+0000","last_active":"2024-09-10T08:46:58.083587+0000","last_peered":"2024-09-10T08:46:58.083587+0000","last_clean":"2024-09-10T08:46:58.083587+0000","last_became_active":"2024-09-10T08:46:50.771211+0000","last_became_peered":"2024-09-10T08:46:50.771211+0000","last_unstale":"2024-09-10T08:46:58.083587+0000","last_undegraded":"2024-09-10T08:46:58.083587+0000","last_fullsized":"2024-09-10T08:46:58.083587+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:23:06.043116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083105+0000","last_change":"2024-09-10T08:46:55.833301+0000","last_active":"2024-09-10T08:46:58.083105+0000","last_peered":"2024-09-10T08:46:58.083105+0000","last_clean":"2024-09-10T08:46:58.083105+0000","last_became_active":"2024-09-10T08:46:55.832778+0000","last_became_peered":"2024-09-10T08:46:55.832778+0000","last_unstale":"2024-09-10T08:46:58.083105+0000","last_undegraded":"2024-09-10T08:46:58.083105+0000","last_fullsized":"2024-09-10T08:46:58.083105+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:38:27.475264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.806724+0000","last_change":"2024-09-10T08:46:51.773996+0000","last_active":"2024-09-10T08:46:56.806724+0000","last_peered":"2024-09-10T08:46:56.806724+0000","last_clean":"2024-09-10T08:46:56.806724+0000","last_became_active":"2024-09-10T08:46:51.773689+0000","last_became_peered":"2024-09-10T08:46:51.773689+0000","last_unstale":"2024-09-10T08:46:56.806724+0000","last_undegraded":"2024-09-10T08:46:56.806724+0000","last_fullsized":"2024-09-10T08:46:56.806724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:27:44.194949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083163+0000","last_change":"2024-09-10T08:46:50.769707+0000","last_active":"2024-09-10T08:46:58.083163+0000","last_peered":"2024-09-10T08:46:58.083163+0000","last_clean":"2024-09-10T08:46:58.083163+0000","last_became_active":"2024-09-10T08:46:50.769431+0000","last_became_peered":"2024-09-10T08:46:50.769431+0000","last_unstale":"2024-09-10T08:46:58.083163+0000","last_undegraded":"2024-09-10T08:46:58.083163+0000","last_fullsized":"2024-09-10T08:46:58.083163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:38:26.709117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083580+0000","last_change":"2024-09-10T08:46:55.825975+0000","last_active":"2024-09-10T08:46:58.083580+0000","last_peered":"2024-09-10T08:46:58.083580+0000","last_clean":"2024-09-10T08:46:58.083580+0000","last_became_active":"2024-09-10T08:46:55.824646+0000","last_became_peered":"2024-09-10T08:46:55.824646+0000","last_unstale":"2024-09-10T08:46:58.083580+0000","last_undegraded":"2024-09-10T08:46:58.083580+0000","last_fullsized":"2024-09-10T08:46:58.083580+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:30.769030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082407+0000","last_change":"2024-09-10T08:46:51.763566+0000","last_active":"2024-09-10T08:46:58.082407+0000","last_peered":"2024-09-10T08:46:58.082407+0000","last_clean":"2024-09-10T08:46:58.082407+0000","last_became_active":"2024-09-10T08:46:51.762799+0000","last_became_peered":"2024-09-10T08:46:51.762799+0000","last_unstale":"2024-09-10T08:46:58.082407+0000","last_undegraded":"2024-09-10T08:46:58.082407+0000","last_fullsized":"2024-09-10T08:46:58.082407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:32:41.996036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.804105+0000","last_change":"2024-09-10T08:46:50.759355+0000","last_active":"2024-09-10T08:46:56.804105+0000","last_peered":"2024-09-10T08:46:56.804105+0000","last_clean":"2024-09-10T08:46:56.804105+0000","last_became_active":"2024-09-10T08:46:50.758565+0000","last_became_peered":"2024-09-10T08:46:50.758565+0000","last_unstale":"2024-09-10T08:46:56.804105+0000","last_undegraded":"2024-09-10T08:46:56.804105+0000","last_fullsized":"2024-09-10T08:46:56.804105+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:02:43.005946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083886+0000","last_change":"2024-09-10T08:46:55.840925+0000","last_active":"2024-09-10T08:46:58.083886+0000","last_peered":"2024-09-10T08:46:58.083886+0000","last_clean":"2024-09-10T08:46:58.083886+0000","last_became_active":"2024-09-10T08:46:55.839186+0000","last_became_peered":"2024-09-10T08:46:55.839186+0000","last_unstale":"2024-09-10T08:46:58.083886+0000","last_undegraded":"2024-09-10T08:46:58.083886+0000","last_fullsized":"2024-09-10T08:46:58.083886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:28.966981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.568979+0000","last_change":"2024-09-10T08:46:51.793589+0000","last_active":"2024-09-10T08:46:57.568979+0000","last_peered":"2024-09-10T08:46:57.568979+0000","last_clean":"2024-09-10T08:46:57.568979+0000","last_became_active":"2024-09-10T08:46:51.792999+0000","last_became_peered":"2024-09-10T08:46:51.792999+0000","last_unstale":"2024-09-10T08:46:57.568979+0000","last_undegraded":"2024-09-10T08:46:57.568979+0000","last_fullsized":"2024-09-10T08:46:57.568979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:43:11.183186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.961882+0000","last_change":"2024-09-10T08:46:50.769021+0000","last_active":"2024-09-10T08:46:57.961882+0000","last_peered":"2024-09-10T08:46:57.961882+0000","last_clean":"2024-09-10T08:46:57.961882+0000","last_became_active":"2024-09-10T08:46:50.768447+0000","last_became_peered":"2024-09-10T08:46:50.768447+0000","last_unstale":"2024-09-10T08:46:57.961882+0000","last_undegraded":"2024-09-10T08:46:57.961882+0000","last_fullsized":"2024-09-10T08:46:57.961882+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:16:38.293555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.569408+0000","last_change":"2024-09-10T08:46:55.882489+0000","last_active":"2024-09-10T08:46:57.569408+0000","last_peered":"2024-09-10T08:46:57.569408+0000","last_clean":"2024-09-10T08:46:57.569408+0000","last_became_active":"2024-09-10T08:46:55.880753+0000","last_became_peered":"2024-09-10T08:46:55.880753+0000","last_unstale":"2024-09-10T08:46:57.569408+0000","last_undegraded":"2024-09-10T08:46:57.569408+0000","last_fullsized":"2024-09-10T08:46:57.569408+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:32:51.937086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082212+0000","last_change":"2024-09-10T08:46:51.780317+0000","last_active":"2024-09-10T08:46:58.082212+0000","last_peered":"2024-09-10T08:46:58.082212+0000","last_clean":"2024-09-10T08:46:58.082212+0000","last_became_active":"2024-09-10T08:46:51.780024+0000","last_became_peered":"2024-09-10T08:46:51.780024+0000","last_unstale":"2024-09-10T08:46:58.082212+0000","last_undegraded":"2024-09-10T08:46:58.082212+0000","last_fullsized":"2024-09-10T08:46:58.082212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:32:41.996036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082934+0000","last_change":"2024-09-10T08:46:50.765202+0000","last_active":"2024-09-10T08:46:58.082934+0000","last_peered":"2024-09-10T08:46:58.082934+0000","last_clean":"2024-09-10T08:46:58.082934+0000","last_became_active":"2024-09-10T08:46:50.762976+0000","last_became_peered":"2024-09-10T08:46:50.762976+0000","last_unstale":"2024-09-10T08:46:58.082934+0000","last_undegraded":"2024-09-10T08:46:58.082934+0000","last_fullsized":"2024-09-10T08:46:58.082934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:13:16.717444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.962109+0000","last_change":"2024-09-10T08:46:42.177049+0000","last_active":"2024-09-10T08:46:57.962109+0000","last_peered":"2024-09-10T08:46:57.962109+0000","last_clean":"2024-09-10T08:46:57.962109+0000","last_became_active":"2024-09-10T08:46:42.175678+0000","last_became_peered":"2024-09-10T08:46:42.175678+0000","last_unstale":"2024-09-10T08:46:57.962109+0000","last_undegraded":"2024-09-10T08:46:57.962109+0000","last_fullsized":"2024-09-10T08:46:57.962109+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:40.326212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:40.326212+0000","last_clean_scrub_stamp":"2024-09-10T08:46:40.326212+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:06.642437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.806408+0000","last_change":"2024-09-10T08:46:55.881533+0000","last_active":"2024-09-10T08:46:56.806408+0000","last_peered":"2024-09-10T08:46:56.806408+0000","last_clean":"2024-09-10T08:46:56.806408+0000","last_became_active":"2024-09-10T08:46:55.880157+0000","last_became_peered":"2024-09-10T08:46:55.880157+0000","last_unstale":"2024-09-10T08:46:56.806408+0000","last_undegraded":"2024-09-10T08:46:56.806408+0000","last_fullsized":"2024-09-10T08:46:56.806408+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:17:54.613658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.962401+0000","last_change":"2024-09-10T08:46:51.793262+0000","last_active":"2024-09-10T08:46:57.962401+0000","last_peered":"2024-09-10T08:46:57.962401+0000","last_clean":"2024-09-10T08:46:57.962401+0000","last_became_active":"2024-09-10T08:46:51.792966+0000","last_became_peered":"2024-09-10T08:46:51.792966+0000","last_unstale":"2024-09-10T08:46:57.962401+0000","last_undegraded":"2024-09-10T08:46:57.962401+0000","last_fullsized":"2024-09-10T08:46:57.962401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:38:23.420671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.804380+0000","last_change":"2024-09-10T08:46:50.768436+0000","last_active":"2024-09-10T08:46:56.804380+0000","last_peered":"2024-09-10T08:46:56.804380+0000","last_clean":"2024-09-10T08:46:56.804380+0000","last_became_active":"2024-09-10T08:46:50.767236+0000","last_became_peered":"2024-09-10T08:46:50.767236+0000","last_unstale":"2024-09-10T08:46:56.804380+0000","last_undegraded":"2024-09-10T08:46:56.804380+0000","last_fullsized":"2024-09-10T08:46:56.804380+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:36:19.851847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.804996+0000","last_change":"2024-09-10T08:46:55.881541+0000","last_active":"2024-09-10T08:46:56.804996+0000","last_peered":"2024-09-10T08:46:56.804996+0000","last_clean":"2024-09-10T08:46:56.804996+0000","last_became_active":"2024-09-10T08:46:55.881029+0000","last_became_peered":"2024-09-10T08:46:55.881029+0000","last_unstale":"2024-09-10T08:46:56.804996+0000","last_undegraded":"2024-09-10T08:46:56.804996+0000","last_fullsized":"2024-09-10T08:46:56.804996+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:02.411540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083119+0000","last_change":"2024-09-10T08:46:51.783403+0000","last_active":"2024-09-10T08:46:58.083119+0000","last_peered":"2024-09-10T08:46:58.083119+0000","last_clean":"2024-09-10T08:46:58.083119+0000","last_became_active":"2024-09-10T08:46:51.781308+0000","last_became_peered":"2024-09-10T08:46:51.781308+0000","last_unstale":"2024-09-10T08:46:58.083119+0000","last_undegraded":"2024-09-10T08:46:58.083119+0000","last_fullsized":"2024-09-10T08:46:58.083119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:24:26.259501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083401+0000","last_change":"2024-09-10T08:46:50.769999+0000","last_active":"2024-09-10T08:46:58.083401+0000","last_peered":"2024-09-10T08:46:58.083401+0000","last_clean":"2024-09-10T08:46:58.083401+0000","last_became_active":"2024-09-10T08:46:50.769664+0000","last_became_peered":"2024-09-10T08:46:50.769664+0000","last_unstale":"2024-09-10T08:46:58.083401+0000","last_undegraded":"2024-09-10T08:46:58.083401+0000","last_fullsized":"2024-09-10T08:46:58.083401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:16:38.293555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.569544+0000","last_change":"2024-09-10T08:46:55.835422+0000","last_active":"2024-09-10T08:46:57.569544+0000","last_peered":"2024-09-10T08:46:57.569544+0000","last_clean":"2024-09-10T08:46:57.569544+0000","last_became_active":"2024-09-10T08:46:55.834891+0000","last_became_peered":"2024-09-10T08:46:55.834891+0000","last_unstale":"2024-09-10T08:46:57.569544+0000","last_undegraded":"2024-09-10T08:46:57.569544+0000","last_fullsized":"2024-09-10T08:46:57.569544+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:49:07.750480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.962646+0000","last_change":"2024-09-10T08:46:51.790394+0000","last_active":"2024-09-10T08:46:57.962646+0000","last_peered":"2024-09-10T08:46:57.962646+0000","last_clean":"2024-09-10T08:46:57.962646+0000","last_became_active":"2024-09-10T08:46:51.790110+0000","last_became_peered":"2024-09-10T08:46:51.790110+0000","last_unstale":"2024-09-10T08:46:57.962646+0000","last_undegraded":"2024-09-10T08:46:57.962646+0000","last_fullsized":"2024-09-10T08:46:57.962646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:32:47.882493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.804824+0000","last_change":"2024-09-10T08:46:50.768366+0000","last_active":"2024-09-10T08:46:56.804824+0000","last_peered":"2024-09-10T08:46:56.804824+0000","last_clean":"2024-09-10T08:46:56.804824+0000","last_became_active":"2024-09-10T08:46:50.768064+0000","last_became_peered":"2024-09-10T08:46:50.768064+0000","last_unstale":"2024-09-10T08:46:56.804824+0000","last_undegraded":"2024-09-10T08:46:56.804824+0000","last_fullsized":"2024-09-10T08:46:56.804824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:41:14.189488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082532+0000","last_change":"2024-09-10T08:46:55.881381+0000","last_active":"2024-09-10T08:46:58.082532+0000","last_peered":"2024-09-10T08:46:58.082532+0000","last_clean":"2024-09-10T08:46:58.082532+0000","last_became_active":"2024-09-10T08:46:55.880233+0000","last_became_peered":"2024-09-10T08:46:55.880233+0000","last_unstale":"2024-09-10T08:46:58.082532+0000","last_undegraded":"2024-09-10T08:46:58.082532+0000","last_fullsized":"2024-09-10T08:46:58.082532+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:18:56.316368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.962469+0000","last_change":"2024-09-10T08:46:51.796394+0000","last_active":"2024-09-10T08:46:57.962469+0000","last_peered":"2024-09-10T08:46:57.962469+0000","last_clean":"2024-09-10T08:46:57.962469+0000","last_became_active":"2024-09-10T08:46:51.795460+0000","last_became_peered":"2024-09-10T08:46:51.795460+0000","last_unstale":"2024-09-10T08:46:57.962469+0000","last_undegraded":"2024-09-10T08:46:57.962469+0000","last_fullsized":"2024-09-10T08:46:57.962469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:24.912388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.805830+0000","last_change":"2024-09-10T08:46:50.764621+0000","last_active":"2024-09-10T08:46:56.805830+0000","last_peered":"2024-09-10T08:46:56.805830+0000","last_clean":"2024-09-10T08:46:56.805830+0000","last_became_active":"2024-09-10T08:46:50.764262+0000","last_became_peered":"2024-09-10T08:46:50.764262+0000","last_unstale":"2024-09-10T08:46:56.805830+0000","last_undegraded":"2024-09-10T08:46:56.805830+0000","last_fullsized":"2024-09-10T08:46:56.805830+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:18.256394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.805988+0000","last_change":"2024-09-10T08:46:55.835039+0000","last_active":"2024-09-10T08:46:56.805988+0000","last_peered":"2024-09-10T08:46:56.805988+0000","last_clean":"2024-09-10T08:46:56.805988+0000","last_became_active":"2024-09-10T08:46:55.834520+0000","last_became_peered":"2024-09-10T08:46:55.834520+0000","last_unstale":"2024-09-10T08:46:56.805988+0000","last_undegraded":"2024-09-10T08:46:56.805988+0000","last_fullsized":"2024-09-10T08:46:56.805988+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:28.297454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.962089+0000","last_change":"2024-09-10T08:46:51.792053+0000","last_active":"2024-09-10T08:46:57.962089+0000","last_peered":"2024-09-10T08:46:57.962089+0000","last_clean":"2024-09-10T08:46:57.962089+0000","last_became_active":"2024-09-10T08:46:51.791729+0000","last_became_peered":"2024-09-10T08:46:51.791729+0000","last_unstale":"2024-09-10T08:46:57.962089+0000","last_undegraded":"2024-09-10T08:46:57.962089+0000","last_fullsized":"2024-09-10T08:46:57.962089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:35:58.356947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.803934+0000","last_change":"2024-09-10T08:46:50.762530+0000","last_active":"2024-09-10T08:46:56.803934+0000","last_peered":"2024-09-10T08:46:56.803934+0000","last_clean":"2024-09-10T08:46:56.803934+0000","last_became_active":"2024-09-10T08:46:50.762274+0000","last_became_peered":"2024-09-10T08:46:50.762274+0000","last_unstale":"2024-09-10T08:46:56.803934+0000","last_undegraded":"2024-09-10T08:46:56.803934+0000","last_fullsized":"2024-09-10T08:46:56.803934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:38:26.709117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.569309+0000","last_change":"2024-09-10T08:46:55.837828+0000","last_active":"2024-09-10T08:46:57.569309+0000","last_peered":"2024-09-10T08:46:57.569309+0000","last_clean":"2024-09-10T08:46:57.569309+0000","last_became_active":"2024-09-10T08:46:55.837157+0000","last_became_peered":"2024-09-10T08:46:55.837157+0000","last_unstale":"2024-09-10T08:46:57.569309+0000","last_undegraded":"2024-09-10T08:46:57.569309+0000","last_fullsized":"2024-09-10T08:46:57.569309+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:30.769030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.805426+0000","last_change":"2024-09-10T08:46:51.780767+0000","last_active":"2024-09-10T08:46:56.805426+0000","last_peered":"2024-09-10T08:46:56.805426+0000","last_clean":"2024-09-10T08:46:56.805426+0000","last_became_active":"2024-09-10T08:46:51.780429+0000","last_became_peered":"2024-09-10T08:46:51.780429+0000","last_unstale":"2024-09-10T08:46:56.805426+0000","last_undegraded":"2024-09-10T08:46:56.805426+0000","last_fullsized":"2024-09-10T08:46:56.805426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:43:11.183186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.805298+0000","last_change":"2024-09-10T08:46:50.767724+0000","last_active":"2024-09-10T08:46:56.805298+0000","last_peered":"2024-09-10T08:46:56.805298+0000","last_clean":"2024-09-10T08:46:56.805298+0000","last_became_active":"2024-09-10T08:46:50.767440+0000","last_became_peered":"2024-09-10T08:46:50.767440+0000","last_unstale":"2024-09-10T08:46:56.805298+0000","last_undegraded":"2024-09-10T08:46:56.805298+0000","last_fullsized":"2024-09-10T08:46:56.805298+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:36:19.851847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.084325+0000","last_change":"2024-09-10T08:46:55.881726+0000","last_active":"2024-09-10T08:46:58.084325+0000","last_peered":"2024-09-10T08:46:58.084325+0000","last_clean":"2024-09-10T08:46:58.084325+0000","last_became_active":"2024-09-10T08:46:55.881215+0000","last_became_peered":"2024-09-10T08:46:55.881215+0000","last_unstale":"2024-09-10T08:46:58.084325+0000","last_undegraded":"2024-09-10T08:46:58.084325+0000","last_fullsized":"2024-09-10T08:46:58.084325+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:55:12.631797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.962268+0000","last_change":"2024-09-10T08:46:51.802443+0000","last_active":"2024-09-10T08:46:57.962268+0000","last_peered":"2024-09-10T08:46:57.962268+0000","last_clean":"2024-09-10T08:46:57.962268+0000","last_became_active":"2024-09-10T08:46:51.800377+0000","last_became_peered":"2024-09-10T08:46:51.800377+0000","last_unstale":"2024-09-10T08:46:57.962268+0000","last_undegraded":"2024-09-10T08:46:57.962268+0000","last_fullsized":"2024-09-10T08:46:57.962268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:17:50.559065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082973+0000","last_change":"2024-09-10T08:46:50.770106+0000","last_active":"2024-09-10T08:46:58.082973+0000","last_peered":"2024-09-10T08:46:58.082973+0000","last_clean":"2024-09-10T08:46:58.082973+0000","last_became_active":"2024-09-10T08:46:50.769664+0000","last_became_peered":"2024-09-10T08:46:50.769664+0000","last_unstale":"2024-09-10T08:46:58.082973+0000","last_undegraded":"2024-09-10T08:46:58.082973+0000","last_fullsized":"2024-09-10T08:46:58.082973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:02:43.005946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082899+0000","last_change":"2024-09-10T08:46:55.878519+0000","last_active":"2024-09-10T08:46:58.082899+0000","last_peered":"2024-09-10T08:46:58.082899+0000","last_clean":"2024-09-10T08:46:58.082899+0000","last_became_active":"2024-09-10T08:46:55.877986+0000","last_became_peered":"2024-09-10T08:46:55.877986+0000","last_unstale":"2024-09-10T08:46:58.082899+0000","last_undegraded":"2024-09-10T08:46:58.082899+0000","last_fullsized":"2024-09-10T08:46:58.082899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:29:38.674946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.569136+0000","last_change":"2024-09-10T08:46:51.788482+0000","last_active":"2024-09-10T08:46:57.569136+0000","last_peered":"2024-09-10T08:46:57.569136+0000","last_clean":"2024-09-10T08:46:57.569136+0000","last_became_active":"2024-09-10T08:46:51.787872+0000","last_became_peered":"2024-09-10T08:46:51.787872+0000","last_unstale":"2024-09-10T08:46:57.569136+0000","last_undegraded":"2024-09-10T08:46:57.569136+0000","last_fullsized":"2024-09-10T08:46:57.569136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:49:28.950554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.569602+0000","last_change":"2024-09-10T08:46:50.766888+0000","last_active":"2024-09-10T08:46:57.569602+0000","last_peered":"2024-09-10T08:46:57.569602+0000","last_clean":"2024-09-10T08:46:57.569602+0000","last_became_active":"2024-09-10T08:46:50.766608+0000","last_became_peered":"2024-09-10T08:46:50.766608+0000","last_unstale":"2024-09-10T08:46:57.569602+0000","last_undegraded":"2024-09-10T08:46:57.569602+0000","last_fullsized":"2024-09-10T08:46:57.569602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:41:14.189488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083056+0000","last_change":"2024-09-10T08:46:55.878767+0000","last_active":"2024-09-10T08:46:58.083056+0000","last_peered":"2024-09-10T08:46:58.083056+0000","last_clean":"2024-09-10T08:46:58.083056+0000","last_became_active":"2024-09-10T08:46:55.878328+0000","last_became_peered":"2024-09-10T08:46:55.878328+0000","last_unstale":"2024-09-10T08:46:58.083056+0000","last_undegraded":"2024-09-10T08:46:58.083056+0000","last_fullsized":"2024-09-10T08:46:58.083056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:29:38.674946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.962269+0000","last_change":"2024-09-10T08:46:51.782671+0000","last_active":"2024-09-10T08:46:57.962269+0000","last_peered":"2024-09-10T08:46:57.962269+0000","last_clean":"2024-09-10T08:46:57.962269+0000","last_became_active":"2024-09-10T08:46:51.782072+0000","last_became_peered":"2024-09-10T08:46:51.782072+0000","last_unstale":"2024-09-10T08:46:57.962269+0000","last_undegraded":"2024-09-10T08:46:57.962269+0000","last_fullsized":"2024-09-10T08:46:57.962269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:24:26.259501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:47:03.196847+0000","last_change":"2024-09-10T08:46:50.763937+0000","last_active":"2024-09-10T08:47:03.196847+0000","last_peered":"2024-09-10T08:47:03.196847+0000","last_clean":"2024-09-10T08:47:03.196847+0000","last_became_active":"2024-09-10T08:46:50.763447+0000","last_became_peered":"2024-09-10T08:46:50.763447+0000","last_unstale":"2024-09-10T08:47:03.196847+0000","last_undegraded":"2024-09-10T08:47:03.196847+0000","last_fullsized":"2024-09-10T08:47:03.196847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:16:38.293555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083220+0000","last_change":"2024-09-10T08:46:55.822409+0000","last_active":"2024-09-10T08:46:58.083220+0000","last_peered":"2024-09-10T08:46:58.083220+0000","last_clean":"2024-09-10T08:46:58.083220+0000","last_became_active":"2024-09-10T08:46:55.821875+0000","last_became_peered":"2024-09-10T08:46:55.821875+0000","last_unstale":"2024-09-10T08:46:58.083220+0000","last_undegraded":"2024-09-10T08:46:58.083220+0000","last_fullsized":"2024-09-10T08:46:58.083220+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:53:58.842801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.805662+0000","last_change":"2024-09-10T08:46:51.780453+0000","last_active":"2024-09-10T08:46:56.805662+0000","last_peered":"2024-09-10T08:46:56.805662+0000","last_clean":"2024-09-10T08:46:56.805662+0000","last_became_active":"2024-09-10T08:46:51.780160+0000","last_became_peered":"2024-09-10T08:46:51.780160+0000","last_unstale":"2024-09-10T08:46:56.805662+0000","last_undegraded":"2024-09-10T08:46:56.805662+0000","last_fullsized":"2024-09-10T08:46:56.805662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:23:07.050797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083373+0000","last_change":"2024-09-10T08:46:50.777289+0000","last_active":"2024-09-10T08:46:58.083373+0000","last_peered":"2024-09-10T08:46:58.083373+0000","last_clean":"2024-09-10T08:46:58.083373+0000","last_became_active":"2024-09-10T08:46:50.776985+0000","last_became_peered":"2024-09-10T08:46:50.776985+0000","last_unstale":"2024-09-10T08:46:58.083373+0000","last_undegraded":"2024-09-10T08:46:58.083373+0000","last_fullsized":"2024-09-10T08:46:58.083373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:13:16.717444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.806645+0000","last_change":"2024-09-10T08:46:55.818962+0000","last_active":"2024-09-10T08:46:56.806645+0000","last_peered":"2024-09-10T08:46:56.806645+0000","last_clean":"2024-09-10T08:46:56.806645+0000","last_became_active":"2024-09-10T08:46:55.818548+0000","last_became_peered":"2024-09-10T08:46:55.818548+0000","last_unstale":"2024-09-10T08:46:56.806645+0000","last_undegraded":"2024-09-10T08:46:56.806645+0000","last_fullsized":"2024-09-10T08:46:56.806645+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:24:30.314094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.569570+0000","last_change":"2024-09-10T08:46:51.786958+0000","last_active":"2024-09-10T08:46:57.569570+0000","last_peered":"2024-09-10T08:46:57.569570+0000","last_clean":"2024-09-10T08:46:57.569570+0000","last_became_active":"2024-09-10T08:46:51.786679+0000","last_became_peered":"2024-09-10T08:46:51.786679+0000","last_unstale":"2024-09-10T08:46:57.569570+0000","last_undegraded":"2024-09-10T08:46:57.569570+0000","last_fullsized":"2024-09-10T08:46:57.569570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:12:29.713395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083066+0000","last_change":"2024-09-10T08:46:50.770627+0000","last_active":"2024-09-10T08:46:58.083066+0000","last_peered":"2024-09-10T08:46:58.083066+0000","last_clean":"2024-09-10T08:46:58.083066+0000","last_became_active":"2024-09-10T08:46:50.770108+0000","last_became_peered":"2024-09-10T08:46:50.770108+0000","last_unstale":"2024-09-10T08:46:58.083066+0000","last_undegraded":"2024-09-10T08:46:58.083066+0000","last_fullsized":"2024-09-10T08:46:58.083066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:16:38.293555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082271+0000","last_change":"2024-09-10T08:46:55.834973+0000","last_active":"2024-09-10T08:46:58.082271+0000","last_peered":"2024-09-10T08:46:58.082271+0000","last_clean":"2024-09-10T08:46:58.082271+0000","last_became_active":"2024-09-10T08:46:55.834553+0000","last_became_peered":"2024-09-10T08:46:55.834553+0000","last_unstale":"2024-09-10T08:46:58.082271+0000","last_undegraded":"2024-09-10T08:46:58.082271+0000","last_fullsized":"2024-09-10T08:46:58.082271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:48:45.215364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082933+0000","last_change":"2024-09-10T08:46:51.792047+0000","last_active":"2024-09-10T08:46:58.082933+0000","last_peered":"2024-09-10T08:46:58.082933+0000","last_clean":"2024-09-10T08:46:58.082933+0000","last_became_active":"2024-09-10T08:46:51.790021+0000","last_became_peered":"2024-09-10T08:46:51.790021+0000","last_unstale":"2024-09-10T08:46:58.082933+0000","last_undegraded":"2024-09-10T08:46:58.082933+0000","last_fullsized":"2024-09-10T08:46:58.082933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:26.714437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.806941+0000","last_change":"2024-09-10T08:46:50.766074+0000","last_active":"2024-09-10T08:46:56.806941+0000","last_peered":"2024-09-10T08:46:56.806941+0000","last_clean":"2024-09-10T08:46:56.806941+0000","last_became_active":"2024-09-10T08:46:50.765744+0000","last_became_peered":"2024-09-10T08:46:50.765744+0000","last_unstale":"2024-09-10T08:46:56.806941+0000","last_undegraded":"2024-09-10T08:46:56.806941+0000","last_fullsized":"2024-09-10T08:46:56.806941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:02:43.005946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082526+0000","last_change":"2024-09-10T08:46:55.883453+0000","last_active":"2024-09-10T08:46:58.082526+0000","last_peered":"2024-09-10T08:46:58.082526+0000","last_clean":"2024-09-10T08:46:58.082526+0000","last_became_active":"2024-09-10T08:46:55.883030+0000","last_became_peered":"2024-09-10T08:46:55.883030+0000","last_unstale":"2024-09-10T08:46:58.082526+0000","last_undegraded":"2024-09-10T08:46:58.082526+0000","last_fullsized":"2024-09-10T08:46:58.082526+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:18:56.316368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.569239+0000","last_change":"2024-09-10T08:46:55.885568+0000","last_active":"2024-09-10T08:46:57.569239+0000","last_peered":"2024-09-10T08:46:57.569239+0000","last_clean":"2024-09-10T08:46:57.569239+0000","last_became_active":"2024-09-10T08:46:55.884728+0000","last_became_peered":"2024-09-10T08:46:55.884728+0000","last_unstale":"2024-09-10T08:46:57.569239+0000","last_undegraded":"2024-09-10T08:46:57.569239+0000","last_fullsized":"2024-09-10T08:46:57.569239+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:53:58.842801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082702+0000","last_change":"2024-09-10T08:46:51.772447+0000","last_active":"2024-09-10T08:46:58.082702+0000","last_peered":"2024-09-10T08:46:58.082702+0000","last_clean":"2024-09-10T08:46:58.082702+0000","last_became_active":"2024-09-10T08:46:51.772157+0000","last_became_peered":"2024-09-10T08:46:51.772157+0000","last_unstale":"2024-09-10T08:46:58.082702+0000","last_undegraded":"2024-09-10T08:46:58.082702+0000","last_fullsized":"2024-09-10T08:46:58.082702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:55:01.331346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082601+0000","last_change":"2024-09-10T08:46:50.773438+0000","last_active":"2024-09-10T08:46:58.082601+0000","last_peered":"2024-09-10T08:46:58.082601+0000","last_clean":"2024-09-10T08:46:58.082601+0000","last_became_active":"2024-09-10T08:46:50.769939+0000","last_became_peered":"2024-09-10T08:46:50.769939+0000","last_unstale":"2024-09-10T08:46:58.082601+0000","last_undegraded":"2024-09-10T08:46:58.082601+0000","last_fullsized":"2024-09-10T08:46:58.082601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:27:43.187268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.806816+0000","last_change":"2024-09-10T08:46:55.833783+0000","last_active":"2024-09-10T08:46:56.806816+0000","last_peered":"2024-09-10T08:46:56.806816+0000","last_clean":"2024-09-10T08:46:56.806816+0000","last_became_active":"2024-09-10T08:46:55.833320+0000","last_became_peered":"2024-09-10T08:46:55.833320+0000","last_unstale":"2024-09-10T08:46:56.806816+0000","last_undegraded":"2024-09-10T08:46:56.806816+0000","last_fullsized":"2024-09-10T08:46:56.806816+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:24:30.314094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082200+0000","last_change":"2024-09-10T08:46:51.773700+0000","last_active":"2024-09-10T08:46:58.082200+0000","last_peered":"2024-09-10T08:46:58.082200+0000","last_clean":"2024-09-10T08:46:58.082200+0000","last_became_active":"2024-09-10T08:46:51.771497+0000","last_became_peered":"2024-09-10T08:46:51.771497+0000","last_unstale":"2024-09-10T08:46:58.082200+0000","last_undegraded":"2024-09-10T08:46:58.082200+0000","last_fullsized":"2024-09-10T08:46:58.082200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:12:29.713395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082693+0000","last_change":"2024-09-10T08:46:50.760228+0000","last_active":"2024-09-10T08:46:58.082693+0000","last_peered":"2024-09-10T08:46:58.082693+0000","last_clean":"2024-09-10T08:46:58.082693+0000","last_became_active":"2024-09-10T08:46:50.759920+0000","last_became_peered":"2024-09-10T08:46:50.759920+0000","last_unstale":"2024-09-10T08:46:58.082693+0000","last_undegraded":"2024-09-10T08:46:58.082693+0000","last_fullsized":"2024-09-10T08:46:58.082693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:41:14.189488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.805887+0000","last_change":"2024-09-10T08:46:50.767239+0000","last_active":"2024-09-10T08:46:56.805887+0000","last_peered":"2024-09-10T08:46:56.805887+0000","last_clean":"2024-09-10T08:46:56.805887+0000","last_became_active":"2024-09-10T08:46:50.766809+0000","last_became_peered":"2024-09-10T08:46:50.766809+0000","last_unstale":"2024-09-10T08:46:56.805887+0000","last_undegraded":"2024-09-10T08:46:56.805887+0000","last_fullsized":"2024-09-10T08:46:56.805887+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:38:26.709117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.569591+0000","last_change":"2024-09-10T08:46:51.794973+0000","last_active":"2024-09-10T08:46:57.569591+0000","last_peered":"2024-09-10T08:46:57.569591+0000","last_clean":"2024-09-10T08:46:57.569591+0000","last_became_active":"2024-09-10T08:46:51.794731+0000","last_became_peered":"2024-09-10T08:46:51.794731+0000","last_unstale":"2024-09-10T08:46:57.569591+0000","last_undegraded":"2024-09-10T08:46:57.569591+0000","last_fullsized":"2024-09-10T08:46:57.569591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:40:55.949890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.804311+0000","last_change":"2024-09-10T08:46:55.824916+0000","last_active":"2024-09-10T08:46:56.804311+0000","last_peered":"2024-09-10T08:46:56.804311+0000","last_clean":"2024-09-10T08:46:56.804311+0000","last_became_active":"2024-09-10T08:46:55.823750+0000","last_became_peered":"2024-09-10T08:46:55.823750+0000","last_unstale":"2024-09-10T08:46:56.804311+0000","last_undegraded":"2024-09-10T08:46:56.804311+0000","last_fullsized":"2024-09-10T08:46:56.804311+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:29:01.507822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082610+0000","last_change":"2024-09-10T08:46:50.759413+0000","last_active":"2024-09-10T08:46:58.082610+0000","last_peered":"2024-09-10T08:46:58.082610+0000","last_clean":"2024-09-10T08:46:58.082610+0000","last_became_active":"2024-09-10T08:46:50.759045+0000","last_became_peered":"2024-09-10T08:46:50.759045+0000","last_unstale":"2024-09-10T08:46:58.082610+0000","last_undegraded":"2024-09-10T08:46:58.082610+0000","last_fullsized":"2024-09-10T08:46:58.082610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:36:19.851847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.805928+0000","last_change":"2024-09-10T08:46:51.769795+0000","last_active":"2024-09-10T08:46:56.805928+0000","last_peered":"2024-09-10T08:46:56.805928+0000","last_clean":"2024-09-10T08:46:56.805928+0000","last_became_active":"2024-09-10T08:46:51.769482+0000","last_became_peered":"2024-09-10T08:46:51.769482+0000","last_unstale":"2024-09-10T08:46:56.805928+0000","last_undegraded":"2024-09-10T08:46:56.805928+0000","last_fullsized":"2024-09-10T08:46:56.805928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:16:39.301236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.084120+0000","last_change":"2024-09-10T08:46:55.827136+0000","last_active":"2024-09-10T08:46:58.084120+0000","last_peered":"2024-09-10T08:46:58.084120+0000","last_clean":"2024-09-10T08:46:58.084120+0000","last_became_active":"2024-09-10T08:46:55.826597+0000","last_became_peered":"2024-09-10T08:46:55.826597+0000","last_unstale":"2024-09-10T08:46:58.084120+0000","last_undegraded":"2024-09-10T08:46:58.084120+0000","last_fullsized":"2024-09-10T08:46:58.084120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:01:01.534963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.805190+0000","last_change":"2024-09-10T08:46:51.775032+0000","last_active":"2024-09-10T08:46:56.805190+0000","last_peered":"2024-09-10T08:46:56.805190+0000","last_clean":"2024-09-10T08:46:56.805190+0000","last_became_active":"2024-09-10T08:46:51.774669+0000","last_became_peered":"2024-09-10T08:46:51.774669+0000","last_unstale":"2024-09-10T08:46:56.805190+0000","last_undegraded":"2024-09-10T08:46:56.805190+0000","last_fullsized":"2024-09-10T08:46:56.805190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:40:55.949890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.804036+0000","last_change":"2024-09-10T08:46:51.796531+0000","last_active":"2024-09-10T08:46:56.804036+0000","last_peered":"2024-09-10T08:46:56.804036+0000","last_clean":"2024-09-10T08:46:56.804036+0000","last_became_active":"2024-09-10T08:46:51.796249+0000","last_became_peered":"2024-09-10T08:46:51.796249+0000","last_unstale":"2024-09-10T08:46:56.804036+0000","last_undegraded":"2024-09-10T08:46:56.804036+0000","last_fullsized":"2024-09-10T08:46:56.804036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:23:07.050797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083010+0000","last_change":"2024-09-10T08:46:51.781773+0000","last_active":"2024-09-10T08:46:58.083010+0000","last_peered":"2024-09-10T08:46:58.083010+0000","last_clean":"2024-09-10T08:46:58.083010+0000","last_became_active":"2024-09-10T08:46:51.781397+0000","last_became_peered":"2024-09-10T08:46:51.781397+0000","last_unstale":"2024-09-10T08:46:58.083010+0000","last_undegraded":"2024-09-10T08:46:58.083010+0000","last_fullsized":"2024-09-10T08:46:58.083010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:35:58.356947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.569502+0000","last_change":"2024-09-10T08:46:51.780877+0000","last_active":"2024-09-10T08:46:57.569502+0000","last_peered":"2024-09-10T08:46:57.569502+0000","last_clean":"2024-09-10T08:46:57.569502+0000","last_became_active":"2024-09-10T08:46:51.778471+0000","last_became_peered":"2024-09-10T08:46:51.778471+0000","last_unstale":"2024-09-10T08:46:57.569502+0000","last_undegraded":"2024-09-10T08:46:57.569502+0000","last_fullsized":"2024-09-10T08:46:57.569502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:32:41.996036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083021+0000","last_change":"2024-09-10T08:46:51.777079+0000","last_active":"2024-09-10T08:46:58.083021+0000","last_peered":"2024-09-10T08:46:58.083021+0000","last_clean":"2024-09-10T08:46:58.083021+0000","last_became_active":"2024-09-10T08:46:51.776561+0000","last_became_peered":"2024-09-10T08:46:51.776561+0000","last_unstale":"2024-09-10T08:46:58.083021+0000","last_undegraded":"2024-09-10T08:46:58.083021+0000","last_fullsized":"2024-09-10T08:46:58.083021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:17:48.493127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083242+0000","last_change":"2024-09-10T08:46:51.772455+0000","last_active":"2024-09-10T08:46:58.083242+0000","last_peered":"2024-09-10T08:46:58.083242+0000","last_clean":"2024-09-10T08:46:58.083242+0000","last_became_active":"2024-09-10T08:46:51.772177+0000","last_became_peered":"2024-09-10T08:46:51.772177+0000","last_unstale":"2024-09-10T08:46:58.083242+0000","last_undegraded":"2024-09-10T08:46:58.083242+0000","last_fullsized":"2024-09-10T08:46:58.083242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:56:12.749632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.807011+0000","last_change":"2024-09-10T08:46:51.787208+0000","last_active":"2024-09-10T08:46:56.807011+0000","last_peered":"2024-09-10T08:46:56.807011+0000","last_clean":"2024-09-10T08:46:56.807011+0000","last_became_active":"2024-09-10T08:46:51.786911+0000","last_became_peered":"2024-09-10T08:46:51.786911+0000","last_unstale":"2024-09-10T08:46:56.807011+0000","last_undegraded":"2024-09-10T08:46:56.807011+0000","last_fullsized":"2024-09-10T08:46:56.807011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:17:48.493127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.084355+0000","last_change":"2024-09-10T08:46:51.779942+0000","last_active":"2024-09-10T08:46:58.084355+0000","last_peered":"2024-09-10T08:46:58.084355+0000","last_clean":"2024-09-10T08:46:58.084355+0000","last_became_active":"2024-09-10T08:46:51.779570+0000","last_became_peered":"2024-09-10T08:46:51.779570+0000","last_unstale":"2024-09-10T08:46:58.084355+0000","last_undegraded":"2024-09-10T08:46:58.084355+0000","last_fullsized":"2024-09-10T08:46:58.084355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:24.598016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082596+0000","last_change":"2024-09-10T08:46:51.786869+0000","last_active":"2024-09-10T08:46:58.082596+0000","last_peered":"2024-09-10T08:46:58.082596+0000","last_clean":"2024-09-10T08:46:58.082596+0000","last_became_active":"2024-09-10T08:46:51.786574+0000","last_became_peered":"2024-09-10T08:46:51.786574+0000","last_unstale":"2024-09-10T08:46:58.082596+0000","last_undegraded":"2024-09-10T08:46:58.082596+0000","last_fullsized":"2024-09-10T08:46:58.082596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:12:29.713395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082590+0000","last_change":"2024-09-10T08:46:51.779669+0000","last_active":"2024-09-10T08:46:58.082590+0000","last_peered":"2024-09-10T08:46:58.082590+0000","last_clean":"2024-09-10T08:46:58.082590+0000","last_became_active":"2024-09-10T08:46:51.779155+0000","last_became_peered":"2024-09-10T08:46:51.779155+0000","last_unstale":"2024-09-10T08:46:58.082590+0000","last_undegraded":"2024-09-10T08:46:58.082590+0000","last_fullsized":"2024-09-10T08:46:58.082590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:43:11.183186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082731+0000","last_change":"2024-09-10T08:46:51.784754+0000","last_active":"2024-09-10T08:46:58.082731+0000","last_peered":"2024-09-10T08:46:58.082731+0000","last_clean":"2024-09-10T08:46:58.082731+0000","last_became_active":"2024-09-10T08:46:51.784415+0000","last_became_peered":"2024-09-10T08:46:51.784415+0000","last_unstale":"2024-09-10T08:46:58.082731+0000","last_undegraded":"2024-09-10T08:46:58.082731+0000","last_fullsized":"2024-09-10T08:46:58.082731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:24.242861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.569395+0000","last_change":"2024-09-10T08:46:51.788577+0000","last_active":"2024-09-10T08:46:57.569395+0000","last_peered":"2024-09-10T08:46:57.569395+0000","last_clean":"2024-09-10T08:46:57.569395+0000","last_became_active":"2024-09-10T08:46:51.787904+0000","last_became_peered":"2024-09-10T08:46:51.787904+0000","last_unstale":"2024-09-10T08:46:57.569395+0000","last_undegraded":"2024-09-10T08:46:57.569395+0000","last_fullsized":"2024-09-10T08:46:57.569395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:28:57.453229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.806471+0000","last_change":"2024-09-10T08:46:51.776337+0000","last_active":"2024-09-10T08:46:56.806471+0000","last_peered":"2024-09-10T08:46:56.806471+0000","last_clean":"2024-09-10T08:46:56.806471+0000","last_became_active":"2024-09-10T08:46:51.776001+0000","last_became_peered":"2024-09-10T08:46:51.776001+0000","last_unstale":"2024-09-10T08:46:56.806471+0000","last_undegraded":"2024-09-10T08:46:56.806471+0000","last_fullsized":"2024-09-10T08:46:56.806471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:32:41.996036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.962516+0000","last_change":"2024-09-10T08:46:51.782912+0000","last_active":"2024-09-10T08:46:57.962516+0000","last_peered":"2024-09-10T08:46:57.962516+0000","last_clean":"2024-09-10T08:46:57.962516+0000","last_became_active":"2024-09-10T08:46:51.782378+0000","last_became_peered":"2024-09-10T08:46:51.782378+0000","last_unstale":"2024-09-10T08:46:57.962516+0000","last_undegraded":"2024-09-10T08:46:57.962516+0000","last_fullsized":"2024-09-10T08:46:57.962516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:26.714437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.804805+0000","last_change":"2024-09-10T08:46:51.773571+0000","last_active":"2024-09-10T08:46:56.804805+0000","last_peered":"2024-09-10T08:46:56.804805+0000","last_clean":"2024-09-10T08:46:56.804805+0000","last_became_active":"2024-09-10T08:46:51.773315+0000","last_became_peered":"2024-09-10T08:46:51.773315+0000","last_unstale":"2024-09-10T08:46:56.804805+0000","last_undegraded":"2024-09-10T08:46:56.804805+0000","last_fullsized":"2024-09-10T08:46:56.804805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:20:24.144389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083297+0000","last_change":"2024-09-10T08:46:51.785342+0000","last_active":"2024-09-10T08:46:58.083297+0000","last_peered":"2024-09-10T08:46:58.083297+0000","last_clean":"2024-09-10T08:46:58.083297+0000","last_became_active":"2024-09-10T08:46:51.785045+0000","last_became_peered":"2024-09-10T08:46:51.785045+0000","last_unstale":"2024-09-10T08:46:58.083297+0000","last_undegraded":"2024-09-10T08:46:58.083297+0000","last_fullsized":"2024-09-10T08:46:58.083297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:38:23.420671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082446+0000","last_change":"2024-09-10T08:46:51.779497+0000","last_active":"2024-09-10T08:46:58.082446+0000","last_peered":"2024-09-10T08:46:58.082446+0000","last_clean":"2024-09-10T08:46:58.082446+0000","last_became_active":"2024-09-10T08:46:51.778862+0000","last_became_peered":"2024-09-10T08:46:51.778862+0000","last_unstale":"2024-09-10T08:46:58.082446+0000","last_undegraded":"2024-09-10T08:46:58.082446+0000","last_fullsized":"2024-09-10T08:46:58.082446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:17:48.493127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082856+0000","last_change":"2024-09-10T08:46:51.777738+0000","last_active":"2024-09-10T08:46:58.082856+0000","last_peered":"2024-09-10T08:46:58.082856+0000","last_clean":"2024-09-10T08:46:58.082856+0000","last_became_active":"2024-09-10T08:46:51.777432+0000","last_became_peered":"2024-09-10T08:46:51.777432+0000","last_unstale":"2024-09-10T08:46:58.082856+0000","last_undegraded":"2024-09-10T08:46:58.082856+0000","last_fullsized":"2024-09-10T08:46:58.082856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:40:55.949890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.569117+0000","last_change":"2024-09-10T08:46:51.770094+0000","last_active":"2024-09-10T08:46:57.569117+0000","last_peered":"2024-09-10T08:46:57.569117+0000","last_clean":"2024-09-10T08:46:57.569117+0000","last_became_active":"2024-09-10T08:46:51.769753+0000","last_became_peered":"2024-09-10T08:46:51.769753+0000","last_unstale":"2024-09-10T08:46:57.569117+0000","last_undegraded":"2024-09-10T08:46:57.569117+0000","last_fullsized":"2024-09-10T08:46:57.569117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:24:41.697382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082447+0000","last_change":"2024-09-10T08:46:51.774060+0000","last_active":"2024-09-10T08:46:58.082447+0000","last_peered":"2024-09-10T08:46:58.082447+0000","last_clean":"2024-09-10T08:46:58.082447+0000","last_became_active":"2024-09-10T08:46:51.773763+0000","last_became_peered":"2024-09-10T08:46:51.773763+0000","last_unstale":"2024-09-10T08:46:58.082447+0000","last_undegraded":"2024-09-10T08:46:58.082447+0000","last_fullsized":"2024-09-10T08:46:58.082447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:40:55.949890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.805537+0000","last_change":"2024-09-10T08:46:51.772499+0000","last_active":"2024-09-10T08:46:56.805537+0000","last_peered":"2024-09-10T08:46:56.805537+0000","last_clean":"2024-09-10T08:46:56.805537+0000","last_became_active":"2024-09-10T08:46:51.772212+0000","last_became_peered":"2024-09-10T08:46:51.772212+0000","last_unstale":"2024-09-10T08:46:56.805537+0000","last_undegraded":"2024-09-10T08:46:56.805537+0000","last_fullsized":"2024-09-10T08:46:56.805537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:56.313573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.806478+0000","last_change":"2024-09-10T08:46:51.782216+0000","last_active":"2024-09-10T08:46:56.806478+0000","last_peered":"2024-09-10T08:46:56.806478+0000","last_clean":"2024-09-10T08:46:56.806478+0000","last_became_active":"2024-09-10T08:46:51.781363+0000","last_became_peered":"2024-09-10T08:46:51.781363+0000","last_unstale":"2024-09-10T08:46:56.806478+0000","last_undegraded":"2024-09-10T08:46:56.806478+0000","last_fullsized":"2024-09-10T08:46:56.806478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:55:01.331346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.806885+0000","last_change":"2024-09-10T08:46:51.796242+0000","last_active":"2024-09-10T08:46:56.806885+0000","last_peered":"2024-09-10T08:46:56.806885+0000","last_clean":"2024-09-10T08:46:56.806885+0000","last_became_active":"2024-09-10T08:46:51.795803+0000","last_became_peered":"2024-09-10T08:46:51.795803+0000","last_unstale":"2024-09-10T08:46:56.806885+0000","last_undegraded":"2024-09-10T08:46:56.806885+0000","last_fullsized":"2024-09-10T08:46:56.806885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:56:12.749632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.962635+0000","last_change":"2024-09-10T08:46:51.792984+0000","last_active":"2024-09-10T08:46:57.962635+0000","last_peered":"2024-09-10T08:46:57.962635+0000","last_clean":"2024-09-10T08:46:57.962635+0000","last_became_active":"2024-09-10T08:46:51.792602+0000","last_became_peered":"2024-09-10T08:46:51.792602+0000","last_unstale":"2024-09-10T08:46:57.962635+0000","last_undegraded":"2024-09-10T08:46:57.962635+0000","last_fullsized":"2024-09-10T08:46:57.962635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:53:54.788208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082095+0000","last_change":"2024-09-10T08:46:51.781436+0000","last_active":"2024-09-10T08:46:58.082095+0000","last_peered":"2024-09-10T08:46:58.082095+0000","last_clean":"2024-09-10T08:46:58.082095+0000","last_became_active":"2024-09-10T08:46:51.781123+0000","last_became_peered":"2024-09-10T08:46:51.781123+0000","last_unstale":"2024-09-10T08:46:58.082095+0000","last_undegraded":"2024-09-10T08:46:58.082095+0000","last_fullsized":"2024-09-10T08:46:58.082095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:56:12.749632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.962036+0000","last_change":"2024-09-10T08:46:51.779525+0000","last_active":"2024-09-10T08:46:57.962036+0000","last_peered":"2024-09-10T08:46:57.962036+0000","last_clean":"2024-09-10T08:46:57.962036+0000","last_became_active":"2024-09-10T08:46:51.779188+0000","last_became_peered":"2024-09-10T08:46:51.779188+0000","last_unstale":"2024-09-10T08:46:57.962036+0000","last_undegraded":"2024-09-10T08:46:57.962036+0000","last_fullsized":"2024-09-10T08:46:57.962036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:24.242861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082677+0000","last_change":"2024-09-10T08:46:51.788567+0000","last_active":"2024-09-10T08:46:58.082677+0000","last_peered":"2024-09-10T08:46:58.082677+0000","last_clean":"2024-09-10T08:46:58.082677+0000","last_became_active":"2024-09-10T08:46:51.787403+0000","last_became_peered":"2024-09-10T08:46:51.787403+0000","last_unstale":"2024-09-10T08:46:58.082677+0000","last_undegraded":"2024-09-10T08:46:58.082677+0000","last_fullsized":"2024-09-10T08:46:58.082677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:41:08.261156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.962152+0000","last_change":"2024-09-10T08:46:51.779364+0000","last_active":"2024-09-10T08:46:57.962152+0000","last_peered":"2024-09-10T08:46:57.962152+0000","last_clean":"2024-09-10T08:46:57.962152+0000","last_became_active":"2024-09-10T08:46:51.778893+0000","last_became_peered":"2024-09-10T08:46:51.778893+0000","last_unstale":"2024-09-10T08:46:57.962152+0000","last_undegraded":"2024-09-10T08:46:57.962152+0000","last_fullsized":"2024-09-10T08:46:57.962152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:24.598016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082934+0000","last_change":"2024-09-10T08:46:51.784880+0000","last_active":"2024-09-10T08:46:58.082934+0000","last_peered":"2024-09-10T08:46:58.082934+0000","last_clean":"2024-09-10T08:46:58.082934+0000","last_became_active":"2024-09-10T08:46:51.784571+0000","last_became_peered":"2024-09-10T08:46:51.784571+0000","last_unstale":"2024-09-10T08:46:58.082934+0000","last_undegraded":"2024-09-10T08:46:58.082934+0000","last_fullsized":"2024-09-10T08:46:58.082934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:24.598016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.569257+0000","last_change":"2024-09-10T08:46:51.778810+0000","last_active":"2024-09-10T08:46:57.569257+0000","last_peered":"2024-09-10T08:46:57.569257+0000","last_clean":"2024-09-10T08:46:57.569257+0000","last_became_active":"2024-09-10T08:46:51.777129+0000","last_became_peered":"2024-09-10T08:46:51.777129+0000","last_unstale":"2024-09-10T08:46:57.569257+0000","last_undegraded":"2024-09-10T08:46:57.569257+0000","last_fullsized":"2024-09-10T08:46:57.569257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:55:01.331346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083661+0000","last_change":"2024-09-10T08:46:51.777958+0000","last_active":"2024-09-10T08:46:58.083661+0000","last_peered":"2024-09-10T08:46:58.083661+0000","last_clean":"2024-09-10T08:46:58.083661+0000","last_became_active":"2024-09-10T08:46:51.777701+0000","last_became_peered":"2024-09-10T08:46:51.777701+0000","last_unstale":"2024-09-10T08:46:58.083661+0000","last_undegraded":"2024-09-10T08:46:58.083661+0000","last_fullsized":"2024-09-10T08:46:58.083661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:17:48.493127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.962500+0000","last_change":"2024-09-10T08:46:51.794577+0000","last_active":"2024-09-10T08:46:57.962500+0000","last_peered":"2024-09-10T08:46:57.962500+0000","last_clean":"2024-09-10T08:46:57.962500+0000","last_became_active":"2024-09-10T08:46:51.794266+0000","last_became_peered":"2024-09-10T08:46:51.794266+0000","last_unstale":"2024-09-10T08:46:57.962500+0000","last_undegraded":"2024-09-10T08:46:57.962500+0000","last_fullsized":"2024-09-10T08:46:57.962500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:48:03.814114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4642,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":104100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":104100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32028,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339812,"statfs":{"total":96636764160,"available":96603967488,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:47:17.984 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:47:18.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.174+0000 7f8d70c00640 1 Processor -- start 2024-09-10T08:47:18.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.175+0000 7f8d70c00640 1 -- start start 2024-09-10T08:47:18.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.176+0000 7f8d70c00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8d6c068060 0x7f8d6c0add80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:18.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.176+0000 7f8d70c00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d6c160e20 con 0x7f8d6c159f50 2024-09-10T08:47:18.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.176+0000 7f8d70c00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d6c160b40 con 0x7f8d6c15d5d0 2024-09-10T08:47:18.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.176+0000 7f8d70c00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f8d6c15caf0 con 0x7f8d6c068060 2024-09-10T08:47:18.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.176+0000 7f8d69e00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f8d6c159f50 0x7f8d6c15ffd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48450/0 (socket says 172.21.15.2:48450) 2024-09-10T08:47:18.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.176+0000 7f8d69e00640 1 -- 172.21.15.2:0/2579640471 learned_addr learned my addr 172.21.15.2:0/2579640471 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:47:18.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.176+0000 7f8d6a800640 1 --2- 172.21.15.2:0/2579640471 >> v2:172.21.15.155:3300/0 conn(0x7f8d6c068060 0x7f8d6c0add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:18.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.176+0000 7f8d69400640 1 -- 172.21.15.2:0/2579640471 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3104835095 0 0) 0x7f8d6c160e20 con 0x7f8d6c159f50 2024-09-10T08:47:18.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.177+0000 7f8d69400640 1 -- 172.21.15.2:0/2579640471 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d50003520 con 0x7f8d6c159f50 2024-09-10T08:47:18.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.177+0000 7f8d69400640 1 -- 172.21.15.2:0/2579640471 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1715827697 0 0) 0x7f8d6c160b40 con 0x7f8d6c15d5d0 2024-09-10T08:47:18.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.177+0000 7f8d69400640 1 -- 172.21.15.2:0/2579640471 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d6c160e20 con 0x7f8d6c15d5d0 2024-09-10T08:47:18.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.177+0000 7f8d69400640 1 -- 172.21.15.2:0/2579640471 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 546268549 0 0) 0x7f8d50003520 con 0x7f8d6c159f50 2024-09-10T08:47:18.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.177+0000 7f8d6a800640 1 -- 172.21.15.2:0/2579640471 >> v1:172.21.15.155:6789/0 conn(0x7f8d6c15d5d0 legacy=0x7f8d6c067950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:18.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.177+0000 7f8d6a800640 1 -- 172.21.15.2:0/2579640471 >> v1:172.21.15.2:6789/0 conn(0x7f8d6c159f50 legacy=0x7f8d6c15ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:18.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.177+0000 7f8d6a800640 1 -- 172.21.15.2:0/2579640471 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d6c15cdd0 con 0x7f8d6c068060 2024-09-10T08:47:18.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.178+0000 7f8d6a800640 1 --2- 172.21.15.2:0/2579640471 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d6c068060 0x7f8d6c0add80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8d64009d90 tx=0x7f8d6402a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f47e041ea88c993d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:18.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.178+0000 7f8d69400640 1 -- 172.21.15.2:0/2579640471 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c001670 con 0x7f8d6c068060 2024-09-10T08:47:18.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.178+0000 7f8d69400640 1 -- 172.21.15.2:0/2579640471 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d64007540 con 0x7f8d6c068060 2024-09-10T08:47:18.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.178+0000 7f8d69400640 1 -- 172.21.15.2:0/2579640471 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d640078f0 con 0x7f8d6c068060 2024-09-10T08:47:18.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.179+0000 7f8d70c00640 1 -- 172.21.15.2:0/2579640471 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d6c068060 msgr2=0x7f8d6c0add80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:18.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.179+0000 7f8d70c00640 1 --2- 172.21.15.2:0/2579640471 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d6c068060 0x7f8d6c0add80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8d64009d90 tx=0x7f8d6402a680 comp rx=0 tx=0).stop 2024-09-10T08:47:18.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.179+0000 7f8d70c00640 1 -- 172.21.15.2:0/2579640471 shutdown_connections 2024-09-10T08:47:18.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.179+0000 7f8d70c00640 1 --2- 172.21.15.2:0/2579640471 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d6c068060 0x7f8d6c0add80 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:18.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.179+0000 7f8d70c00640 1 -- 172.21.15.2:0/2579640471 >> 172.21.15.2:0/2579640471 conn(0x7f8d6c0735e0 msgr2=0x7f8d6c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:18.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.179+0000 7f8d70c00640 1 -- 172.21.15.2:0/2579640471 shutdown_connections 2024-09-10T08:47:18.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.179+0000 7f8d70c00640 1 -- 172.21.15.2:0/2579640471 wait complete. 2024-09-10T08:47:18.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.181+0000 7f8d70c00640 1 Processor -- start 2024-09-10T08:47:18.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.181+0000 7f8d70c00640 1 -- start start 2024-09-10T08:47:18.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.182+0000 7f8d70c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d6c068060 0x7f8d6c154690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:18.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.182+0000 7f8d70c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d6c159f50 0x7f8d6c0cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:18.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.182+0000 7f8d70c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d6c15d5d0 0x7f8d6c155a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:18.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.182+0000 7f8d70c00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8d6c15a330 con 0x7f8d6c068060 2024-09-10T08:47:18.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.182+0000 7f8d70c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8d6c070490 con 0x7f8d6c15d5d0 2024-09-10T08:47:18.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.182+0000 7f8d70c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8d6c1606e0 con 0x7f8d6c159f50 2024-09-10T08:47:18.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.182+0000 7f8d69e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d6c068060 0x7f8d6c154690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:18.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.182+0000 7f8d69e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d6c068060 0x7f8d6c154690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51178/0 (socket says 172.21.15.2:51178) 2024-09-10T08:47:18.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.182+0000 7f8d69e00640 1 -- 172.21.15.2:0/3562305496 learned_addr learned my addr 172.21.15.2:0/3562305496 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:18.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.182+0000 7f8d6a800640 1 --2- 172.21.15.2:0/3562305496 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d6c15d5d0 0x7f8d6c155a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:18.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.182+0000 7f8d63e00640 1 --2- 172.21.15.2:0/3562305496 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d6c159f50 0x7f8d6c0cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:18.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.182+0000 7f8d69e00640 1 -- 172.21.15.2:0/3562305496 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d6c159f50 msgr2=0x7f8d6c0cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:18.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.182+0000 7f8d69e00640 1 --2- 172.21.15.2:0/3562305496 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d6c159f50 0x7f8d6c0cf9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:18.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.182+0000 7f8d69e00640 1 -- 172.21.15.2:0/3562305496 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d6c15d5d0 msgr2=0x7f8d6c155a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:18.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.182+0000 7f8d69e00640 1 --2- 172.21.15.2:0/3562305496 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d6c15d5d0 0x7f8d6c155a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:18.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.182+0000 7f8d69e00640 1 -- 172.21.15.2:0/3562305496 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d6c157db0 con 0x7f8d6c068060 2024-09-10T08:47:18.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.182+0000 7f8d6a800640 1 --2- 172.21.15.2:0/3562305496 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d6c15d5d0 0x7f8d6c155a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:47:18.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.183+0000 7f8d69e00640 1 --2- 172.21.15.2:0/3562305496 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d6c068060 0x7f8d6c154690 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c001eb0 tx=0x7f8d5c00cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:18.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.183+0000 7f8d62000640 1 -- 172.21.15.2:0/3562305496 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c017070 con 0x7f8d6c068060 2024-09-10T08:47:18.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.183+0000 7f8d62000640 1 -- 172.21.15.2:0/3562305496 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d5c005ad0 con 0x7f8d6c068060 2024-09-10T08:47:18.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.183+0000 7f8d70c00640 1 -- 172.21.15.2:0/3562305496 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d6c158090 con 0x7f8d6c068060 2024-09-10T08:47:18.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.183+0000 7f8d62000640 1 -- 172.21.15.2:0/3562305496 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c007070 con 0x7f8d6c068060 2024-09-10T08:47:18.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.183+0000 7f8d70c00640 1 -- 172.21.15.2:0/3562305496 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d6c1553a0 con 0x7f8d6c068060 2024-09-10T08:47:18.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.184+0000 7f8d70c00640 1 -- 172.21.15.2:0/3562305496 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d6c15ffd0 con 0x7f8d6c068060 2024-09-10T08:47:18.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.185+0000 7f8d62000640 1 -- 172.21.15.2:0/3562305496 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8d5c01a070 con 0x7f8d6c068060 2024-09-10T08:47:18.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.186+0000 7f8d62000640 1 --2- 172.21.15.2:0/3562305496 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f8d4806be30 0x7f8d4806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:18.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.186+0000 7f8d62000640 1 -- 172.21.15.2:0/3562305496 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f8d5c08a830 con 0x7f8d6c068060 2024-09-10T08:47:18.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.186+0000 7f8d63e00640 1 --2- 172.21.15.2:0/3562305496 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f8d4806be30 0x7f8d4806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:18.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.187+0000 7f8d63e00640 1 --2- 172.21.15.2:0/3562305496 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f8d4806be30 0x7f8d4806e2f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c0b26f0 tx=0x7f8d54009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:18.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.190+0000 7f8d62000640 1 -- 172.21.15.2:0/3562305496 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8d5c058d80 con 0x7f8d6c068060 2024-09-10T08:47:18.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.368+0000 7f8d70c00640 1 -- 172.21.15.2:0/3562305496 --> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8d6c154bd0 con 0x7f8d4806be30 2024-09-10T08:47:18.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.377+0000 7f8d62000640 1 -- 172.21.15.2:0/3562305496 <== mgr.4099 v2:172.21.15.155:6832/2611418382 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332531 (secure 0 0 0) 0x7f8d54007c60 con 0x7f8d4806be30 2024-09-10T08:47:18.382 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:47:18.383 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-10T08:47:18.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.381+0000 7f8d70c00640 1 -- 172.21.15.2:0/3562305496 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f8d4806be30 msgr2=0x7f8d4806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:18.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.381+0000 7f8d70c00640 1 --2- 172.21.15.2:0/3562305496 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f8d4806be30 0x7f8d4806e2f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c0b26f0 tx=0x7f8d54009040 comp rx=0 tx=0).stop 2024-09-10T08:47:18.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.381+0000 7f8d70c00640 1 -- 172.21.15.2:0/3562305496 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d6c068060 msgr2=0x7f8d6c154690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:18.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.381+0000 7f8d70c00640 1 --2- 172.21.15.2:0/3562305496 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d6c068060 0x7f8d6c154690 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c001eb0 tx=0x7f8d5c00cbe0 comp rx=0 tx=0).stop 2024-09-10T08:47:18.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.381+0000 7f8d70c00640 1 -- 172.21.15.2:0/3562305496 shutdown_connections 2024-09-10T08:47:18.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.381+0000 7f8d70c00640 1 --2- 172.21.15.2:0/3562305496 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d6c15d5d0 0x7f8d6c155a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:18.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.381+0000 7f8d70c00640 1 --2- 172.21.15.2:0/3562305496 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f8d4806be30 0x7f8d4806e2f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:18.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.381+0000 7f8d70c00640 1 --2- 172.21.15.2:0/3562305496 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d6c159f50 0x7f8d6c0cf9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:18.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.381+0000 7f8d70c00640 1 --2- 172.21.15.2:0/3562305496 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8d6c068060 0x7f8d6c154690 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:18.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.381+0000 7f8d70c00640 1 -- 172.21.15.2:0/3562305496 >> 172.21.15.2:0/3562305496 conn(0x7f8d6c0735e0 msgr2=0x7f8d6c0aeca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:18.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.381+0000 7f8d70c00640 1 -- 172.21.15.2:0/3562305496 shutdown_connections 2024-09-10T08:47:18.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.381+0000 7f8d70c00640 1 -- 172.21.15.2:0/3562305496 wait complete. 2024-09-10T08:47:18.398 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-09-10T08:47:17.378049+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595010,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231916,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754742804,"statfs":{"total":773094113280,"available":772856631296,"internally_reserved":0,"allocated":3284992,"data_stored":1992068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":234016304},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003877"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.569663+0000","last_change":"2024-09-10T08:46:50.757068+0000","last_active":"2024-09-10T08:46:57.569663+0000","last_peered":"2024-09-10T08:46:57.569663+0000","last_clean":"2024-09-10T08:46:57.569663+0000","last_became_active":"2024-09-10T08:46:50.754880+0000","last_became_peered":"2024-09-10T08:46:50.754880+0000","last_unstale":"2024-09-10T08:46:57.569663+0000","last_undegraded":"2024-09-10T08:46:57.569663+0000","last_fullsized":"2024-09-10T08:46:57.569663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:56:12.627990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.084163+0000","last_change":"2024-09-10T08:46:51.773476+0000","last_active":"2024-09-10T08:46:58.084163+0000","last_peered":"2024-09-10T08:46:58.084163+0000","last_clean":"2024-09-10T08:46:58.084163+0000","last_became_active":"2024-09-10T08:46:51.773221+0000","last_became_peered":"2024-09-10T08:46:51.773221+0000","last_unstale":"2024-09-10T08:46:58.084163+0000","last_undegraded":"2024-09-10T08:46:58.084163+0000","last_fullsized":"2024-09-10T08:46:58.084163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:24.242861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082454+0000","last_change":"2024-09-10T08:46:55.882294+0000","last_active":"2024-09-10T08:46:58.082454+0000","last_peered":"2024-09-10T08:46:58.082454+0000","last_clean":"2024-09-10T08:46:58.082454+0000","last_became_active":"2024-09-10T08:46:55.881924+0000","last_became_peered":"2024-09-10T08:46:55.881924+0000","last_unstale":"2024-09-10T08:46:58.082454+0000","last_undegraded":"2024-09-10T08:46:58.082454+0000","last_fullsized":"2024-09-10T08:46:58.082454+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:09:55.956737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.084247+0000","last_change":"2024-09-10T08:46:50.763493+0000","last_active":"2024-09-10T08:46:58.084247+0000","last_peered":"2024-09-10T08:46:58.084247+0000","last_clean":"2024-09-10T08:46:58.084247+0000","last_became_active":"2024-09-10T08:46:50.761280+0000","last_became_peered":"2024-09-10T08:46:50.761280+0000","last_unstale":"2024-09-10T08:46:58.084247+0000","last_undegraded":"2024-09-10T08:46:58.084247+0000","last_fullsized":"2024-09-10T08:46:58.084247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:38:26.709117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.569396+0000","last_change":"2024-09-10T08:46:51.794099+0000","last_active":"2024-09-10T08:46:57.569396+0000","last_peered":"2024-09-10T08:46:57.569396+0000","last_clean":"2024-09-10T08:46:57.569396+0000","last_became_active":"2024-09-10T08:46:51.793831+0000","last_became_peered":"2024-09-10T08:46:51.793831+0000","last_unstale":"2024-09-10T08:46:57.569396+0000","last_undegraded":"2024-09-10T08:46:57.569396+0000","last_fullsized":"2024-09-10T08:46:57.569396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:17:48.493127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.805298+0000","last_change":"2024-09-10T08:46:55.835850+0000","last_active":"2024-09-10T08:46:56.805298+0000","last_peered":"2024-09-10T08:46:56.805298+0000","last_clean":"2024-09-10T08:46:56.805298+0000","last_became_active":"2024-09-10T08:46:55.834778+0000","last_became_peered":"2024-09-10T08:46:55.834778+0000","last_unstale":"2024-09-10T08:46:56.805298+0000","last_undegraded":"2024-09-10T08:46:56.805298+0000","last_fullsized":"2024-09-10T08:46:56.805298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:17:52.547720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.962530+0000","last_change":"2024-09-10T08:46:50.762150+0000","last_active":"2024-09-10T08:46:57.962530+0000","last_peered":"2024-09-10T08:46:57.962530+0000","last_clean":"2024-09-10T08:46:57.962530+0000","last_became_active":"2024-09-10T08:46:50.761706+0000","last_became_peered":"2024-09-10T08:46:50.761706+0000","last_unstale":"2024-09-10T08:46:57.962530+0000","last_undegraded":"2024-09-10T08:46:57.962530+0000","last_fullsized":"2024-09-10T08:46:57.962530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:23:06.043116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082889+0000","last_change":"2024-09-10T08:46:51.795776+0000","last_active":"2024-09-10T08:46:58.082889+0000","last_peered":"2024-09-10T08:46:58.082889+0000","last_clean":"2024-09-10T08:46:58.082889+0000","last_became_active":"2024-09-10T08:46:51.795503+0000","last_became_peered":"2024-09-10T08:46:51.795503+0000","last_unstale":"2024-09-10T08:46:58.082889+0000","last_undegraded":"2024-09-10T08:46:58.082889+0000","last_fullsized":"2024-09-10T08:46:58.082889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:17:50.559065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.806427+0000","last_change":"2024-09-10T08:46:55.836120+0000","last_active":"2024-09-10T08:46:56.806427+0000","last_peered":"2024-09-10T08:46:56.806427+0000","last_clean":"2024-09-10T08:46:56.806427+0000","last_became_active":"2024-09-10T08:46:55.834616+0000","last_became_peered":"2024-09-10T08:46:55.834616+0000","last_unstale":"2024-09-10T08:46:56.806427+0000","last_undegraded":"2024-09-10T08:46:56.806427+0000","last_fullsized":"2024-09-10T08:46:56.806427+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:02.411540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.962107+0000","last_change":"2024-09-10T08:46:50.775708+0000","last_active":"2024-09-10T08:46:57.962107+0000","last_peered":"2024-09-10T08:46:57.962107+0000","last_clean":"2024-09-10T08:46:57.962107+0000","last_became_active":"2024-09-10T08:46:50.775448+0000","last_became_peered":"2024-09-10T08:46:50.775448+0000","last_unstale":"2024-09-10T08:46:57.962107+0000","last_undegraded":"2024-09-10T08:46:57.962107+0000","last_fullsized":"2024-09-10T08:46:57.962107+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:27:43.187268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083129+0000","last_change":"2024-09-10T08:46:51.791061+0000","last_active":"2024-09-10T08:46:58.083129+0000","last_peered":"2024-09-10T08:46:58.083129+0000","last_clean":"2024-09-10T08:46:58.083129+0000","last_became_active":"2024-09-10T08:46:51.790526+0000","last_became_peered":"2024-09-10T08:46:51.790526+0000","last_unstale":"2024-09-10T08:46:58.083129+0000","last_undegraded":"2024-09-10T08:46:58.083129+0000","last_fullsized":"2024-09-10T08:46:58.083129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:48:03.814114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.805699+0000","last_change":"2024-09-10T08:46:55.823814+0000","last_active":"2024-09-10T08:46:56.805699+0000","last_peered":"2024-09-10T08:46:56.805699+0000","last_clean":"2024-09-10T08:46:56.805699+0000","last_became_active":"2024-09-10T08:46:55.823335+0000","last_became_peered":"2024-09-10T08:46:55.823335+0000","last_unstale":"2024-09-10T08:46:56.805699+0000","last_undegraded":"2024-09-10T08:46:56.805699+0000","last_fullsized":"2024-09-10T08:46:56.805699+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:41:12.315749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.805058+0000","last_change":"2024-09-10T08:46:51.781024+0000","last_active":"2024-09-10T08:46:56.805058+0000","last_peered":"2024-09-10T08:46:56.805058+0000","last_clean":"2024-09-10T08:46:56.805058+0000","last_became_active":"2024-09-10T08:46:51.780735+0000","last_became_peered":"2024-09-10T08:46:51.780735+0000","last_unstale":"2024-09-10T08:46:56.805058+0000","last_undegraded":"2024-09-10T08:46:56.805058+0000","last_fullsized":"2024-09-10T08:46:56.805058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:49:28.950554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.962318+0000","last_change":"2024-09-10T08:46:50.772598+0000","last_active":"2024-09-10T08:46:57.962318+0000","last_peered":"2024-09-10T08:46:57.962318+0000","last_clean":"2024-09-10T08:46:57.962318+0000","last_became_active":"2024-09-10T08:46:50.770687+0000","last_became_peered":"2024-09-10T08:46:50.770687+0000","last_unstale":"2024-09-10T08:46:57.962318+0000","last_undegraded":"2024-09-10T08:46:57.962318+0000","last_fullsized":"2024-09-10T08:46:57.962318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:55.305892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.806573+0000","last_change":"2024-09-10T08:46:55.831028+0000","last_active":"2024-09-10T08:46:56.806573+0000","last_peered":"2024-09-10T08:46:56.806573+0000","last_clean":"2024-09-10T08:46:56.806573+0000","last_became_active":"2024-09-10T08:46:55.830439+0000","last_became_peered":"2024-09-10T08:46:55.830439+0000","last_unstale":"2024-09-10T08:46:56.806573+0000","last_undegraded":"2024-09-10T08:46:56.806573+0000","last_fullsized":"2024-09-10T08:46:56.806573+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:17:54.613658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082547+0000","last_change":"2024-09-10T08:46:51.781312+0000","last_active":"2024-09-10T08:46:58.082547+0000","last_peered":"2024-09-10T08:46:58.082547+0000","last_clean":"2024-09-10T08:46:58.082547+0000","last_became_active":"2024-09-10T08:46:51.779810+0000","last_became_peered":"2024-09-10T08:46:51.779810+0000","last_unstale":"2024-09-10T08:46:58.082547+0000","last_undegraded":"2024-09-10T08:46:58.082547+0000","last_fullsized":"2024-09-10T08:46:58.082547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:55:01.331346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083271+0000","last_change":"2024-09-10T08:46:50.766807+0000","last_active":"2024-09-10T08:46:58.083271+0000","last_peered":"2024-09-10T08:46:58.083271+0000","last_clean":"2024-09-10T08:46:58.083271+0000","last_became_active":"2024-09-10T08:46:50.766511+0000","last_became_peered":"2024-09-10T08:46:50.766511+0000","last_unstale":"2024-09-10T08:46:58.083271+0000","last_undegraded":"2024-09-10T08:46:58.083271+0000","last_fullsized":"2024-09-10T08:46:58.083271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:02:43.005946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.805396+0000","last_change":"2024-09-10T08:46:55.835018+0000","last_active":"2024-09-10T08:46:56.805396+0000","last_peered":"2024-09-10T08:46:56.805396+0000","last_clean":"2024-09-10T08:46:56.805396+0000","last_became_active":"2024-09-10T08:46:55.834507+0000","last_became_peered":"2024-09-10T08:46:55.834507+0000","last_unstale":"2024-09-10T08:46:56.805396+0000","last_undegraded":"2024-09-10T08:46:56.805396+0000","last_fullsized":"2024-09-10T08:46:56.805396+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:12:33.767988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082297+0000","last_change":"2024-09-10T08:46:51.771494+0000","last_active":"2024-09-10T08:46:58.082297+0000","last_peered":"2024-09-10T08:46:58.082297+0000","last_clean":"2024-09-10T08:46:58.082297+0000","last_became_active":"2024-09-10T08:46:51.771158+0000","last_became_peered":"2024-09-10T08:46:51.771158+0000","last_unstale":"2024-09-10T08:46:58.082297+0000","last_undegraded":"2024-09-10T08:46:58.082297+0000","last_fullsized":"2024-09-10T08:46:58.082297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:41:08.261156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082874+0000","last_change":"2024-09-10T08:46:50.767844+0000","last_active":"2024-09-10T08:46:58.082874+0000","last_peered":"2024-09-10T08:46:58.082874+0000","last_clean":"2024-09-10T08:46:58.082874+0000","last_became_active":"2024-09-10T08:46:50.767532+0000","last_became_peered":"2024-09-10T08:46:50.767532+0000","last_unstale":"2024-09-10T08:46:58.082874+0000","last_undegraded":"2024-09-10T08:46:58.082874+0000","last_fullsized":"2024-09-10T08:46:58.082874+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:55.305892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083798+0000","last_change":"2024-09-10T08:46:55.881275+0000","last_active":"2024-09-10T08:46:58.083798+0000","last_peered":"2024-09-10T08:46:58.083798+0000","last_clean":"2024-09-10T08:46:58.083798+0000","last_became_active":"2024-09-10T08:46:55.880859+0000","last_became_peered":"2024-09-10T08:46:55.880859+0000","last_unstale":"2024-09-10T08:46:58.083798+0000","last_undegraded":"2024-09-10T08:46:58.083798+0000","last_fullsized":"2024-09-10T08:46:58.083798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:32:51.937086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.806377+0000","last_change":"2024-09-10T08:46:51.768270+0000","last_active":"2024-09-10T08:46:56.806377+0000","last_peered":"2024-09-10T08:46:56.806377+0000","last_clean":"2024-09-10T08:46:56.806377+0000","last_became_active":"2024-09-10T08:46:51.767974+0000","last_became_peered":"2024-09-10T08:46:51.767974+0000","last_unstale":"2024-09-10T08:46:56.806377+0000","last_undegraded":"2024-09-10T08:46:56.806377+0000","last_fullsized":"2024-09-10T08:46:56.806377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:13:17.725125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.961838+0000","last_change":"2024-09-10T08:46:50.768755+0000","last_active":"2024-09-10T08:46:57.961838+0000","last_peered":"2024-09-10T08:46:57.961838+0000","last_clean":"2024-09-10T08:46:57.961838+0000","last_became_active":"2024-09-10T08:46:50.768090+0000","last_became_peered":"2024-09-10T08:46:50.768090+0000","last_unstale":"2024-09-10T08:46:57.961838+0000","last_undegraded":"2024-09-10T08:46:57.961838+0000","last_fullsized":"2024-09-10T08:46:57.961838+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:13:16.717444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.806723+0000","last_change":"2024-09-10T08:46:55.823983+0000","last_active":"2024-09-10T08:46:56.806723+0000","last_peered":"2024-09-10T08:46:56.806723+0000","last_clean":"2024-09-10T08:46:56.806723+0000","last_became_active":"2024-09-10T08:46:55.823590+0000","last_became_peered":"2024-09-10T08:46:55.823590+0000","last_unstale":"2024-09-10T08:46:56.806723+0000","last_undegraded":"2024-09-10T08:46:56.806723+0000","last_fullsized":"2024-09-10T08:46:56.806723+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:48:07.868707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.569487+0000","last_change":"2024-09-10T08:46:51.776329+0000","last_active":"2024-09-10T08:46:57.569487+0000","last_peered":"2024-09-10T08:46:57.569487+0000","last_clean":"2024-09-10T08:46:57.569487+0000","last_became_active":"2024-09-10T08:46:51.775407+0000","last_became_peered":"2024-09-10T08:46:51.775407+0000","last_unstale":"2024-09-10T08:46:57.569487+0000","last_undegraded":"2024-09-10T08:46:57.569487+0000","last_fullsized":"2024-09-10T08:46:57.569487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:56:12.749632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.807054+0000","last_change":"2024-09-10T08:46:50.756330+0000","last_active":"2024-09-10T08:46:56.807054+0000","last_peered":"2024-09-10T08:46:56.807054+0000","last_clean":"2024-09-10T08:46:56.807054+0000","last_became_active":"2024-09-10T08:46:50.755912+0000","last_became_peered":"2024-09-10T08:46:50.755912+0000","last_unstale":"2024-09-10T08:46:56.807054+0000","last_undegraded":"2024-09-10T08:46:56.807054+0000","last_fullsized":"2024-09-10T08:46:56.807054+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:13:16.717444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.806363+0000","last_change":"2024-09-10T08:46:55.881993+0000","last_active":"2024-09-10T08:46:56.806363+0000","last_peered":"2024-09-10T08:46:56.806363+0000","last_clean":"2024-09-10T08:46:56.806363+0000","last_became_active":"2024-09-10T08:46:55.881654+0000","last_became_peered":"2024-09-10T08:46:55.881654+0000","last_unstale":"2024-09-10T08:46:56.806363+0000","last_undegraded":"2024-09-10T08:46:56.806363+0000","last_fullsized":"2024-09-10T08:46:56.806363+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:28.652609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.084400+0000","last_change":"2024-09-10T08:46:51.791470+0000","last_active":"2024-09-10T08:46:58.084400+0000","last_peered":"2024-09-10T08:46:58.084400+0000","last_clean":"2024-09-10T08:46:58.084400+0000","last_became_active":"2024-09-10T08:46:51.789315+0000","last_became_peered":"2024-09-10T08:46:51.789315+0000","last_unstale":"2024-09-10T08:46:58.084400+0000","last_undegraded":"2024-09-10T08:46:58.084400+0000","last_fullsized":"2024-09-10T08:46:58.084400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:35:58.356947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083695+0000","last_change":"2024-09-10T08:46:50.763200+0000","last_active":"2024-09-10T08:46:58.083695+0000","last_peered":"2024-09-10T08:46:58.083695+0000","last_clean":"2024-09-10T08:46:58.083695+0000","last_became_active":"2024-09-10T08:46:50.761919+0000","last_became_peered":"2024-09-10T08:46:50.761919+0000","last_unstale":"2024-09-10T08:46:58.083695+0000","last_undegraded":"2024-09-10T08:46:58.083695+0000","last_fullsized":"2024-09-10T08:46:58.083695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:27:43.187268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082087+0000","last_change":"2024-09-10T08:46:55.879120+0000","last_active":"2024-09-10T08:46:58.082087+0000","last_peered":"2024-09-10T08:46:58.082087+0000","last_clean":"2024-09-10T08:46:58.082087+0000","last_became_active":"2024-09-10T08:46:55.878150+0000","last_became_peered":"2024-09-10T08:46:55.878150+0000","last_unstale":"2024-09-10T08:46:58.082087+0000","last_undegraded":"2024-09-10T08:46:58.082087+0000","last_fullsized":"2024-09-10T08:46:58.082087+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:49:07.750480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083493+0000","last_change":"2024-09-10T08:46:51.764062+0000","last_active":"2024-09-10T08:46:58.083493+0000","last_peered":"2024-09-10T08:46:58.083493+0000","last_clean":"2024-09-10T08:46:58.083493+0000","last_became_active":"2024-09-10T08:46:51.763032+0000","last_became_peered":"2024-09-10T08:46:51.763032+0000","last_unstale":"2024-09-10T08:46:58.083493+0000","last_undegraded":"2024-09-10T08:46:58.083493+0000","last_fullsized":"2024-09-10T08:46:58.083493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:12:29.713395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.962641+0000","last_change":"2024-09-10T08:46:50.774433+0000","last_active":"2024-09-10T08:46:57.962641+0000","last_peered":"2024-09-10T08:46:57.962641+0000","last_clean":"2024-09-10T08:46:57.962641+0000","last_became_active":"2024-09-10T08:46:50.774032+0000","last_became_peered":"2024-09-10T08:46:50.774032+0000","last_unstale":"2024-09-10T08:46:57.962641+0000","last_undegraded":"2024-09-10T08:46:57.962641+0000","last_fullsized":"2024-09-10T08:46:57.962641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:20:23.136708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.569437+0000","last_change":"2024-09-10T08:46:55.884303+0000","last_active":"2024-09-10T08:46:57.569437+0000","last_peered":"2024-09-10T08:46:57.569437+0000","last_clean":"2024-09-10T08:46:57.569437+0000","last_became_active":"2024-09-10T08:46:55.880606+0000","last_became_peered":"2024-09-10T08:46:55.880606+0000","last_unstale":"2024-09-10T08:46:57.569437+0000","last_undegraded":"2024-09-10T08:46:57.569437+0000","last_fullsized":"2024-09-10T08:46:57.569437+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:28.966981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083135+0000","last_change":"2024-09-10T08:46:51.782882+0000","last_active":"2024-09-10T08:46:58.083135+0000","last_peered":"2024-09-10T08:46:58.083135+0000","last_clean":"2024-09-10T08:46:58.083135+0000","last_became_active":"2024-09-10T08:46:51.782618+0000","last_became_peered":"2024-09-10T08:46:51.782618+0000","last_unstale":"2024-09-10T08:46:58.083135+0000","last_undegraded":"2024-09-10T08:46:58.083135+0000","last_fullsized":"2024-09-10T08:46:58.083135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:53:54.788208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083587+0000","last_change":"2024-09-10T08:46:50.771532+0000","last_active":"2024-09-10T08:46:58.083587+0000","last_peered":"2024-09-10T08:46:58.083587+0000","last_clean":"2024-09-10T08:46:58.083587+0000","last_became_active":"2024-09-10T08:46:50.771211+0000","last_became_peered":"2024-09-10T08:46:50.771211+0000","last_unstale":"2024-09-10T08:46:58.083587+0000","last_undegraded":"2024-09-10T08:46:58.083587+0000","last_fullsized":"2024-09-10T08:46:58.083587+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:23:06.043116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083105+0000","last_change":"2024-09-10T08:46:55.833301+0000","last_active":"2024-09-10T08:46:58.083105+0000","last_peered":"2024-09-10T08:46:58.083105+0000","last_clean":"2024-09-10T08:46:58.083105+0000","last_became_active":"2024-09-10T08:46:55.832778+0000","last_became_peered":"2024-09-10T08:46:55.832778+0000","last_unstale":"2024-09-10T08:46:58.083105+0000","last_undegraded":"2024-09-10T08:46:58.083105+0000","last_fullsized":"2024-09-10T08:46:58.083105+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:38:27.475264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.806724+0000","last_change":"2024-09-10T08:46:51.773996+0000","last_active":"2024-09-10T08:46:56.806724+0000","last_peered":"2024-09-10T08:46:56.806724+0000","last_clean":"2024-09-10T08:46:56.806724+0000","last_became_active":"2024-09-10T08:46:51.773689+0000","last_became_peered":"2024-09-10T08:46:51.773689+0000","last_unstale":"2024-09-10T08:46:56.806724+0000","last_undegraded":"2024-09-10T08:46:56.806724+0000","last_fullsized":"2024-09-10T08:46:56.806724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:27:44.194949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083163+0000","last_change":"2024-09-10T08:46:50.769707+0000","last_active":"2024-09-10T08:46:58.083163+0000","last_peered":"2024-09-10T08:46:58.083163+0000","last_clean":"2024-09-10T08:46:58.083163+0000","last_became_active":"2024-09-10T08:46:50.769431+0000","last_became_peered":"2024-09-10T08:46:50.769431+0000","last_unstale":"2024-09-10T08:46:58.083163+0000","last_undegraded":"2024-09-10T08:46:58.083163+0000","last_fullsized":"2024-09-10T08:46:58.083163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:38:26.709117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083580+0000","last_change":"2024-09-10T08:46:55.825975+0000","last_active":"2024-09-10T08:46:58.083580+0000","last_peered":"2024-09-10T08:46:58.083580+0000","last_clean":"2024-09-10T08:46:58.083580+0000","last_became_active":"2024-09-10T08:46:55.824646+0000","last_became_peered":"2024-09-10T08:46:55.824646+0000","last_unstale":"2024-09-10T08:46:58.083580+0000","last_undegraded":"2024-09-10T08:46:58.083580+0000","last_fullsized":"2024-09-10T08:46:58.083580+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:30.769030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082407+0000","last_change":"2024-09-10T08:46:51.763566+0000","last_active":"2024-09-10T08:46:58.082407+0000","last_peered":"2024-09-10T08:46:58.082407+0000","last_clean":"2024-09-10T08:46:58.082407+0000","last_became_active":"2024-09-10T08:46:51.762799+0000","last_became_peered":"2024-09-10T08:46:51.762799+0000","last_unstale":"2024-09-10T08:46:58.082407+0000","last_undegraded":"2024-09-10T08:46:58.082407+0000","last_fullsized":"2024-09-10T08:46:58.082407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:32:41.996036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.804105+0000","last_change":"2024-09-10T08:46:50.759355+0000","last_active":"2024-09-10T08:46:56.804105+0000","last_peered":"2024-09-10T08:46:56.804105+0000","last_clean":"2024-09-10T08:46:56.804105+0000","last_became_active":"2024-09-10T08:46:50.758565+0000","last_became_peered":"2024-09-10T08:46:50.758565+0000","last_unstale":"2024-09-10T08:46:56.804105+0000","last_undegraded":"2024-09-10T08:46:56.804105+0000","last_fullsized":"2024-09-10T08:46:56.804105+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:02:43.005946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083886+0000","last_change":"2024-09-10T08:46:55.840925+0000","last_active":"2024-09-10T08:46:58.083886+0000","last_peered":"2024-09-10T08:46:58.083886+0000","last_clean":"2024-09-10T08:46:58.083886+0000","last_became_active":"2024-09-10T08:46:55.839186+0000","last_became_peered":"2024-09-10T08:46:55.839186+0000","last_unstale":"2024-09-10T08:46:58.083886+0000","last_undegraded":"2024-09-10T08:46:58.083886+0000","last_fullsized":"2024-09-10T08:46:58.083886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:28.966981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.568979+0000","last_change":"2024-09-10T08:46:51.793589+0000","last_active":"2024-09-10T08:46:57.568979+0000","last_peered":"2024-09-10T08:46:57.568979+0000","last_clean":"2024-09-10T08:46:57.568979+0000","last_became_active":"2024-09-10T08:46:51.792999+0000","last_became_peered":"2024-09-10T08:46:51.792999+0000","last_unstale":"2024-09-10T08:46:57.568979+0000","last_undegraded":"2024-09-10T08:46:57.568979+0000","last_fullsized":"2024-09-10T08:46:57.568979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:43:11.183186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.961882+0000","last_change":"2024-09-10T08:46:50.769021+0000","last_active":"2024-09-10T08:46:57.961882+0000","last_peered":"2024-09-10T08:46:57.961882+0000","last_clean":"2024-09-10T08:46:57.961882+0000","last_became_active":"2024-09-10T08:46:50.768447+0000","last_became_peered":"2024-09-10T08:46:50.768447+0000","last_unstale":"2024-09-10T08:46:57.961882+0000","last_undegraded":"2024-09-10T08:46:57.961882+0000","last_fullsized":"2024-09-10T08:46:57.961882+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:16:38.293555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.569408+0000","last_change":"2024-09-10T08:46:55.882489+0000","last_active":"2024-09-10T08:46:57.569408+0000","last_peered":"2024-09-10T08:46:57.569408+0000","last_clean":"2024-09-10T08:46:57.569408+0000","last_became_active":"2024-09-10T08:46:55.880753+0000","last_became_peered":"2024-09-10T08:46:55.880753+0000","last_unstale":"2024-09-10T08:46:57.569408+0000","last_undegraded":"2024-09-10T08:46:57.569408+0000","last_fullsized":"2024-09-10T08:46:57.569408+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:32:51.937086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082212+0000","last_change":"2024-09-10T08:46:51.780317+0000","last_active":"2024-09-10T08:46:58.082212+0000","last_peered":"2024-09-10T08:46:58.082212+0000","last_clean":"2024-09-10T08:46:58.082212+0000","last_became_active":"2024-09-10T08:46:51.780024+0000","last_became_peered":"2024-09-10T08:46:51.780024+0000","last_unstale":"2024-09-10T08:46:58.082212+0000","last_undegraded":"2024-09-10T08:46:58.082212+0000","last_fullsized":"2024-09-10T08:46:58.082212+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:32:41.996036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082934+0000","last_change":"2024-09-10T08:46:50.765202+0000","last_active":"2024-09-10T08:46:58.082934+0000","last_peered":"2024-09-10T08:46:58.082934+0000","last_clean":"2024-09-10T08:46:58.082934+0000","last_became_active":"2024-09-10T08:46:50.762976+0000","last_became_peered":"2024-09-10T08:46:50.762976+0000","last_unstale":"2024-09-10T08:46:58.082934+0000","last_undegraded":"2024-09-10T08:46:58.082934+0000","last_fullsized":"2024-09-10T08:46:58.082934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:13:16.717444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.962109+0000","last_change":"2024-09-10T08:46:42.177049+0000","last_active":"2024-09-10T08:46:57.962109+0000","last_peered":"2024-09-10T08:46:57.962109+0000","last_clean":"2024-09-10T08:46:57.962109+0000","last_became_active":"2024-09-10T08:46:42.175678+0000","last_became_peered":"2024-09-10T08:46:42.175678+0000","last_unstale":"2024-09-10T08:46:57.962109+0000","last_undegraded":"2024-09-10T08:46:57.962109+0000","last_fullsized":"2024-09-10T08:46:57.962109+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:40.326212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:40.326212+0000","last_clean_scrub_stamp":"2024-09-10T08:46:40.326212+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:06.642437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.806408+0000","last_change":"2024-09-10T08:46:55.881533+0000","last_active":"2024-09-10T08:46:56.806408+0000","last_peered":"2024-09-10T08:46:56.806408+0000","last_clean":"2024-09-10T08:46:56.806408+0000","last_became_active":"2024-09-10T08:46:55.880157+0000","last_became_peered":"2024-09-10T08:46:55.880157+0000","last_unstale":"2024-09-10T08:46:56.806408+0000","last_undegraded":"2024-09-10T08:46:56.806408+0000","last_fullsized":"2024-09-10T08:46:56.806408+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:17:54.613658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.962401+0000","last_change":"2024-09-10T08:46:51.793262+0000","last_active":"2024-09-10T08:46:57.962401+0000","last_peered":"2024-09-10T08:46:57.962401+0000","last_clean":"2024-09-10T08:46:57.962401+0000","last_became_active":"2024-09-10T08:46:51.792966+0000","last_became_peered":"2024-09-10T08:46:51.792966+0000","last_unstale":"2024-09-10T08:46:57.962401+0000","last_undegraded":"2024-09-10T08:46:57.962401+0000","last_fullsized":"2024-09-10T08:46:57.962401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:38:23.420671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.804380+0000","last_change":"2024-09-10T08:46:50.768436+0000","last_active":"2024-09-10T08:46:56.804380+0000","last_peered":"2024-09-10T08:46:56.804380+0000","last_clean":"2024-09-10T08:46:56.804380+0000","last_became_active":"2024-09-10T08:46:50.767236+0000","last_became_peered":"2024-09-10T08:46:50.767236+0000","last_unstale":"2024-09-10T08:46:56.804380+0000","last_undegraded":"2024-09-10T08:46:56.804380+0000","last_fullsized":"2024-09-10T08:46:56.804380+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:36:19.851847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.804996+0000","last_change":"2024-09-10T08:46:55.881541+0000","last_active":"2024-09-10T08:46:56.804996+0000","last_peered":"2024-09-10T08:46:56.804996+0000","last_clean":"2024-09-10T08:46:56.804996+0000","last_became_active":"2024-09-10T08:46:55.881029+0000","last_became_peered":"2024-09-10T08:46:55.881029+0000","last_unstale":"2024-09-10T08:46:56.804996+0000","last_undegraded":"2024-09-10T08:46:56.804996+0000","last_fullsized":"2024-09-10T08:46:56.804996+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:36:02.411540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083119+0000","last_change":"2024-09-10T08:46:51.783403+0000","last_active":"2024-09-10T08:46:58.083119+0000","last_peered":"2024-09-10T08:46:58.083119+0000","last_clean":"2024-09-10T08:46:58.083119+0000","last_became_active":"2024-09-10T08:46:51.781308+0000","last_became_peered":"2024-09-10T08:46:51.781308+0000","last_unstale":"2024-09-10T08:46:58.083119+0000","last_undegraded":"2024-09-10T08:46:58.083119+0000","last_fullsized":"2024-09-10T08:46:58.083119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:24:26.259501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083401+0000","last_change":"2024-09-10T08:46:50.769999+0000","last_active":"2024-09-10T08:46:58.083401+0000","last_peered":"2024-09-10T08:46:58.083401+0000","last_clean":"2024-09-10T08:46:58.083401+0000","last_became_active":"2024-09-10T08:46:50.769664+0000","last_became_peered":"2024-09-10T08:46:50.769664+0000","last_unstale":"2024-09-10T08:46:58.083401+0000","last_undegraded":"2024-09-10T08:46:58.083401+0000","last_fullsized":"2024-09-10T08:46:58.083401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:16:38.293555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.569544+0000","last_change":"2024-09-10T08:46:55.835422+0000","last_active":"2024-09-10T08:46:57.569544+0000","last_peered":"2024-09-10T08:46:57.569544+0000","last_clean":"2024-09-10T08:46:57.569544+0000","last_became_active":"2024-09-10T08:46:55.834891+0000","last_became_peered":"2024-09-10T08:46:55.834891+0000","last_unstale":"2024-09-10T08:46:57.569544+0000","last_undegraded":"2024-09-10T08:46:57.569544+0000","last_fullsized":"2024-09-10T08:46:57.569544+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:49:07.750480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.962646+0000","last_change":"2024-09-10T08:46:51.790394+0000","last_active":"2024-09-10T08:46:57.962646+0000","last_peered":"2024-09-10T08:46:57.962646+0000","last_clean":"2024-09-10T08:46:57.962646+0000","last_became_active":"2024-09-10T08:46:51.790110+0000","last_became_peered":"2024-09-10T08:46:51.790110+0000","last_unstale":"2024-09-10T08:46:57.962646+0000","last_undegraded":"2024-09-10T08:46:57.962646+0000","last_fullsized":"2024-09-10T08:46:57.962646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:32:47.882493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.804824+0000","last_change":"2024-09-10T08:46:50.768366+0000","last_active":"2024-09-10T08:46:56.804824+0000","last_peered":"2024-09-10T08:46:56.804824+0000","last_clean":"2024-09-10T08:46:56.804824+0000","last_became_active":"2024-09-10T08:46:50.768064+0000","last_became_peered":"2024-09-10T08:46:50.768064+0000","last_unstale":"2024-09-10T08:46:56.804824+0000","last_undegraded":"2024-09-10T08:46:56.804824+0000","last_fullsized":"2024-09-10T08:46:56.804824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:41:14.189488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082532+0000","last_change":"2024-09-10T08:46:55.881381+0000","last_active":"2024-09-10T08:46:58.082532+0000","last_peered":"2024-09-10T08:46:58.082532+0000","last_clean":"2024-09-10T08:46:58.082532+0000","last_became_active":"2024-09-10T08:46:55.880233+0000","last_became_peered":"2024-09-10T08:46:55.880233+0000","last_unstale":"2024-09-10T08:46:58.082532+0000","last_undegraded":"2024-09-10T08:46:58.082532+0000","last_fullsized":"2024-09-10T08:46:58.082532+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:18:56.316368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.962469+0000","last_change":"2024-09-10T08:46:51.796394+0000","last_active":"2024-09-10T08:46:57.962469+0000","last_peered":"2024-09-10T08:46:57.962469+0000","last_clean":"2024-09-10T08:46:57.962469+0000","last_became_active":"2024-09-10T08:46:51.795460+0000","last_became_peered":"2024-09-10T08:46:51.795460+0000","last_unstale":"2024-09-10T08:46:57.962469+0000","last_undegraded":"2024-09-10T08:46:57.962469+0000","last_fullsized":"2024-09-10T08:46:57.962469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:24.912388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.805830+0000","last_change":"2024-09-10T08:46:50.764621+0000","last_active":"2024-09-10T08:46:56.805830+0000","last_peered":"2024-09-10T08:46:56.805830+0000","last_clean":"2024-09-10T08:46:56.805830+0000","last_became_active":"2024-09-10T08:46:50.764262+0000","last_became_peered":"2024-09-10T08:46:50.764262+0000","last_unstale":"2024-09-10T08:46:56.805830+0000","last_undegraded":"2024-09-10T08:46:56.805830+0000","last_fullsized":"2024-09-10T08:46:56.805830+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:16:18.256394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.805988+0000","last_change":"2024-09-10T08:46:55.835039+0000","last_active":"2024-09-10T08:46:56.805988+0000","last_peered":"2024-09-10T08:46:56.805988+0000","last_clean":"2024-09-10T08:46:56.805988+0000","last_became_active":"2024-09-10T08:46:55.834520+0000","last_became_peered":"2024-09-10T08:46:55.834520+0000","last_unstale":"2024-09-10T08:46:56.805988+0000","last_undegraded":"2024-09-10T08:46:56.805988+0000","last_fullsized":"2024-09-10T08:46:56.805988+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:28.297454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.962089+0000","last_change":"2024-09-10T08:46:51.792053+0000","last_active":"2024-09-10T08:46:57.962089+0000","last_peered":"2024-09-10T08:46:57.962089+0000","last_clean":"2024-09-10T08:46:57.962089+0000","last_became_active":"2024-09-10T08:46:51.791729+0000","last_became_peered":"2024-09-10T08:46:51.791729+0000","last_unstale":"2024-09-10T08:46:57.962089+0000","last_undegraded":"2024-09-10T08:46:57.962089+0000","last_fullsized":"2024-09-10T08:46:57.962089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:35:58.356947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.803934+0000","last_change":"2024-09-10T08:46:50.762530+0000","last_active":"2024-09-10T08:46:56.803934+0000","last_peered":"2024-09-10T08:46:56.803934+0000","last_clean":"2024-09-10T08:46:56.803934+0000","last_became_active":"2024-09-10T08:46:50.762274+0000","last_became_peered":"2024-09-10T08:46:50.762274+0000","last_unstale":"2024-09-10T08:46:56.803934+0000","last_undegraded":"2024-09-10T08:46:56.803934+0000","last_fullsized":"2024-09-10T08:46:56.803934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:38:26.709117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.569309+0000","last_change":"2024-09-10T08:46:55.837828+0000","last_active":"2024-09-10T08:46:57.569309+0000","last_peered":"2024-09-10T08:46:57.569309+0000","last_clean":"2024-09-10T08:46:57.569309+0000","last_became_active":"2024-09-10T08:46:55.837157+0000","last_became_peered":"2024-09-10T08:46:55.837157+0000","last_unstale":"2024-09-10T08:46:57.569309+0000","last_undegraded":"2024-09-10T08:46:57.569309+0000","last_fullsized":"2024-09-10T08:46:57.569309+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:30.769030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.805426+0000","last_change":"2024-09-10T08:46:51.780767+0000","last_active":"2024-09-10T08:46:56.805426+0000","last_peered":"2024-09-10T08:46:56.805426+0000","last_clean":"2024-09-10T08:46:56.805426+0000","last_became_active":"2024-09-10T08:46:51.780429+0000","last_became_peered":"2024-09-10T08:46:51.780429+0000","last_unstale":"2024-09-10T08:46:56.805426+0000","last_undegraded":"2024-09-10T08:46:56.805426+0000","last_fullsized":"2024-09-10T08:46:56.805426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:43:11.183186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.805298+0000","last_change":"2024-09-10T08:46:50.767724+0000","last_active":"2024-09-10T08:46:56.805298+0000","last_peered":"2024-09-10T08:46:56.805298+0000","last_clean":"2024-09-10T08:46:56.805298+0000","last_became_active":"2024-09-10T08:46:50.767440+0000","last_became_peered":"2024-09-10T08:46:50.767440+0000","last_unstale":"2024-09-10T08:46:56.805298+0000","last_undegraded":"2024-09-10T08:46:56.805298+0000","last_fullsized":"2024-09-10T08:46:56.805298+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:36:19.851847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.084325+0000","last_change":"2024-09-10T08:46:55.881726+0000","last_active":"2024-09-10T08:46:58.084325+0000","last_peered":"2024-09-10T08:46:58.084325+0000","last_clean":"2024-09-10T08:46:58.084325+0000","last_became_active":"2024-09-10T08:46:55.881215+0000","last_became_peered":"2024-09-10T08:46:55.881215+0000","last_unstale":"2024-09-10T08:46:58.084325+0000","last_undegraded":"2024-09-10T08:46:58.084325+0000","last_fullsized":"2024-09-10T08:46:58.084325+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:55:12.631797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.962268+0000","last_change":"2024-09-10T08:46:51.802443+0000","last_active":"2024-09-10T08:46:57.962268+0000","last_peered":"2024-09-10T08:46:57.962268+0000","last_clean":"2024-09-10T08:46:57.962268+0000","last_became_active":"2024-09-10T08:46:51.800377+0000","last_became_peered":"2024-09-10T08:46:51.800377+0000","last_unstale":"2024-09-10T08:46:57.962268+0000","last_undegraded":"2024-09-10T08:46:57.962268+0000","last_fullsized":"2024-09-10T08:46:57.962268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:17:50.559065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082973+0000","last_change":"2024-09-10T08:46:50.770106+0000","last_active":"2024-09-10T08:46:58.082973+0000","last_peered":"2024-09-10T08:46:58.082973+0000","last_clean":"2024-09-10T08:46:58.082973+0000","last_became_active":"2024-09-10T08:46:50.769664+0000","last_became_peered":"2024-09-10T08:46:50.769664+0000","last_unstale":"2024-09-10T08:46:58.082973+0000","last_undegraded":"2024-09-10T08:46:58.082973+0000","last_fullsized":"2024-09-10T08:46:58.082973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:02:43.005946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082899+0000","last_change":"2024-09-10T08:46:55.878519+0000","last_active":"2024-09-10T08:46:58.082899+0000","last_peered":"2024-09-10T08:46:58.082899+0000","last_clean":"2024-09-10T08:46:58.082899+0000","last_became_active":"2024-09-10T08:46:55.877986+0000","last_became_peered":"2024-09-10T08:46:55.877986+0000","last_unstale":"2024-09-10T08:46:58.082899+0000","last_undegraded":"2024-09-10T08:46:58.082899+0000","last_fullsized":"2024-09-10T08:46:58.082899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:29:38.674946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.569136+0000","last_change":"2024-09-10T08:46:51.788482+0000","last_active":"2024-09-10T08:46:57.569136+0000","last_peered":"2024-09-10T08:46:57.569136+0000","last_clean":"2024-09-10T08:46:57.569136+0000","last_became_active":"2024-09-10T08:46:51.787872+0000","last_became_peered":"2024-09-10T08:46:51.787872+0000","last_unstale":"2024-09-10T08:46:57.569136+0000","last_undegraded":"2024-09-10T08:46:57.569136+0000","last_fullsized":"2024-09-10T08:46:57.569136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:49:28.950554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.569602+0000","last_change":"2024-09-10T08:46:50.766888+0000","last_active":"2024-09-10T08:46:57.569602+0000","last_peered":"2024-09-10T08:46:57.569602+0000","last_clean":"2024-09-10T08:46:57.569602+0000","last_became_active":"2024-09-10T08:46:50.766608+0000","last_became_peered":"2024-09-10T08:46:50.766608+0000","last_unstale":"2024-09-10T08:46:57.569602+0000","last_undegraded":"2024-09-10T08:46:57.569602+0000","last_fullsized":"2024-09-10T08:46:57.569602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:41:14.189488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083056+0000","last_change":"2024-09-10T08:46:55.878767+0000","last_active":"2024-09-10T08:46:58.083056+0000","last_peered":"2024-09-10T08:46:58.083056+0000","last_clean":"2024-09-10T08:46:58.083056+0000","last_became_active":"2024-09-10T08:46:55.878328+0000","last_became_peered":"2024-09-10T08:46:55.878328+0000","last_unstale":"2024-09-10T08:46:58.083056+0000","last_undegraded":"2024-09-10T08:46:58.083056+0000","last_fullsized":"2024-09-10T08:46:58.083056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:29:38.674946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.962269+0000","last_change":"2024-09-10T08:46:51.782671+0000","last_active":"2024-09-10T08:46:57.962269+0000","last_peered":"2024-09-10T08:46:57.962269+0000","last_clean":"2024-09-10T08:46:57.962269+0000","last_became_active":"2024-09-10T08:46:51.782072+0000","last_became_peered":"2024-09-10T08:46:51.782072+0000","last_unstale":"2024-09-10T08:46:57.962269+0000","last_undegraded":"2024-09-10T08:46:57.962269+0000","last_fullsized":"2024-09-10T08:46:57.962269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:24:26.259501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:47:03.196847+0000","last_change":"2024-09-10T08:46:50.763937+0000","last_active":"2024-09-10T08:47:03.196847+0000","last_peered":"2024-09-10T08:47:03.196847+0000","last_clean":"2024-09-10T08:47:03.196847+0000","last_became_active":"2024-09-10T08:46:50.763447+0000","last_became_peered":"2024-09-10T08:46:50.763447+0000","last_unstale":"2024-09-10T08:47:03.196847+0000","last_undegraded":"2024-09-10T08:47:03.196847+0000","last_fullsized":"2024-09-10T08:47:03.196847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:16:38.293555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083220+0000","last_change":"2024-09-10T08:46:55.822409+0000","last_active":"2024-09-10T08:46:58.083220+0000","last_peered":"2024-09-10T08:46:58.083220+0000","last_clean":"2024-09-10T08:46:58.083220+0000","last_became_active":"2024-09-10T08:46:55.821875+0000","last_became_peered":"2024-09-10T08:46:55.821875+0000","last_unstale":"2024-09-10T08:46:58.083220+0000","last_undegraded":"2024-09-10T08:46:58.083220+0000","last_fullsized":"2024-09-10T08:46:58.083220+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:53:58.842801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.805662+0000","last_change":"2024-09-10T08:46:51.780453+0000","last_active":"2024-09-10T08:46:56.805662+0000","last_peered":"2024-09-10T08:46:56.805662+0000","last_clean":"2024-09-10T08:46:56.805662+0000","last_became_active":"2024-09-10T08:46:51.780160+0000","last_became_peered":"2024-09-10T08:46:51.780160+0000","last_unstale":"2024-09-10T08:46:56.805662+0000","last_undegraded":"2024-09-10T08:46:56.805662+0000","last_fullsized":"2024-09-10T08:46:56.805662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:23:07.050797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083373+0000","last_change":"2024-09-10T08:46:50.777289+0000","last_active":"2024-09-10T08:46:58.083373+0000","last_peered":"2024-09-10T08:46:58.083373+0000","last_clean":"2024-09-10T08:46:58.083373+0000","last_became_active":"2024-09-10T08:46:50.776985+0000","last_became_peered":"2024-09-10T08:46:50.776985+0000","last_unstale":"2024-09-10T08:46:58.083373+0000","last_undegraded":"2024-09-10T08:46:58.083373+0000","last_fullsized":"2024-09-10T08:46:58.083373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:13:16.717444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.806645+0000","last_change":"2024-09-10T08:46:55.818962+0000","last_active":"2024-09-10T08:46:56.806645+0000","last_peered":"2024-09-10T08:46:56.806645+0000","last_clean":"2024-09-10T08:46:56.806645+0000","last_became_active":"2024-09-10T08:46:55.818548+0000","last_became_peered":"2024-09-10T08:46:55.818548+0000","last_unstale":"2024-09-10T08:46:56.806645+0000","last_undegraded":"2024-09-10T08:46:56.806645+0000","last_fullsized":"2024-09-10T08:46:56.806645+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:24:30.314094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.569570+0000","last_change":"2024-09-10T08:46:51.786958+0000","last_active":"2024-09-10T08:46:57.569570+0000","last_peered":"2024-09-10T08:46:57.569570+0000","last_clean":"2024-09-10T08:46:57.569570+0000","last_became_active":"2024-09-10T08:46:51.786679+0000","last_became_peered":"2024-09-10T08:46:51.786679+0000","last_unstale":"2024-09-10T08:46:57.569570+0000","last_undegraded":"2024-09-10T08:46:57.569570+0000","last_fullsized":"2024-09-10T08:46:57.569570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:12:29.713395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083066+0000","last_change":"2024-09-10T08:46:50.770627+0000","last_active":"2024-09-10T08:46:58.083066+0000","last_peered":"2024-09-10T08:46:58.083066+0000","last_clean":"2024-09-10T08:46:58.083066+0000","last_became_active":"2024-09-10T08:46:50.770108+0000","last_became_peered":"2024-09-10T08:46:50.770108+0000","last_unstale":"2024-09-10T08:46:58.083066+0000","last_undegraded":"2024-09-10T08:46:58.083066+0000","last_fullsized":"2024-09-10T08:46:58.083066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:16:38.293555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082271+0000","last_change":"2024-09-10T08:46:55.834973+0000","last_active":"2024-09-10T08:46:58.082271+0000","last_peered":"2024-09-10T08:46:58.082271+0000","last_clean":"2024-09-10T08:46:58.082271+0000","last_became_active":"2024-09-10T08:46:55.834553+0000","last_became_peered":"2024-09-10T08:46:55.834553+0000","last_unstale":"2024-09-10T08:46:58.082271+0000","last_undegraded":"2024-09-10T08:46:58.082271+0000","last_fullsized":"2024-09-10T08:46:58.082271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:48:45.215364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082933+0000","last_change":"2024-09-10T08:46:51.792047+0000","last_active":"2024-09-10T08:46:58.082933+0000","last_peered":"2024-09-10T08:46:58.082933+0000","last_clean":"2024-09-10T08:46:58.082933+0000","last_became_active":"2024-09-10T08:46:51.790021+0000","last_became_peered":"2024-09-10T08:46:51.790021+0000","last_unstale":"2024-09-10T08:46:58.082933+0000","last_undegraded":"2024-09-10T08:46:58.082933+0000","last_fullsized":"2024-09-10T08:46:58.082933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:26.714437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.806941+0000","last_change":"2024-09-10T08:46:50.766074+0000","last_active":"2024-09-10T08:46:56.806941+0000","last_peered":"2024-09-10T08:46:56.806941+0000","last_clean":"2024-09-10T08:46:56.806941+0000","last_became_active":"2024-09-10T08:46:50.765744+0000","last_became_peered":"2024-09-10T08:46:50.765744+0000","last_unstale":"2024-09-10T08:46:56.806941+0000","last_undegraded":"2024-09-10T08:46:56.806941+0000","last_fullsized":"2024-09-10T08:46:56.806941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:02:43.005946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082526+0000","last_change":"2024-09-10T08:46:55.883453+0000","last_active":"2024-09-10T08:46:58.082526+0000","last_peered":"2024-09-10T08:46:58.082526+0000","last_clean":"2024-09-10T08:46:58.082526+0000","last_became_active":"2024-09-10T08:46:55.883030+0000","last_became_peered":"2024-09-10T08:46:55.883030+0000","last_unstale":"2024-09-10T08:46:58.082526+0000","last_undegraded":"2024-09-10T08:46:58.082526+0000","last_fullsized":"2024-09-10T08:46:58.082526+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:18:56.316368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.569239+0000","last_change":"2024-09-10T08:46:55.885568+0000","last_active":"2024-09-10T08:46:57.569239+0000","last_peered":"2024-09-10T08:46:57.569239+0000","last_clean":"2024-09-10T08:46:57.569239+0000","last_became_active":"2024-09-10T08:46:55.884728+0000","last_became_peered":"2024-09-10T08:46:55.884728+0000","last_unstale":"2024-09-10T08:46:57.569239+0000","last_undegraded":"2024-09-10T08:46:57.569239+0000","last_fullsized":"2024-09-10T08:46:57.569239+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:53:58.842801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082702+0000","last_change":"2024-09-10T08:46:51.772447+0000","last_active":"2024-09-10T08:46:58.082702+0000","last_peered":"2024-09-10T08:46:58.082702+0000","last_clean":"2024-09-10T08:46:58.082702+0000","last_became_active":"2024-09-10T08:46:51.772157+0000","last_became_peered":"2024-09-10T08:46:51.772157+0000","last_unstale":"2024-09-10T08:46:58.082702+0000","last_undegraded":"2024-09-10T08:46:58.082702+0000","last_fullsized":"2024-09-10T08:46:58.082702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:55:01.331346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082601+0000","last_change":"2024-09-10T08:46:50.773438+0000","last_active":"2024-09-10T08:46:58.082601+0000","last_peered":"2024-09-10T08:46:58.082601+0000","last_clean":"2024-09-10T08:46:58.082601+0000","last_became_active":"2024-09-10T08:46:50.769939+0000","last_became_peered":"2024-09-10T08:46:50.769939+0000","last_unstale":"2024-09-10T08:46:58.082601+0000","last_undegraded":"2024-09-10T08:46:58.082601+0000","last_fullsized":"2024-09-10T08:46:58.082601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:27:43.187268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.806816+0000","last_change":"2024-09-10T08:46:55.833783+0000","last_active":"2024-09-10T08:46:56.806816+0000","last_peered":"2024-09-10T08:46:56.806816+0000","last_clean":"2024-09-10T08:46:56.806816+0000","last_became_active":"2024-09-10T08:46:55.833320+0000","last_became_peered":"2024-09-10T08:46:55.833320+0000","last_unstale":"2024-09-10T08:46:56.806816+0000","last_undegraded":"2024-09-10T08:46:56.806816+0000","last_fullsized":"2024-09-10T08:46:56.806816+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:24:30.314094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082200+0000","last_change":"2024-09-10T08:46:51.773700+0000","last_active":"2024-09-10T08:46:58.082200+0000","last_peered":"2024-09-10T08:46:58.082200+0000","last_clean":"2024-09-10T08:46:58.082200+0000","last_became_active":"2024-09-10T08:46:51.771497+0000","last_became_peered":"2024-09-10T08:46:51.771497+0000","last_unstale":"2024-09-10T08:46:58.082200+0000","last_undegraded":"2024-09-10T08:46:58.082200+0000","last_fullsized":"2024-09-10T08:46:58.082200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:12:29.713395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082693+0000","last_change":"2024-09-10T08:46:50.760228+0000","last_active":"2024-09-10T08:46:58.082693+0000","last_peered":"2024-09-10T08:46:58.082693+0000","last_clean":"2024-09-10T08:46:58.082693+0000","last_became_active":"2024-09-10T08:46:50.759920+0000","last_became_peered":"2024-09-10T08:46:50.759920+0000","last_unstale":"2024-09-10T08:46:58.082693+0000","last_undegraded":"2024-09-10T08:46:58.082693+0000","last_fullsized":"2024-09-10T08:46:58.082693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:41:14.189488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.805887+0000","last_change":"2024-09-10T08:46:50.767239+0000","last_active":"2024-09-10T08:46:56.805887+0000","last_peered":"2024-09-10T08:46:56.805887+0000","last_clean":"2024-09-10T08:46:56.805887+0000","last_became_active":"2024-09-10T08:46:50.766809+0000","last_became_peered":"2024-09-10T08:46:50.766809+0000","last_unstale":"2024-09-10T08:46:56.805887+0000","last_undegraded":"2024-09-10T08:46:56.805887+0000","last_fullsized":"2024-09-10T08:46:56.805887+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:38:26.709117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.569591+0000","last_change":"2024-09-10T08:46:51.794973+0000","last_active":"2024-09-10T08:46:57.569591+0000","last_peered":"2024-09-10T08:46:57.569591+0000","last_clean":"2024-09-10T08:46:57.569591+0000","last_became_active":"2024-09-10T08:46:51.794731+0000","last_became_peered":"2024-09-10T08:46:51.794731+0000","last_unstale":"2024-09-10T08:46:57.569591+0000","last_undegraded":"2024-09-10T08:46:57.569591+0000","last_fullsized":"2024-09-10T08:46:57.569591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:40:55.949890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.804311+0000","last_change":"2024-09-10T08:46:55.824916+0000","last_active":"2024-09-10T08:46:56.804311+0000","last_peered":"2024-09-10T08:46:56.804311+0000","last_clean":"2024-09-10T08:46:56.804311+0000","last_became_active":"2024-09-10T08:46:55.823750+0000","last_became_peered":"2024-09-10T08:46:55.823750+0000","last_unstale":"2024-09-10T08:46:56.804311+0000","last_undegraded":"2024-09-10T08:46:56.804311+0000","last_fullsized":"2024-09-10T08:46:56.804311+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:29:01.507822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082610+0000","last_change":"2024-09-10T08:46:50.759413+0000","last_active":"2024-09-10T08:46:58.082610+0000","last_peered":"2024-09-10T08:46:58.082610+0000","last_clean":"2024-09-10T08:46:58.082610+0000","last_became_active":"2024-09-10T08:46:50.759045+0000","last_became_peered":"2024-09-10T08:46:50.759045+0000","last_unstale":"2024-09-10T08:46:58.082610+0000","last_undegraded":"2024-09-10T08:46:58.082610+0000","last_fullsized":"2024-09-10T08:46:58.082610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:49.727667+0000","last_clean_scrub_stamp":"2024-09-10T08:46:49.727667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:36:19.851847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.805928+0000","last_change":"2024-09-10T08:46:51.769795+0000","last_active":"2024-09-10T08:46:56.805928+0000","last_peered":"2024-09-10T08:46:56.805928+0000","last_clean":"2024-09-10T08:46:56.805928+0000","last_became_active":"2024-09-10T08:46:51.769482+0000","last_became_peered":"2024-09-10T08:46:51.769482+0000","last_unstale":"2024-09-10T08:46:56.805928+0000","last_undegraded":"2024-09-10T08:46:56.805928+0000","last_fullsized":"2024-09-10T08:46:56.805928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:16:39.301236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.084120+0000","last_change":"2024-09-10T08:46:55.827136+0000","last_active":"2024-09-10T08:46:58.084120+0000","last_peered":"2024-09-10T08:46:58.084120+0000","last_clean":"2024-09-10T08:46:58.084120+0000","last_became_active":"2024-09-10T08:46:55.826597+0000","last_became_peered":"2024-09-10T08:46:55.826597+0000","last_unstale":"2024-09-10T08:46:58.084120+0000","last_undegraded":"2024-09-10T08:46:58.084120+0000","last_fullsized":"2024-09-10T08:46:58.084120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:54.789941+0000","last_clean_scrub_stamp":"2024-09-10T08:46:54.789941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:01:01.534963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.805190+0000","last_change":"2024-09-10T08:46:51.775032+0000","last_active":"2024-09-10T08:46:56.805190+0000","last_peered":"2024-09-10T08:46:56.805190+0000","last_clean":"2024-09-10T08:46:56.805190+0000","last_became_active":"2024-09-10T08:46:51.774669+0000","last_became_peered":"2024-09-10T08:46:51.774669+0000","last_unstale":"2024-09-10T08:46:56.805190+0000","last_undegraded":"2024-09-10T08:46:56.805190+0000","last_fullsized":"2024-09-10T08:46:56.805190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:40:55.949890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.804036+0000","last_change":"2024-09-10T08:46:51.796531+0000","last_active":"2024-09-10T08:46:56.804036+0000","last_peered":"2024-09-10T08:46:56.804036+0000","last_clean":"2024-09-10T08:46:56.804036+0000","last_became_active":"2024-09-10T08:46:51.796249+0000","last_became_peered":"2024-09-10T08:46:51.796249+0000","last_unstale":"2024-09-10T08:46:56.804036+0000","last_undegraded":"2024-09-10T08:46:56.804036+0000","last_fullsized":"2024-09-10T08:46:56.804036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:23:07.050797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083010+0000","last_change":"2024-09-10T08:46:51.781773+0000","last_active":"2024-09-10T08:46:58.083010+0000","last_peered":"2024-09-10T08:46:58.083010+0000","last_clean":"2024-09-10T08:46:58.083010+0000","last_became_active":"2024-09-10T08:46:51.781397+0000","last_became_peered":"2024-09-10T08:46:51.781397+0000","last_unstale":"2024-09-10T08:46:58.083010+0000","last_undegraded":"2024-09-10T08:46:58.083010+0000","last_fullsized":"2024-09-10T08:46:58.083010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:35:58.356947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.569502+0000","last_change":"2024-09-10T08:46:51.780877+0000","last_active":"2024-09-10T08:46:57.569502+0000","last_peered":"2024-09-10T08:46:57.569502+0000","last_clean":"2024-09-10T08:46:57.569502+0000","last_became_active":"2024-09-10T08:46:51.778471+0000","last_became_peered":"2024-09-10T08:46:51.778471+0000","last_unstale":"2024-09-10T08:46:57.569502+0000","last_undegraded":"2024-09-10T08:46:57.569502+0000","last_fullsized":"2024-09-10T08:46:57.569502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:32:41.996036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083021+0000","last_change":"2024-09-10T08:46:51.777079+0000","last_active":"2024-09-10T08:46:58.083021+0000","last_peered":"2024-09-10T08:46:58.083021+0000","last_clean":"2024-09-10T08:46:58.083021+0000","last_became_active":"2024-09-10T08:46:51.776561+0000","last_became_peered":"2024-09-10T08:46:51.776561+0000","last_unstale":"2024-09-10T08:46:58.083021+0000","last_undegraded":"2024-09-10T08:46:58.083021+0000","last_fullsized":"2024-09-10T08:46:58.083021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:17:48.493127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083242+0000","last_change":"2024-09-10T08:46:51.772455+0000","last_active":"2024-09-10T08:46:58.083242+0000","last_peered":"2024-09-10T08:46:58.083242+0000","last_clean":"2024-09-10T08:46:58.083242+0000","last_became_active":"2024-09-10T08:46:51.772177+0000","last_became_peered":"2024-09-10T08:46:51.772177+0000","last_unstale":"2024-09-10T08:46:58.083242+0000","last_undegraded":"2024-09-10T08:46:58.083242+0000","last_fullsized":"2024-09-10T08:46:58.083242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:56:12.749632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.807011+0000","last_change":"2024-09-10T08:46:51.787208+0000","last_active":"2024-09-10T08:46:56.807011+0000","last_peered":"2024-09-10T08:46:56.807011+0000","last_clean":"2024-09-10T08:46:56.807011+0000","last_became_active":"2024-09-10T08:46:51.786911+0000","last_became_peered":"2024-09-10T08:46:51.786911+0000","last_unstale":"2024-09-10T08:46:56.807011+0000","last_undegraded":"2024-09-10T08:46:56.807011+0000","last_fullsized":"2024-09-10T08:46:56.807011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:17:48.493127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.084355+0000","last_change":"2024-09-10T08:46:51.779942+0000","last_active":"2024-09-10T08:46:58.084355+0000","last_peered":"2024-09-10T08:46:58.084355+0000","last_clean":"2024-09-10T08:46:58.084355+0000","last_became_active":"2024-09-10T08:46:51.779570+0000","last_became_peered":"2024-09-10T08:46:51.779570+0000","last_unstale":"2024-09-10T08:46:58.084355+0000","last_undegraded":"2024-09-10T08:46:58.084355+0000","last_fullsized":"2024-09-10T08:46:58.084355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:24.598016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082596+0000","last_change":"2024-09-10T08:46:51.786869+0000","last_active":"2024-09-10T08:46:58.082596+0000","last_peered":"2024-09-10T08:46:58.082596+0000","last_clean":"2024-09-10T08:46:58.082596+0000","last_became_active":"2024-09-10T08:46:51.786574+0000","last_became_peered":"2024-09-10T08:46:51.786574+0000","last_unstale":"2024-09-10T08:46:58.082596+0000","last_undegraded":"2024-09-10T08:46:58.082596+0000","last_fullsized":"2024-09-10T08:46:58.082596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:12:29.713395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082590+0000","last_change":"2024-09-10T08:46:51.779669+0000","last_active":"2024-09-10T08:46:58.082590+0000","last_peered":"2024-09-10T08:46:58.082590+0000","last_clean":"2024-09-10T08:46:58.082590+0000","last_became_active":"2024-09-10T08:46:51.779155+0000","last_became_peered":"2024-09-10T08:46:51.779155+0000","last_unstale":"2024-09-10T08:46:58.082590+0000","last_undegraded":"2024-09-10T08:46:58.082590+0000","last_fullsized":"2024-09-10T08:46:58.082590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:43:11.183186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082731+0000","last_change":"2024-09-10T08:46:51.784754+0000","last_active":"2024-09-10T08:46:58.082731+0000","last_peered":"2024-09-10T08:46:58.082731+0000","last_clean":"2024-09-10T08:46:58.082731+0000","last_became_active":"2024-09-10T08:46:51.784415+0000","last_became_peered":"2024-09-10T08:46:51.784415+0000","last_unstale":"2024-09-10T08:46:58.082731+0000","last_undegraded":"2024-09-10T08:46:58.082731+0000","last_fullsized":"2024-09-10T08:46:58.082731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:24.242861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.569395+0000","last_change":"2024-09-10T08:46:51.788577+0000","last_active":"2024-09-10T08:46:57.569395+0000","last_peered":"2024-09-10T08:46:57.569395+0000","last_clean":"2024-09-10T08:46:57.569395+0000","last_became_active":"2024-09-10T08:46:51.787904+0000","last_became_peered":"2024-09-10T08:46:51.787904+0000","last_unstale":"2024-09-10T08:46:57.569395+0000","last_undegraded":"2024-09-10T08:46:57.569395+0000","last_fullsized":"2024-09-10T08:46:57.569395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:28:57.453229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.806471+0000","last_change":"2024-09-10T08:46:51.776337+0000","last_active":"2024-09-10T08:46:56.806471+0000","last_peered":"2024-09-10T08:46:56.806471+0000","last_clean":"2024-09-10T08:46:56.806471+0000","last_became_active":"2024-09-10T08:46:51.776001+0000","last_became_peered":"2024-09-10T08:46:51.776001+0000","last_unstale":"2024-09-10T08:46:56.806471+0000","last_undegraded":"2024-09-10T08:46:56.806471+0000","last_fullsized":"2024-09-10T08:46:56.806471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:32:41.996036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.962516+0000","last_change":"2024-09-10T08:46:51.782912+0000","last_active":"2024-09-10T08:46:57.962516+0000","last_peered":"2024-09-10T08:46:57.962516+0000","last_clean":"2024-09-10T08:46:57.962516+0000","last_became_active":"2024-09-10T08:46:51.782378+0000","last_became_peered":"2024-09-10T08:46:51.782378+0000","last_unstale":"2024-09-10T08:46:57.962516+0000","last_undegraded":"2024-09-10T08:46:57.962516+0000","last_fullsized":"2024-09-10T08:46:57.962516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:57:26.714437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.804805+0000","last_change":"2024-09-10T08:46:51.773571+0000","last_active":"2024-09-10T08:46:56.804805+0000","last_peered":"2024-09-10T08:46:56.804805+0000","last_clean":"2024-09-10T08:46:56.804805+0000","last_became_active":"2024-09-10T08:46:51.773315+0000","last_became_peered":"2024-09-10T08:46:51.773315+0000","last_unstale":"2024-09-10T08:46:56.804805+0000","last_undegraded":"2024-09-10T08:46:56.804805+0000","last_fullsized":"2024-09-10T08:46:56.804805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:20:24.144389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083297+0000","last_change":"2024-09-10T08:46:51.785342+0000","last_active":"2024-09-10T08:46:58.083297+0000","last_peered":"2024-09-10T08:46:58.083297+0000","last_clean":"2024-09-10T08:46:58.083297+0000","last_became_active":"2024-09-10T08:46:51.785045+0000","last_became_peered":"2024-09-10T08:46:51.785045+0000","last_unstale":"2024-09-10T08:46:58.083297+0000","last_undegraded":"2024-09-10T08:46:58.083297+0000","last_fullsized":"2024-09-10T08:46:58.083297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:38:23.420671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082446+0000","last_change":"2024-09-10T08:46:51.779497+0000","last_active":"2024-09-10T08:46:58.082446+0000","last_peered":"2024-09-10T08:46:58.082446+0000","last_clean":"2024-09-10T08:46:58.082446+0000","last_became_active":"2024-09-10T08:46:51.778862+0000","last_became_peered":"2024-09-10T08:46:51.778862+0000","last_unstale":"2024-09-10T08:46:58.082446+0000","last_undegraded":"2024-09-10T08:46:58.082446+0000","last_fullsized":"2024-09-10T08:46:58.082446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:17:48.493127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082856+0000","last_change":"2024-09-10T08:46:51.777738+0000","last_active":"2024-09-10T08:46:58.082856+0000","last_peered":"2024-09-10T08:46:58.082856+0000","last_clean":"2024-09-10T08:46:58.082856+0000","last_became_active":"2024-09-10T08:46:51.777432+0000","last_became_peered":"2024-09-10T08:46:51.777432+0000","last_unstale":"2024-09-10T08:46:58.082856+0000","last_undegraded":"2024-09-10T08:46:58.082856+0000","last_fullsized":"2024-09-10T08:46:58.082856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:40:55.949890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.569117+0000","last_change":"2024-09-10T08:46:51.770094+0000","last_active":"2024-09-10T08:46:57.569117+0000","last_peered":"2024-09-10T08:46:57.569117+0000","last_clean":"2024-09-10T08:46:57.569117+0000","last_became_active":"2024-09-10T08:46:51.769753+0000","last_became_peered":"2024-09-10T08:46:51.769753+0000","last_unstale":"2024-09-10T08:46:57.569117+0000","last_undegraded":"2024-09-10T08:46:57.569117+0000","last_fullsized":"2024-09-10T08:46:57.569117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:24:41.697382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082447+0000","last_change":"2024-09-10T08:46:51.774060+0000","last_active":"2024-09-10T08:46:58.082447+0000","last_peered":"2024-09-10T08:46:58.082447+0000","last_clean":"2024-09-10T08:46:58.082447+0000","last_became_active":"2024-09-10T08:46:51.773763+0000","last_became_peered":"2024-09-10T08:46:51.773763+0000","last_unstale":"2024-09-10T08:46:58.082447+0000","last_undegraded":"2024-09-10T08:46:58.082447+0000","last_fullsized":"2024-09-10T08:46:58.082447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:40:55.949890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.805537+0000","last_change":"2024-09-10T08:46:51.772499+0000","last_active":"2024-09-10T08:46:56.805537+0000","last_peered":"2024-09-10T08:46:56.805537+0000","last_clean":"2024-09-10T08:46:56.805537+0000","last_became_active":"2024-09-10T08:46:51.772212+0000","last_became_peered":"2024-09-10T08:46:51.772212+0000","last_unstale":"2024-09-10T08:46:56.805537+0000","last_undegraded":"2024-09-10T08:46:56.805537+0000","last_fullsized":"2024-09-10T08:46:56.805537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:37:56.313573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.806478+0000","last_change":"2024-09-10T08:46:51.782216+0000","last_active":"2024-09-10T08:46:56.806478+0000","last_peered":"2024-09-10T08:46:56.806478+0000","last_clean":"2024-09-10T08:46:56.806478+0000","last_became_active":"2024-09-10T08:46:51.781363+0000","last_became_peered":"2024-09-10T08:46:51.781363+0000","last_unstale":"2024-09-10T08:46:56.806478+0000","last_undegraded":"2024-09-10T08:46:56.806478+0000","last_fullsized":"2024-09-10T08:46:56.806478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:55:01.331346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:56.806885+0000","last_change":"2024-09-10T08:46:51.796242+0000","last_active":"2024-09-10T08:46:56.806885+0000","last_peered":"2024-09-10T08:46:56.806885+0000","last_clean":"2024-09-10T08:46:56.806885+0000","last_became_active":"2024-09-10T08:46:51.795803+0000","last_became_peered":"2024-09-10T08:46:51.795803+0000","last_unstale":"2024-09-10T08:46:56.806885+0000","last_undegraded":"2024-09-10T08:46:56.806885+0000","last_fullsized":"2024-09-10T08:46:56.806885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:56:12.749632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.962635+0000","last_change":"2024-09-10T08:46:51.792984+0000","last_active":"2024-09-10T08:46:57.962635+0000","last_peered":"2024-09-10T08:46:57.962635+0000","last_clean":"2024-09-10T08:46:57.962635+0000","last_became_active":"2024-09-10T08:46:51.792602+0000","last_became_peered":"2024-09-10T08:46:51.792602+0000","last_unstale":"2024-09-10T08:46:57.962635+0000","last_undegraded":"2024-09-10T08:46:57.962635+0000","last_fullsized":"2024-09-10T08:46:57.962635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T08:53:54.788208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082095+0000","last_change":"2024-09-10T08:46:51.781436+0000","last_active":"2024-09-10T08:46:58.082095+0000","last_peered":"2024-09-10T08:46:58.082095+0000","last_clean":"2024-09-10T08:46:58.082095+0000","last_became_active":"2024-09-10T08:46:51.781123+0000","last_became_peered":"2024-09-10T08:46:51.781123+0000","last_unstale":"2024-09-10T08:46:58.082095+0000","last_undegraded":"2024-09-10T08:46:58.082095+0000","last_fullsized":"2024-09-10T08:46:58.082095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:56:12.749632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.962036+0000","last_change":"2024-09-10T08:46:51.779525+0000","last_active":"2024-09-10T08:46:57.962036+0000","last_peered":"2024-09-10T08:46:57.962036+0000","last_clean":"2024-09-10T08:46:57.962036+0000","last_became_active":"2024-09-10T08:46:51.779188+0000","last_became_peered":"2024-09-10T08:46:51.779188+0000","last_unstale":"2024-09-10T08:46:57.962036+0000","last_undegraded":"2024-09-10T08:46:57.962036+0000","last_fullsized":"2024-09-10T08:46:57.962036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:12:24.242861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082677+0000","last_change":"2024-09-10T08:46:51.788567+0000","last_active":"2024-09-10T08:46:58.082677+0000","last_peered":"2024-09-10T08:46:58.082677+0000","last_clean":"2024-09-10T08:46:58.082677+0000","last_became_active":"2024-09-10T08:46:51.787403+0000","last_became_peered":"2024-09-10T08:46:51.787403+0000","last_unstale":"2024-09-10T08:46:58.082677+0000","last_undegraded":"2024-09-10T08:46:58.082677+0000","last_fullsized":"2024-09-10T08:46:58.082677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:41:08.261156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.962152+0000","last_change":"2024-09-10T08:46:51.779364+0000","last_active":"2024-09-10T08:46:57.962152+0000","last_peered":"2024-09-10T08:46:57.962152+0000","last_clean":"2024-09-10T08:46:57.962152+0000","last_became_active":"2024-09-10T08:46:51.778893+0000","last_became_peered":"2024-09-10T08:46:51.778893+0000","last_unstale":"2024-09-10T08:46:57.962152+0000","last_undegraded":"2024-09-10T08:46:57.962152+0000","last_fullsized":"2024-09-10T08:46:57.962152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:24.598016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.082934+0000","last_change":"2024-09-10T08:46:51.784880+0000","last_active":"2024-09-10T08:46:58.082934+0000","last_peered":"2024-09-10T08:46:58.082934+0000","last_clean":"2024-09-10T08:46:58.082934+0000","last_became_active":"2024-09-10T08:46:51.784571+0000","last_became_peered":"2024-09-10T08:46:51.784571+0000","last_unstale":"2024-09-10T08:46:58.082934+0000","last_undegraded":"2024-09-10T08:46:58.082934+0000","last_fullsized":"2024-09-10T08:46:58.082934+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:24.598016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.569257+0000","last_change":"2024-09-10T08:46:51.778810+0000","last_active":"2024-09-10T08:46:57.569257+0000","last_peered":"2024-09-10T08:46:57.569257+0000","last_clean":"2024-09-10T08:46:57.569257+0000","last_became_active":"2024-09-10T08:46:51.777129+0000","last_became_peered":"2024-09-10T08:46:51.777129+0000","last_unstale":"2024-09-10T08:46:57.569257+0000","last_undegraded":"2024-09-10T08:46:57.569257+0000","last_fullsized":"2024-09-10T08:46:57.569257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:55:01.331346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:58.083661+0000","last_change":"2024-09-10T08:46:51.777958+0000","last_active":"2024-09-10T08:46:58.083661+0000","last_peered":"2024-09-10T08:46:58.083661+0000","last_clean":"2024-09-10T08:46:58.083661+0000","last_became_active":"2024-09-10T08:46:51.777701+0000","last_became_peered":"2024-09-10T08:46:51.777701+0000","last_unstale":"2024-09-10T08:46:58.083661+0000","last_undegraded":"2024-09-10T08:46:58.083661+0000","last_fullsized":"2024-09-10T08:46:58.083661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:17:48.493127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-09-10T08:46:57.962500+0000","last_change":"2024-09-10T08:46:51.794577+0000","last_active":"2024-09-10T08:46:57.962500+0000","last_peered":"2024-09-10T08:46:57.962500+0000","last_clean":"2024-09-10T08:46:57.962500+0000","last_became_active":"2024-09-10T08:46:51.794266+0000","last_became_peered":"2024-09-10T08:46:51.794266+0000","last_unstale":"2024-09-10T08:46:57.962500+0000","last_undegraded":"2024-09-10T08:46:57.962500+0000","last_fullsized":"2024-09-10T08:46:57.962500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:50.735348+0000","last_clean_scrub_stamp":"2024-09-10T08:46:50.735348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:48:03.814114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4642,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":104100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":104100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32028,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339812,"statfs":{"total":96636764160,"available":96603967488,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:47:18.404 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T08:47:18.404 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-10T08:47:18.404 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-10T08:47:18.404 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T08:47:18.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.594+0000 7f2ebd800640 1 Processor -- start 2024-09-10T08:47:18.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.594+0000 7f2ebd800640 1 -- start start 2024-09-10T08:47:18.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.595+0000 7f2ebd800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2eb80cebc0 0x7f2eb80b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:18.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.595+0000 7f2ebd800640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2eb80d4180 con 0x7f2eb815e4c0 2024-09-10T08:47:18.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.595+0000 7f2ebd800640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2eb80b6730 con 0x7f2eb80b6320 2024-09-10T08:47:18.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.595+0000 7f2ebd800640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f2eb80d30e0 con 0x7f2eb80cebc0 2024-09-10T08:47:18.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.595+0000 7f2eb7e00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f2eb815e4c0 0x7f2eb80d2890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48458/0 (socket says 172.21.15.2:48458) 2024-09-10T08:47:18.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.595+0000 7f2eafe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2eb80cebc0 0x7f2eb80b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:18.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.595+0000 7f2eb7e00640 1 -- 172.21.15.2:0/3129641291 learned_addr learned my addr 172.21.15.2:0/3129641291 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:47:18.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.596+0000 7f2eb7400640 1 -- 172.21.15.2:0/3129641291 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3577996913 0 0) 0x7f2ea8001110 con 0x7f2eb815e4c0 2024-09-10T08:47:18.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.596+0000 7f2eafe00640 1 -- 172.21.15.2:0/3129641291 >> v1:172.21.15.155:6789/0 conn(0x7f2eb80b6320 legacy=0x7f2eb80b7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:18.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.596+0000 7f2eafe00640 1 -- 172.21.15.2:0/3129641291 >> v1:172.21.15.2:6789/0 conn(0x7f2eb815e4c0 legacy=0x7f2eb80d2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:18.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.596+0000 7f2eafe00640 1 -- 172.21.15.2:0/3129641291 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2eb80d33c0 con 0x7f2eb80cebc0 2024-09-10T08:47:18.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.597+0000 7f2eafe00640 1 --2- 172.21.15.2:0/3129641291 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2eb80cebc0 0x7f2eb80b5de0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2ea00097a0 tx=0x7f2ea002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8f42a46c83a0cf7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:18.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.597+0000 7f2eb7400640 1 -- 172.21.15.2:0/3129641291 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea0037070 con 0x7f2eb80cebc0 2024-09-10T08:47:18.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.597+0000 7f2eb7400640 1 -- 172.21.15.2:0/3129641291 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ea0032440 con 0x7f2eb80cebc0 2024-09-10T08:47:18.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.597+0000 7f2eb7400640 1 -- 172.21.15.2:0/3129641291 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea0032810 con 0x7f2eb80cebc0 2024-09-10T08:47:18.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.597+0000 7f2ebd800640 1 -- 172.21.15.2:0/3129641291 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2eb80cebc0 msgr2=0x7f2eb80b5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:18.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.598+0000 7f2ebd800640 1 --2- 172.21.15.2:0/3129641291 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2eb80cebc0 0x7f2eb80b5de0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2ea00097a0 tx=0x7f2ea002a1a0 comp rx=0 tx=0).stop 2024-09-10T08:47:18.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.598+0000 7f2ebd800640 1 -- 172.21.15.2:0/3129641291 shutdown_connections 2024-09-10T08:47:18.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.598+0000 7f2ebd800640 1 --2- 172.21.15.2:0/3129641291 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2eb80cebc0 0x7f2eb80b5de0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:18.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.598+0000 7f2ebd800640 1 -- 172.21.15.2:0/3129641291 >> 172.21.15.2:0/3129641291 conn(0x7f2eb80d0de0 msgr2=0x7f2eb80d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:18.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.598+0000 7f2ebd800640 1 -- 172.21.15.2:0/3129641291 shutdown_connections 2024-09-10T08:47:18.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.598+0000 7f2ebd800640 1 -- 172.21.15.2:0/3129641291 wait complete. 2024-09-10T08:47:18.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.599+0000 7f2ebd800640 1 Processor -- start 2024-09-10T08:47:18.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.599+0000 7f2ebd800640 1 -- start start 2024-09-10T08:47:18.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.600+0000 7f2ebd800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2eb80b6320 0x7f2eb8153d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:18.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.600+0000 7f2ebd800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2eb80cebc0 0x7f2eb8156000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:18.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.600+0000 7f2ebd800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2eb815e4c0 0x7f2eb8160890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:18.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.600+0000 7f2ebd800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb80d3c60 con 0x7f2eb80cebc0 2024-09-10T08:47:18.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.600+0000 7f2ebd800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb80d3980 con 0x7f2eb815e4c0 2024-09-10T08:47:18.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.600+0000 7f2ebd800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2eb815e8a0 con 0x7f2eb80b6320 2024-09-10T08:47:18.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.600+0000 7f2eafe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2eb80cebc0 0x7f2eb8156000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:18.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.601+0000 7f2eafe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2eb80cebc0 0x7f2eb8156000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51192/0 (socket says 172.21.15.2:51192) 2024-09-10T08:47:18.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.601+0000 7f2eafe00640 1 -- 172.21.15.2:0/2139091647 learned_addr learned my addr 172.21.15.2:0/2139091647 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:18.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.601+0000 7f2ebce00640 1 --2- 172.21.15.2:0/2139091647 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2eb815e4c0 0x7f2eb8160890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:18.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.601+0000 7f2eb7e00640 1 --2- 172.21.15.2:0/2139091647 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2eb80b6320 0x7f2eb8153d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:18.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.601+0000 7f2eafe00640 1 -- 172.21.15.2:0/2139091647 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2eb80b6320 msgr2=0x7f2eb8153d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:18.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.601+0000 7f2eafe00640 1 --2- 172.21.15.2:0/2139091647 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2eb80b6320 0x7f2eb8153d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:18.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.601+0000 7f2eafe00640 1 -- 172.21.15.2:0/2139091647 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2eb815e4c0 msgr2=0x7f2eb8160890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:18.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.601+0000 7f2eafe00640 1 --2- 172.21.15.2:0/2139091647 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2eb815e4c0 0x7f2eb8160890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:18.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.601+0000 7f2eafe00640 1 -- 172.21.15.2:0/2139091647 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2eb8155260 con 0x7f2eb80cebc0 2024-09-10T08:47:18.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.601+0000 7f2eb7e00640 1 --2- 172.21.15.2:0/2139091647 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2eb80b6320 0x7f2eb8153d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:47:18.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.601+0000 7f2eafe00640 1 --2- 172.21.15.2:0/2139091647 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2eb80cebc0 0x7f2eb8156000 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2ea0000c00 tx=0x7f2ea00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:18.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.601+0000 7f2eb4c00640 1 -- 172.21.15.2:0/2139091647 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea0037040 con 0x7f2eb80cebc0 2024-09-10T08:47:18.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.601+0000 7f2eb4c00640 1 -- 172.21.15.2:0/2139091647 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ea0042070 con 0x7f2eb80cebc0 2024-09-10T08:47:18.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.602+0000 7f2eb4c00640 1 -- 172.21.15.2:0/2139091647 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea0030a70 con 0x7f2eb80cebc0 2024-09-10T08:47:18.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.602+0000 7f2ebd800640 1 -- 172.21.15.2:0/2139091647 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2eb8155520 con 0x7f2eb80cebc0 2024-09-10T08:47:18.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.602+0000 7f2ebd800640 1 -- 172.21.15.2:0/2139091647 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2eb8155ae0 con 0x7f2eb80cebc0 2024-09-10T08:47:18.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.603+0000 7f2ebd800640 1 -- 172.21.15.2:0/2139091647 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2eb80b5de0 con 0x7f2eb80cebc0 2024-09-10T08:47:18.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.604+0000 7f2eb4c00640 1 -- 172.21.15.2:0/2139091647 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2ea0030c10 con 0x7f2eb80cebc0 2024-09-10T08:47:18.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.604+0000 7f2eb4c00640 1 --2- 172.21.15.2:0/2139091647 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f2e9406be30 0x7f2e9406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:18.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.604+0000 7f2eb4c00640 1 -- 172.21.15.2:0/2139091647 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f2ea00abda0 con 0x7f2eb80cebc0 2024-09-10T08:47:18.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.605+0000 7f2eb7e00640 1 --2- 172.21.15.2:0/2139091647 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f2e9406be30 0x7f2e9406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:18.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.605+0000 7f2eb7e00640 1 --2- 172.21.15.2:0/2139091647 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f2e9406be30 0x7f2e9406e2f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8000f60 tx=0x7f2ea8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:18.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.609+0000 7f2eb4c00640 1 -- 172.21.15.2:0/2139091647 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2ea0045360 con 0x7f2eb80cebc0 2024-09-10T08:47:18.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.829+0000 7f2ebd800640 1 -- 172.21.15.2:0/2139091647 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f2eb80b7240 con 0x7f2eb80cebc0 2024-09-10T08:47:18.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.829+0000 7f2eb4c00640 1 -- 172.21.15.2:0/2139091647 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f2ea007a2e0 con 0x7f2eb80cebc0 2024-09-10T08:47:18.831 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:47:18.831 INFO:teuthology.orchestra.run.smithi002.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-10T08:47:18.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.831+0000 7f2ebd800640 1 -- 172.21.15.2:0/2139091647 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f2e9406be30 msgr2=0x7f2e9406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:18.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.831+0000 7f2ebd800640 1 --2- 172.21.15.2:0/2139091647 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f2e9406be30 0x7f2e9406e2f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8000f60 tx=0x7f2ea8009040 comp rx=0 tx=0).stop 2024-09-10T08:47:18.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.831+0000 7f2ebd800640 1 -- 172.21.15.2:0/2139091647 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2eb80cebc0 msgr2=0x7f2eb8156000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:18.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.831+0000 7f2ebd800640 1 --2- 172.21.15.2:0/2139091647 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2eb80cebc0 0x7f2eb8156000 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2ea0000c00 tx=0x7f2ea00046c0 comp rx=0 tx=0).stop 2024-09-10T08:47:18.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.831+0000 7f2ebd800640 1 -- 172.21.15.2:0/2139091647 shutdown_connections 2024-09-10T08:47:18.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.831+0000 7f2ebd800640 1 --2- 172.21.15.2:0/2139091647 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2eb815e4c0 0x7f2eb8160890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:18.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.831+0000 7f2ebd800640 1 --2- 172.21.15.2:0/2139091647 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2eb80cebc0 0x7f2eb8156000 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:18.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.831+0000 7f2ebd800640 1 --2- 172.21.15.2:0/2139091647 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f2e9406be30 0x7f2e9406e2f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:18.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.831+0000 7f2ebd800640 1 --2- 172.21.15.2:0/2139091647 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2eb80b6320 0x7f2eb8153d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:18.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.831+0000 7f2ebd800640 1 -- 172.21.15.2:0/2139091647 >> 172.21.15.2:0/2139091647 conn(0x7f2eb80d0de0 msgr2=0x7f2eb80d2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:18.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.832+0000 7f2ebd800640 1 -- 172.21.15.2:0/2139091647 shutdown_connections 2024-09-10T08:47:18.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:18.832+0000 7f2ebd800640 1 -- 172.21.15.2:0/2139091647 wait complete. 2024-09-10T08:47:18.849 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-10T08:47:18.849 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:47:19.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.003+0000 7f2520e00640 1 Processor -- start 2024-09-10T08:47:19.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.003+0000 7f2520e00640 1 -- start start 2024-09-10T08:47:19.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.004+0000 7f2520e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f251c15e6b0 0x7f251c0d4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:19.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.004+0000 7f2520e00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f251c0d32b0 0x7f251c0cf7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:19.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.004+0000 7f2520e00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f251c0d1120 con 0x7f251c0d5210 2024-09-10T08:47:19.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.004+0000 7f2520e00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f251c0d1a50 con 0x7f251c15e6b0 2024-09-10T08:47:19.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.004+0000 7f2520e00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f251c0d1400 con 0x7f251c0d32b0 2024-09-10T08:47:19.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.004+0000 7f2519e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f251c15e6b0 0x7f251c0d4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:19.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.004+0000 7f2519400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f251c0d5210 0x7f251c0d2ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48468/0 (socket says 172.21.15.2:48468) 2024-09-10T08:47:19.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.004+0000 7f2519400640 1 -- 172.21.15.2:0/1372801039 learned_addr learned my addr 172.21.15.2:0/1372801039 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:47:19.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.005+0000 7f251a800640 1 --2- 172.21.15.2:0/1372801039 >> v2:172.21.15.155:3300/0 conn(0x7f251c0d32b0 0x7f251c0cf7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:19.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.005+0000 7f2518a00640 1 -- 172.21.15.2:0/1372801039 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2275772093 0 0) 0x7f251c0d1120 con 0x7f251c0d5210 2024-09-10T08:47:19.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.005+0000 7f2518a00640 1 -- 172.21.15.2:0/1372801039 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2500003520 con 0x7f251c0d5210 2024-09-10T08:47:19.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.005+0000 7f2519e00640 1 -- 172.21.15.2:0/1372801039 >> v2:172.21.15.155:3300/0 conn(0x7f251c0d32b0 msgr2=0x7f251c0cf7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:19.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.005+0000 7f2519e00640 1 --2- 172.21.15.2:0/1372801039 >> v2:172.21.15.155:3300/0 conn(0x7f251c0d32b0 0x7f251c0cf7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:19.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.005+0000 7f2519e00640 1 -- 172.21.15.2:0/1372801039 >> v1:172.21.15.2:6789/0 conn(0x7f251c0d5210 legacy=0x7f251c0d2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:19.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.005+0000 7f2519e00640 1 -- 172.21.15.2:0/1372801039 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f251c0d16e0 con 0x7f251c15e6b0 2024-09-10T08:47:19.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.006+0000 7f2519e00640 1 --2- 172.21.15.2:0/1372801039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f251c15e6b0 0x7f251c0d4cd0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f251c08c8d0 tx=0x7f250c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=680c9d360819c695 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:19.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.006+0000 7f2518a00640 1 -- 172.21.15.2:0/1372801039 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f250c037070 con 0x7f251c15e6b0 2024-09-10T08:47:19.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.006+0000 7f2518a00640 1 -- 172.21.15.2:0/1372801039 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f250c032440 con 0x7f251c15e6b0 2024-09-10T08:47:19.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.006+0000 7f2518a00640 1 -- 172.21.15.2:0/1372801039 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f250c02ae60 con 0x7f251c15e6b0 2024-09-10T08:47:19.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.007+0000 7f2520e00640 1 -- 172.21.15.2:0/1372801039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f251c15e6b0 msgr2=0x7f251c0d4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:19.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.007+0000 7f2520e00640 1 --2- 172.21.15.2:0/1372801039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f251c15e6b0 0x7f251c0d4cd0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f251c08c8d0 tx=0x7f250c02a110 comp rx=0 tx=0).stop 2024-09-10T08:47:19.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.007+0000 7f2520e00640 1 -- 172.21.15.2:0/1372801039 shutdown_connections 2024-09-10T08:47:19.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.007+0000 7f2520e00640 1 --2- 172.21.15.2:0/1372801039 >> v2:172.21.15.155:3300/0 conn(0x7f251c0d32b0 0x7f251c0cf7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:19.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.007+0000 7f2520e00640 1 --2- 172.21.15.2:0/1372801039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f251c15e6b0 0x7f251c0d4cd0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:19.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.007+0000 7f2520e00640 1 -- 172.21.15.2:0/1372801039 >> 172.21.15.2:0/1372801039 conn(0x7f251c08bfd0 msgr2=0x7f251c0d45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:19.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.007+0000 7f2520e00640 1 -- 172.21.15.2:0/1372801039 shutdown_connections 2024-09-10T08:47:19.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.007+0000 7f2520e00640 1 -- 172.21.15.2:0/1372801039 wait complete. 2024-09-10T08:47:19.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.009+0000 7f2520e00640 1 Processor -- start 2024-09-10T08:47:19.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.009+0000 7f2520e00640 1 -- start start 2024-09-10T08:47:19.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.009+0000 7f2520e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f251c0d32b0 0x7f251c0b4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:19.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.009+0000 7f2520e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f251c0d5210 0x7f251c0b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:19.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.010+0000 7f2520e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f251c15e6b0 0x7f251c1543a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:19.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.010+0000 7f2520e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f251c0d0db0 con 0x7f251c0d32b0 2024-09-10T08:47:19.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.010+0000 7f2520e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f251c0cf210 con 0x7f251c0d5210 2024-09-10T08:47:19.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.010+0000 7f2520e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f251c06ce60 con 0x7f251c15e6b0 2024-09-10T08:47:19.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.010+0000 7f2519e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f251c0d32b0 0x7f251c0b4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:19.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.010+0000 7f2519e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f251c0d32b0 0x7f251c0b4b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51216/0 (socket says 172.21.15.2:51216) 2024-09-10T08:47:19.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.010+0000 7f2519e00640 1 -- 172.21.15.2:0/1728288115 learned_addr learned my addr 172.21.15.2:0/1728288115 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:19.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.010+0000 7f2519400640 1 --2- 172.21.15.2:0/1728288115 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f251c0d5210 0x7f251c0b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:19.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.010+0000 7f251a800640 1 --2- 172.21.15.2:0/1728288115 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f251c15e6b0 0x7f251c1543a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:19.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.010+0000 7f2519e00640 1 -- 172.21.15.2:0/1728288115 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f251c15e6b0 msgr2=0x7f251c1543a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:19.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.010+0000 7f2519e00640 1 --2- 172.21.15.2:0/1728288115 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f251c15e6b0 0x7f251c1543a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:19.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.010+0000 7f2519e00640 1 -- 172.21.15.2:0/1728288115 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f251c0d5210 msgr2=0x7f251c0b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:19.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.010+0000 7f2519e00640 1 --2- 172.21.15.2:0/1728288115 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f251c0d5210 0x7f251c0b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:19.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.010+0000 7f2519e00640 1 -- 172.21.15.2:0/1728288115 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f251c0b5ce0 con 0x7f251c0d32b0 2024-09-10T08:47:19.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.010+0000 7f251a800640 1 --2- 172.21.15.2:0/1728288115 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f251c15e6b0 0x7f251c1543a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:47:19.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.010+0000 7f2519400640 1 --2- 172.21.15.2:0/1728288115 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f251c0d5210 0x7f251c0b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:47:19.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.011+0000 7f2519e00640 1 --2- 172.21.15.2:0/1728288115 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f251c0d32b0 0x7f251c0b4b60 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f250c000c00 tx=0x7f250c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:19.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.011+0000 7f2512000640 1 -- 172.21.15.2:0/1728288115 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f250c041020 con 0x7f251c0d32b0 2024-09-10T08:47:19.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.011+0000 7f2512000640 1 -- 172.21.15.2:0/1728288115 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f250c03d700 con 0x7f251c0d32b0 2024-09-10T08:47:19.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.011+0000 7f2512000640 1 -- 172.21.15.2:0/1728288115 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f250c037040 con 0x7f251c0d32b0 2024-09-10T08:47:19.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.011+0000 7f2520e00640 1 -- 172.21.15.2:0/1728288115 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f251c0b5440 con 0x7f251c0d32b0 2024-09-10T08:47:19.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.011+0000 7f2520e00640 1 -- 172.21.15.2:0/1728288115 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f251c0b5a00 con 0x7f251c0d32b0 2024-09-10T08:47:19.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.012+0000 7f2520e00640 1 -- 172.21.15.2:0/1728288115 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f251c160ab0 con 0x7f251c0d32b0 2024-09-10T08:47:19.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.013+0000 7f2512000640 1 -- 172.21.15.2:0/1728288115 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f250c044020 con 0x7f251c0d32b0 2024-09-10T08:47:19.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.014+0000 7f2512000640 1 --2- 172.21.15.2:0/1728288115 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f24fc06be30 0x7f24fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:19.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.014+0000 7f2512000640 1 -- 172.21.15.2:0/1728288115 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f250c0ab9a0 con 0x7f251c0d32b0 2024-09-10T08:47:19.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.014+0000 7f2519400640 1 --2- 172.21.15.2:0/1728288115 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f24fc06be30 0x7f24fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:19.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.015+0000 7f2519400640 1 --2- 172.21.15.2:0/1728288115 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f24fc06be30 0x7f24fc06e2f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2508007fd0 tx=0x7f2508009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:19.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.018+0000 7f2512000640 1 -- 172.21.15.2:0/1728288115 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f250c04b030 con 0x7f251c0d32b0 2024-09-10T08:47:19.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.237+0000 7f2520e00640 1 -- 172.21.15.2:0/1728288115 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f251c0d1d20 con 0x7f251c0d32b0 2024-09-10T08:47:19.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.238+0000 7f2512000640 1 -- 172.21.15.2:0/1728288115 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5216 (secure 0 0 0) 0x7f250c079f80 con 0x7f251c0d32b0 2024-09-10T08:47:19.240 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:47:19.240 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":9,"btime":"2024-09-10T08:47:13:450812+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/4081738683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":4081738683},{"type":"v1","addr":"172.21.15.2:6835","nonce":4081738683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1478106484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":1478106484},{"type":"v1","addr":"172.21.15.155:6837","nonce":1478106484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/800933941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":800933941},{"type":"v1","addr":"172.21.15.2:6834","nonce":800933941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:46:51.181258+0000","modified":"2024-09-10T08:47:12.877562+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6836/2996773231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2996773231},{"type":"v1","addr":"172.21.15.155:6836","nonce":2996773231}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":1}]} 2024-09-10T08:47:19.240 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 9 2024-09-10T08:47:19.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.241+0000 7f2520e00640 1 -- 172.21.15.2:0/1728288115 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f24fc06be30 msgr2=0x7f24fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:19.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.241+0000 7f2520e00640 1 --2- 172.21.15.2:0/1728288115 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f24fc06be30 0x7f24fc06e2f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2508007fd0 tx=0x7f2508009040 comp rx=0 tx=0).stop 2024-09-10T08:47:19.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.241+0000 7f2520e00640 1 -- 172.21.15.2:0/1728288115 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f251c0d32b0 msgr2=0x7f251c0b4b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:19.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.241+0000 7f2520e00640 1 --2- 172.21.15.2:0/1728288115 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f251c0d32b0 0x7f251c0b4b60 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f250c000c00 tx=0x7f250c0046c0 comp rx=0 tx=0).stop 2024-09-10T08:47:19.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.241+0000 7f2520e00640 1 -- 172.21.15.2:0/1728288115 shutdown_connections 2024-09-10T08:47:19.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.241+0000 7f2520e00640 1 --2- 172.21.15.2:0/1728288115 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f24fc06be30 0x7f24fc06e2f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:19.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.241+0000 7f2520e00640 1 --2- 172.21.15.2:0/1728288115 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f251c15e6b0 0x7f251c1543a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:19.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.241+0000 7f2520e00640 1 --2- 172.21.15.2:0/1728288115 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f251c0d5210 0x7f251c0b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:19.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.241+0000 7f2520e00640 1 --2- 172.21.15.2:0/1728288115 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f251c0d32b0 0x7f251c0b4b60 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:19.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.241+0000 7f2520e00640 1 -- 172.21.15.2:0/1728288115 >> 172.21.15.2:0/1728288115 conn(0x7f251c08bfd0 msgr2=0x7f251c0b9d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:19.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.241+0000 7f2520e00640 1 -- 172.21.15.2:0/1728288115 shutdown_connections 2024-09-10T08:47:19.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.241+0000 7f2520e00640 1 -- 172.21.15.2:0/1728288115 wait complete. 2024-09-10T08:47:19.258 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:47:19.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.415+0000 7f8e0b800640 1 Processor -- start 2024-09-10T08:47:19.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.415+0000 7f8e0b800640 1 -- start start 2024-09-10T08:47:19.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.416+0000 7f8e0b800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8e04144c90 0x7f8e040ccd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:19.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.416+0000 7f8e0b800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8e040cd2b0 0x7f8e040ce420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:19.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.416+0000 7f8e0b800640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e0406f540 con 0x7f8e04144250 2024-09-10T08:47:19.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.416+0000 7f8e0b800640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f8e0406f820 con 0x7f8e04144c90 2024-09-10T08:47:19.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.416+0000 7f8e0b800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8e0406fb00 con 0x7f8e040cd2b0 2024-09-10T08:47:19.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.417+0000 7f8e03e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8e04144c90 0x7f8e040ccd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:19.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.417+0000 7f8e03e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8e04144c90 0x7f8e040ccd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51220/0 (socket says 172.21.15.2:51220) 2024-09-10T08:47:19.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.417+0000 7f8e03e00640 1 -- 172.21.15.2:0/826538265 learned_addr learned my addr 172.21.15.2:0/826538265 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:19.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.417+0000 7f8e09800640 1 --2- 172.21.15.2:0/826538265 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8e040cd2b0 0x7f8e040ce420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:19.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.417+0000 7f8e03e00640 1 -- 172.21.15.2:0/826538265 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8e040cd2b0 msgr2=0x7f8e040ce420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:19.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.417+0000 7f8e03e00640 1 --2- 172.21.15.2:0/826538265 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8e040cd2b0 0x7f8e040ce420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:19.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.417+0000 7f8e03e00640 1 -- 172.21.15.2:0/826538265 >> v1:172.21.15.155:6789/0 conn(0x7f8e04144250 legacy=0x7f8e040cf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:19.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.417+0000 7f8e03e00640 1 -- 172.21.15.2:0/826538265 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e0406fde0 con 0x7f8e04144c90 2024-09-10T08:47:19.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.417+0000 7f8e09800640 1 --2- 172.21.15.2:0/826538265 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8e040cd2b0 0x7f8e040ce420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:47:19.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.418+0000 7f8e03e00640 1 --2- 172.21.15.2:0/826538265 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e04144c90 0x7f8e040ccd70 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8df0009870 tx=0x7f8df002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9421de0a26a3562 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:19.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.418+0000 7f8e03400640 1 -- 172.21.15.2:0/826538265 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df0037070 con 0x7f8e04144c90 2024-09-10T08:47:19.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.418+0000 7f8e03400640 1 -- 172.21.15.2:0/826538265 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8df0032440 con 0x7f8e04144c90 2024-09-10T08:47:19.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.418+0000 7f8e03400640 1 -- 172.21.15.2:0/826538265 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df0032810 con 0x7f8e04144c90 2024-09-10T08:47:19.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.419+0000 7f8e0b800640 1 -- 172.21.15.2:0/826538265 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e04144c90 msgr2=0x7f8e040ccd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:19.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.419+0000 7f8e0b800640 1 --2- 172.21.15.2:0/826538265 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e04144c90 0x7f8e040ccd70 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8df0009870 tx=0x7f8df002a270 comp rx=0 tx=0).stop 2024-09-10T08:47:19.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.419+0000 7f8e0b800640 1 -- 172.21.15.2:0/826538265 shutdown_connections 2024-09-10T08:47:19.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.419+0000 7f8e0b800640 1 --2- 172.21.15.2:0/826538265 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8e040cd2b0 0x7f8e040ce420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:19.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.419+0000 7f8e0b800640 1 --2- 172.21.15.2:0/826538265 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e04144c90 0x7f8e040ccd70 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:19.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.419+0000 7f8e0b800640 1 -- 172.21.15.2:0/826538265 >> 172.21.15.2:0/826538265 conn(0x7f8e0406bc10 msgr2=0x7f8e0406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:19.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.419+0000 7f8e0b800640 1 -- 172.21.15.2:0/826538265 shutdown_connections 2024-09-10T08:47:19.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.419+0000 7f8e0b800640 1 -- 172.21.15.2:0/826538265 wait complete. 2024-09-10T08:47:19.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.421+0000 7f8e0b800640 1 Processor -- start 2024-09-10T08:47:19.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.421+0000 7f8e0b800640 1 -- start start 2024-09-10T08:47:19.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.421+0000 7f8e0b800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e040cd2b0 0x7f8e0413c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:19.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.422+0000 7f8e0b800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8e04144250 0x7f8e04155540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:19.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.422+0000 7f8e0b800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e04144c90 0x7f8e0415dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:19.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.422+0000 7f8e0b800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f8e040ce960 con 0x7f8e04144c90 2024-09-10T08:47:19.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.422+0000 7f8e0b800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8e040b3390 con 0x7f8e040cd2b0 2024-09-10T08:47:19.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.422+0000 7f8e0b800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8e040ceae0 con 0x7f8e04144250 2024-09-10T08:47:19.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.422+0000 7f8e09800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e04144c90 0x7f8e0415dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:19.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.422+0000 7f8e09800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e04144c90 0x7f8e0415dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51228/0 (socket says 172.21.15.2:51228) 2024-09-10T08:47:19.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.422+0000 7f8e09800640 1 -- 172.21.15.2:0/3645931000 learned_addr learned my addr 172.21.15.2:0/3645931000 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:19.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.422+0000 7f8e03e00640 1 --2- 172.21.15.2:0/3645931000 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8e04144250 0x7f8e04155540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:19.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.422+0000 7f8e08e00640 1 --2- 172.21.15.2:0/3645931000 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e040cd2b0 0x7f8e0413c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:19.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.422+0000 7f8e09800640 1 -- 172.21.15.2:0/3645931000 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8e04144250 msgr2=0x7f8e04155540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:19.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.422+0000 7f8e09800640 1 --2- 172.21.15.2:0/3645931000 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8e04144250 0x7f8e04155540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:19.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.422+0000 7f8e09800640 1 -- 172.21.15.2:0/3645931000 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e040cd2b0 msgr2=0x7f8e0413c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:19.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.422+0000 7f8e09800640 1 --2- 172.21.15.2:0/3645931000 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e040cd2b0 0x7f8e0413c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:19.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.422+0000 7f8e09800640 1 -- 172.21.15.2:0/3645931000 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e041563c0 con 0x7f8e04144c90 2024-09-10T08:47:19.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.422+0000 7f8e08e00640 1 --2- 172.21.15.2:0/3645931000 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e040cd2b0 0x7f8e0413c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:47:19.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.423+0000 7f8e09800640 1 --2- 172.21.15.2:0/3645931000 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e04144c90 0x7f8e0415dcf0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc007f20 tx=0x7f8dfc00d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:19.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.423+0000 7f8e00c00640 1 -- 172.21.15.2:0/3645931000 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc01a070 con 0x7f8e04144c90 2024-09-10T08:47:19.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.423+0000 7f8e00c00640 1 -- 172.21.15.2:0/3645931000 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dfc003b90 con 0x7f8e04144c90 2024-09-10T08:47:19.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.423+0000 7f8e00c00640 1 -- 172.21.15.2:0/3645931000 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc004030 con 0x7f8e04144c90 2024-09-10T08:47:19.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.423+0000 7f8e0b800640 1 -- 172.21.15.2:0/3645931000 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e04154aa0 con 0x7f8e04144c90 2024-09-10T08:47:19.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.423+0000 7f8e0b800640 1 -- 172.21.15.2:0/3645931000 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e04154d40 con 0x7f8e04144c90 2024-09-10T08:47:19.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.424+0000 7f8e0b800640 1 -- 172.21.15.2:0/3645931000 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e040b42a0 con 0x7f8e04144c90 2024-09-10T08:47:19.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.425+0000 7f8e00c00640 1 -- 172.21.15.2:0/3645931000 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8dfc01d070 con 0x7f8e04144c90 2024-09-10T08:47:19.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.426+0000 7f8e00c00640 1 --2- 172.21.15.2:0/3645931000 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f8de406be30 0x7f8de406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:19.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.426+0000 7f8e00c00640 1 -- 172.21.15.2:0/3645931000 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f8dfc08b430 con 0x7f8e04144c90 2024-09-10T08:47:19.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.426+0000 7f8e08e00640 1 --2- 172.21.15.2:0/3645931000 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f8de406be30 0x7f8de406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:19.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.427+0000 7f8e08e00640 1 --2- 172.21.15.2:0/3645931000 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f8de406be30 0x7f8de406e2f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8df4001700 tx=0x7f8df4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:19.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.430+0000 7f8e00c00640 1 -- 172.21.15.2:0/3645931000 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8dfc010070 con 0x7f8e04144c90 2024-09-10T08:47:19.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.653+0000 7f8e0b800640 1 -- 172.21.15.2:0/3645931000 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8e040b3fc0 con 0x7f8e04144c90 2024-09-10T08:47:19.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.654+0000 7f8e00c00640 1 -- 172.21.15.2:0/3645931000 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5216 (secure 0 0 0) 0x7f8dfc059440 con 0x7f8e04144c90 2024-09-10T08:47:19.655 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:47:19.655 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":9,"btime":"2024-09-10T08:47:13:450812+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/4081738683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":4081738683},{"type":"v1","addr":"172.21.15.2:6835","nonce":4081738683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1478106484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":1478106484},{"type":"v1","addr":"172.21.15.155:6837","nonce":1478106484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/800933941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":800933941},{"type":"v1","addr":"172.21.15.2:6834","nonce":800933941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:46:51.181258+0000","modified":"2024-09-10T08:47:12.877562+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6836/2996773231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2996773231},{"type":"v1","addr":"172.21.15.155:6836","nonce":2996773231}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":1}]} 2024-09-10T08:47:19.656 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 9 2024-09-10T08:47:19.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.656+0000 7f8e0b800640 1 -- 172.21.15.2:0/3645931000 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f8de406be30 msgr2=0x7f8de406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:19.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.656+0000 7f8e0b800640 1 --2- 172.21.15.2:0/3645931000 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f8de406be30 0x7f8de406e2f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8df4001700 tx=0x7f8df4009040 comp rx=0 tx=0).stop 2024-09-10T08:47:19.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.656+0000 7f8e0b800640 1 -- 172.21.15.2:0/3645931000 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e04144c90 msgr2=0x7f8e0415dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:19.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.656+0000 7f8e0b800640 1 --2- 172.21.15.2:0/3645931000 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e04144c90 0x7f8e0415dcf0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc007f20 tx=0x7f8dfc00d560 comp rx=0 tx=0).stop 2024-09-10T08:47:19.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.656+0000 7f8e0b800640 1 -- 172.21.15.2:0/3645931000 shutdown_connections 2024-09-10T08:47:19.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.656+0000 7f8e0b800640 1 --2- 172.21.15.2:0/3645931000 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8e04144c90 0x7f8e0415dcf0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:19.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.656+0000 7f8e0b800640 1 --2- 172.21.15.2:0/3645931000 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f8de406be30 0x7f8de406e2f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:19.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.656+0000 7f8e0b800640 1 --2- 172.21.15.2:0/3645931000 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8e04144250 0x7f8e04155540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:19.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.656+0000 7f8e0b800640 1 --2- 172.21.15.2:0/3645931000 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e040cd2b0 0x7f8e0413c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:19.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.656+0000 7f8e0b800640 1 -- 172.21.15.2:0/3645931000 >> 172.21.15.2:0/3645931000 conn(0x7f8e0406bc10 msgr2=0x7f8e04141c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:19.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.656+0000 7f8e0b800640 1 -- 172.21.15.2:0/3645931000 shutdown_connections 2024-09-10T08:47:19.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.656+0000 7f8e0b800640 1 -- 172.21.15.2:0/3645931000 wait complete. 2024-09-10T08:47:19.674 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:47:19.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.829+0000 7f3c8be00640 1 Processor -- start 2024-09-10T08:47:19.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.829+0000 7f3c8be00640 1 -- start start 2024-09-10T08:47:19.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.830+0000 7f3c8be00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3c8415e6b0 0x7f3c840d4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:19.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.830+0000 7f3c8be00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3c840d5210 0x7f3c840d2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:19.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.830+0000 7f3c8be00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3c8406ce60 0x7f3c840d30e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:19.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.830+0000 7f3c8be00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f3c840d1a50 con 0x7f3c8415e6b0 2024-09-10T08:47:19.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.830+0000 7f3c8be00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f3c840d1120 con 0x7f3c8406ce60 2024-09-10T08:47:19.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.830+0000 7f3c8be00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3c840d1400 con 0x7f3c840d5210 2024-09-10T08:47:19.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.830+0000 7f3c89400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3c8415e6b0 0x7f3c840d4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:19.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.830+0000 7f3c88a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3c840d5210 0x7f3c840d2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:19.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.830+0000 7f3c89400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3c8415e6b0 0x7f3c840d4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51232/0 (socket says 172.21.15.2:51232) 2024-09-10T08:47:19.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.830+0000 7f3c89400640 1 -- 172.21.15.2:0/1366869331 learned_addr learned my addr 172.21.15.2:0/1366869331 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:19.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.830+0000 7f3c89e00640 1 --2- 172.21.15.2:0/1366869331 >> v2:172.21.15.155:3300/0 conn(0x7f3c8406ce60 0x7f3c840d30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:19.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.831+0000 7f3c89400640 1 -- 172.21.15.2:0/1366869331 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3c840d5210 msgr2=0x7f3c840d2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:19.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.831+0000 7f3c89400640 1 --2- 172.21.15.2:0/1366869331 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3c840d5210 0x7f3c840d2ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:19.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.831+0000 7f3c89400640 1 -- 172.21.15.2:0/1366869331 >> v2:172.21.15.155:3300/0 conn(0x7f3c8406ce60 msgr2=0x7f3c840d30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:19.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.831+0000 7f3c89400640 1 --2- 172.21.15.2:0/1366869331 >> v2:172.21.15.155:3300/0 conn(0x7f3c8406ce60 0x7f3c840d30e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:19.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.831+0000 7f3c89400640 1 -- 172.21.15.2:0/1366869331 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c840d16e0 con 0x7f3c8415e6b0 2024-09-10T08:47:19.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.832+0000 7f3c89400640 1 --2- 172.21.15.2:0/1366869331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c8415e6b0 0x7f3c840d4cd0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3c840ceca0 tx=0x7f3c7802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aefd03400df3580 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:19.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.833+0000 7f3c83e00640 1 -- 172.21.15.2:0/1366869331 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c78037070 con 0x7f3c8415e6b0 2024-09-10T08:47:19.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.833+0000 7f3c83e00640 1 -- 172.21.15.2:0/1366869331 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c78032440 con 0x7f3c8415e6b0 2024-09-10T08:47:19.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.833+0000 7f3c83e00640 1 -- 172.21.15.2:0/1366869331 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c78032810 con 0x7f3c8415e6b0 2024-09-10T08:47:19.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.833+0000 7f3c8be00640 1 -- 172.21.15.2:0/1366869331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c8415e6b0 msgr2=0x7f3c840d4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:19.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.833+0000 7f3c8be00640 1 --2- 172.21.15.2:0/1366869331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c8415e6b0 0x7f3c840d4cd0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3c840ceca0 tx=0x7f3c7802a140 comp rx=0 tx=0).stop 2024-09-10T08:47:19.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.833+0000 7f3c8be00640 1 -- 172.21.15.2:0/1366869331 shutdown_connections 2024-09-10T08:47:19.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.834+0000 7f3c8be00640 1 --2- 172.21.15.2:0/1366869331 >> v2:172.21.15.155:3300/0 conn(0x7f3c8406ce60 0x7f3c840d30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:19.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.834+0000 7f3c8be00640 1 --2- 172.21.15.2:0/1366869331 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3c840d5210 0x7f3c840d2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:19.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.834+0000 7f3c8be00640 1 --2- 172.21.15.2:0/1366869331 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c8415e6b0 0x7f3c840d4cd0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:19.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.834+0000 7f3c8be00640 1 -- 172.21.15.2:0/1366869331 >> 172.21.15.2:0/1366869331 conn(0x7f3c8408bfd0 msgr2=0x7f3c840d45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:19.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.834+0000 7f3c8be00640 1 -- 172.21.15.2:0/1366869331 shutdown_connections 2024-09-10T08:47:19.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.834+0000 7f3c8be00640 1 -- 172.21.15.2:0/1366869331 wait complete. 2024-09-10T08:47:19.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.835+0000 7f3c8be00640 1 Processor -- start 2024-09-10T08:47:19.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.836+0000 7f3c8be00640 1 -- start start 2024-09-10T08:47:19.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.837+0000 7f3c8be00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3c8406ce60 0x7f3c840b4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:19.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.837+0000 7f3c8be00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3c840d5210 0x7f3c841549b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:19.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.837+0000 7f3c8be00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c8415e6b0 0x7f3c840cb690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:19.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.837+0000 7f3c8be00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3c840d0db0 con 0x7f3c8415e6b0 2024-09-10T08:47:19.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.837+0000 7f3c8be00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3c840cf210 con 0x7f3c8406ce60 2024-09-10T08:47:19.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.837+0000 7f3c8be00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3c840cf7a0 con 0x7f3c840d5210 2024-09-10T08:47:19.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.837+0000 7f3c89e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c8415e6b0 0x7f3c840cb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:19.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.837+0000 7f3c88a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3c840d5210 0x7f3c841549b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:19.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.837+0000 7f3c89e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c8415e6b0 0x7f3c840cb690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51246/0 (socket says 172.21.15.2:51246) 2024-09-10T08:47:19.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.837+0000 7f3c89e00640 1 -- 172.21.15.2:0/1583884894 learned_addr learned my addr 172.21.15.2:0/1583884894 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:19.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.837+0000 7f3c88a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3c840d5210 0x7f3c841549b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.2:40680/0 (socket says 172.21.15.2:40680) 2024-09-10T08:47:19.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.837+0000 7f3c89400640 1 --2- 172.21.15.2:0/1583884894 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3c8406ce60 0x7f3c840b4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:19.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.837+0000 7f3c89e00640 1 -- 172.21.15.2:0/1583884894 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3c840d5210 msgr2=0x7f3c841549b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:19.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.837+0000 7f3c89e00640 1 --2- 172.21.15.2:0/1583884894 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3c840d5210 0x7f3c841549b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:19.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.837+0000 7f3c89e00640 1 -- 172.21.15.2:0/1583884894 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3c8406ce60 msgr2=0x7f3c840b4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:19.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.837+0000 7f3c89e00640 1 --2- 172.21.15.2:0/1583884894 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3c8406ce60 0x7f3c840b4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:19.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.837+0000 7f3c89e00640 1 -- 172.21.15.2:0/1583884894 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c840cc150 con 0x7f3c8415e6b0 2024-09-10T08:47:19.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.838+0000 7f3c89e00640 1 --2- 172.21.15.2:0/1583884894 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c8415e6b0 0x7f3c840cb690 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c00eed0 tx=0x7f3c7c00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:19.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.838+0000 7f3c81600640 1 -- 172.21.15.2:0/1583884894 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c7c018020 con 0x7f3c8415e6b0 2024-09-10T08:47:19.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.838+0000 7f3c81600640 1 -- 172.21.15.2:0/1583884894 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c7c014400 con 0x7f3c8415e6b0 2024-09-10T08:47:19.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.838+0000 7f3c81600640 1 -- 172.21.15.2:0/1583884894 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c7c0147f0 con 0x7f3c8415e6b0 2024-09-10T08:47:19.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.838+0000 7f3c8be00640 1 -- 172.21.15.2:0/1583884894 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c840cc430 con 0x7f3c8415e6b0 2024-09-10T08:47:19.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.838+0000 7f3c8be00640 1 -- 172.21.15.2:0/1583884894 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c840cc9f0 con 0x7f3c8415e6b0 2024-09-10T08:47:19.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.839+0000 7f3c8be00640 1 -- 172.21.15.2:0/1583884894 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c840d4cd0 con 0x7f3c8415e6b0 2024-09-10T08:47:19.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.840+0000 7f3c81600640 1 -- 172.21.15.2:0/1583884894 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3c7c005d10 con 0x7f3c8415e6b0 2024-09-10T08:47:19.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.841+0000 7f3c81600640 1 --2- 172.21.15.2:0/1583884894 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f3c6406be30 0x7f3c6406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:19.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.841+0000 7f3c81600640 1 -- 172.21.15.2:0/1583884894 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f3c7c08bb20 con 0x7f3c8415e6b0 2024-09-10T08:47:19.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.841+0000 7f3c89400640 1 --2- 172.21.15.2:0/1583884894 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f3c6406be30 0x7f3c6406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:19.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.842+0000 7f3c89400640 1 --2- 172.21.15.2:0/1583884894 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f3c6406be30 0x7f3c6406e2f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3c78034000 tx=0x7f3c7802e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:19.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:19.845+0000 7f3c81600640 1 -- 172.21.15.2:0/1583884894 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3c7c022030 con 0x7f3c8415e6b0 2024-09-10T08:47:20.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.038+0000 7f3c8be00640 1 -- 172.21.15.2:0/1583884894 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3c840d1d20 con 0x7f3c8415e6b0 2024-09-10T08:47:20.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.039+0000 7f3c81600640 1 -- 172.21.15.2:0/1583884894 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18538 (secure 0 0 0) 0x7f3c7c059b30 con 0x7f3c8415e6b0 2024-09-10T08:47:20.041 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:47:20.041 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":24,"fsid":"f20a15a7-d363-4d44-98cb-4f4f466b52b8","created":"2024-09-10T08:46:26.481619+0000","modified":"2024-09-10T08:46:56.240092+0000","last_up_change":"2024-09-10T08:46:39.323912+0000","last_in_change":"2024-09-10T08:46:29.499894+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:46:39.426180+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:46:49.214595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T08:46:50.168313+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T08:46:53.833162+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c90be333-506b-46d1-b00a-10d089a84776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6822","nonce":298678486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6823","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6826","nonce":298678486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6831","nonce":298678486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6829","nonce":298678486}]},"public_addr":"172.21.15.2:6822/298678486","cluster_addr":"172.21.15.2:6826/298678486","heartbeat_back_addr":"172.21.15.2:6831/298678486","heartbeat_front_addr":"172.21.15.2:6829/298678486","state":["exists","up"]},{"osd":1,"uuid":"3f8bdde8-6cd3-4112-8939-a876191c7368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6809","nonce":1619566025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6811","nonce":1619566025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6815","nonce":1619566025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6813","nonce":1619566025}]},"public_addr":"172.21.15.2:6809/1619566025","cluster_addr":"172.21.15.2:6811/1619566025","heartbeat_back_addr":"172.21.15.2:6815/1619566025","heartbeat_front_addr":"172.21.15.2:6813/1619566025","state":["exists","up"]},{"osd":2,"uuid":"3835f5ab-ed3a-4f46-ae6c-f0edf21708d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6801","nonce":3992427579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6803","nonce":3992427579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6807","nonce":3992427579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6805","nonce":3992427579}]},"public_addr":"172.21.15.2:6801/3992427579","cluster_addr":"172.21.15.2:6803/3992427579","heartbeat_back_addr":"172.21.15.2:6807/3992427579","heartbeat_front_addr":"172.21.15.2:6805/3992427579","state":["exists","up"]},{"osd":3,"uuid":"add6ad27-b411-4a82-9622-b0c1c1782cf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6817","nonce":1270626884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6819","nonce":1270626884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6827","nonce":1270626884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6824","nonce":1270626884}]},"public_addr":"172.21.15.2:6817/1270626884","cluster_addr":"172.21.15.2:6819/1270626884","heartbeat_back_addr":"172.21.15.2:6827/1270626884","heartbeat_front_addr":"172.21.15.2:6824/1270626884","state":["exists","up"]},{"osd":4,"uuid":"c7b642f4-8bd2-4262-9a82-ee1061cfab7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6803","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6806","nonce":553254873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6813","nonce":553254873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6822","nonce":553254873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6819","nonce":553254873}]},"public_addr":"172.21.15.155:6806/553254873","cluster_addr":"172.21.15.155:6813/553254873","heartbeat_back_addr":"172.21.15.155:6822/553254873","heartbeat_front_addr":"172.21.15.155:6819/553254873","state":["exists","up"]},{"osd":5,"uuid":"fb53289a-419f-46d8-9e3a-384ac529dc57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6805","nonce":2107688472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6811","nonce":2107688472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6823","nonce":2107688472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6817","nonce":2107688472}]},"public_addr":"172.21.15.155:6805/2107688472","cluster_addr":"172.21.15.155:6811/2107688472","heartbeat_back_addr":"172.21.15.155:6823/2107688472","heartbeat_front_addr":"172.21.15.155:6817/2107688472","state":["exists","up"]},{"osd":6,"uuid":"3f9ddd54-ede4-4565-aff6-ae1c07e7c678","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6825","nonce":944542383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6827","nonce":944542383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6831","nonce":944542383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6829","nonce":944542383}]},"public_addr":"172.21.15.155:6825/944542383","cluster_addr":"172.21.15.155:6827/944542383","heartbeat_back_addr":"172.21.15.155:6831/944542383","heartbeat_front_addr":"172.21.15.155:6829/944542383","state":["exists","up"]},{"osd":7,"uuid":"328d0681-eef4-4556-94e1-9745bd4adbe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6801","nonce":2220093913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6807","nonce":2220093913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6818","nonce":2220093913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6812","nonce":2220093913}]},"public_addr":"172.21.15.155:6801/2220093913","cluster_addr":"172.21.15.155:6807/2220093913","heartbeat_back_addr":"172.21.15.155:6818/2220093913","heartbeat_front_addr":"172.21.15.155:6812/2220093913","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.052980+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.104550+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.025661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:35.784354+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:35.863363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.322312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.100890+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:35.763584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:47:20.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.041+0000 7f3c8be00640 1 -- 172.21.15.2:0/1583884894 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f3c6406be30 msgr2=0x7f3c6406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:20.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.041+0000 7f3c8be00640 1 --2- 172.21.15.2:0/1583884894 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f3c6406be30 0x7f3c6406e2f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3c78034000 tx=0x7f3c7802e000 comp rx=0 tx=0).stop 2024-09-10T08:47:20.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.041+0000 7f3c8be00640 1 -- 172.21.15.2:0/1583884894 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c8415e6b0 msgr2=0x7f3c840cb690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:20.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.041+0000 7f3c8be00640 1 --2- 172.21.15.2:0/1583884894 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c8415e6b0 0x7f3c840cb690 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c00eed0 tx=0x7f3c7c00b480 comp rx=0 tx=0).stop 2024-09-10T08:47:20.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.041+0000 7f3c8be00640 1 -- 172.21.15.2:0/1583884894 shutdown_connections 2024-09-10T08:47:20.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.041+0000 7f3c8be00640 1 --2- 172.21.15.2:0/1583884894 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c8415e6b0 0x7f3c840cb690 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:20.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.041+0000 7f3c8be00640 1 --2- 172.21.15.2:0/1583884894 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f3c6406be30 0x7f3c6406e2f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:20.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.041+0000 7f3c8be00640 1 --2- 172.21.15.2:0/1583884894 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3c840d5210 0x7f3c841549b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:20.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.041+0000 7f3c8be00640 1 --2- 172.21.15.2:0/1583884894 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3c8406ce60 0x7f3c840b4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:20.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.041+0000 7f3c8be00640 1 -- 172.21.15.2:0/1583884894 >> 172.21.15.2:0/1583884894 conn(0x7f3c8408bfd0 msgr2=0x7f3c840b1b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:20.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.041+0000 7f3c8be00640 1 -- 172.21.15.2:0/1583884894 shutdown_connections 2024-09-10T08:47:20.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.042+0000 7f3c8be00640 1 -- 172.21.15.2:0/1583884894 wait complete. 2024-09-10T08:47:20.058 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:47:20.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.212+0000 7f721d400640 1 Processor -- start 2024-09-10T08:47:20.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.212+0000 7f721d400640 1 -- start start 2024-09-10T08:47:20.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.214+0000 7f721d400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f72180cd480 0x7f72181660d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:20.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.214+0000 7f721d400640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72180cf430 con 0x7f7218144c90 2024-09-10T08:47:20.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.214+0000 7f721d400640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f721806f540 con 0x7f7218144250 2024-09-10T08:47:20.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.214+0000 7f721d400640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f721806f820 con 0x7f72180cd480 2024-09-10T08:47:20.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.214+0000 7f720fe00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f7218144c90 0x7f72180ccd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48470/0 (socket says 172.21.15.2:48470) 2024-09-10T08:47:20.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.214+0000 7f720fe00640 1 -- 172.21.15.2:0/593909058 learned_addr learned my addr 172.21.15.2:0/593909058 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:47:20.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.214+0000 7f7217200640 1 --2- 172.21.15.2:0/593909058 >> v2:172.21.15.2:3300/0 conn(0x7f72180cd480 0x7f72181660d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:20.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.214+0000 7f7215e00640 1 -- 172.21.15.2:0/593909058 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2214852791 0 0) 0x7f72180cf430 con 0x7f7218144c90 2024-09-10T08:47:20.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.214+0000 7f7215e00640 1 -- 172.21.15.2:0/593909058 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f71fc005730 con 0x7f7218144c90 2024-09-10T08:47:20.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.214+0000 7f7215e00640 1 -- 172.21.15.2:0/593909058 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1886636305 0 0) 0x7f721806f540 con 0x7f7218144250 2024-09-10T08:47:20.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.214+0000 7f7217200640 1 -- 172.21.15.2:0/593909058 >> v1:172.21.15.155:6789/0 conn(0x7f7218144250 legacy=0x7f72180cf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:20.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.214+0000 7f7217200640 1 -- 172.21.15.2:0/593909058 >> v1:172.21.15.2:6789/0 conn(0x7f7218144c90 legacy=0x7f72180ccd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:20.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.214+0000 7f7217200640 1 -- 172.21.15.2:0/593909058 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f721806fb00 con 0x7f72180cd480 2024-09-10T08:47:20.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.215+0000 7f7217200640 1 --2- 172.21.15.2:0/593909058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72180cd480 0x7f72181660d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7210009d90 tx=0x7f721002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cd6f609160bc38c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:20.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.216+0000 7f7215e00640 1 -- 172.21.15.2:0/593909058 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7210007740 con 0x7f72180cd480 2024-09-10T08:47:20.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.216+0000 7f7215e00640 1 -- 172.21.15.2:0/593909058 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72100078e0 con 0x7f72180cd480 2024-09-10T08:47:20.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.216+0000 7f7215e00640 1 -- 172.21.15.2:0/593909058 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7210007cb0 con 0x7f72180cd480 2024-09-10T08:47:20.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.216+0000 7f721d400640 1 -- 172.21.15.2:0/593909058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72180cd480 msgr2=0x7f72181660d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:20.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.216+0000 7f721d400640 1 --2- 172.21.15.2:0/593909058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72180cd480 0x7f72181660d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7210009d90 tx=0x7f721002a6f0 comp rx=0 tx=0).stop 2024-09-10T08:47:20.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.216+0000 7f721d400640 1 -- 172.21.15.2:0/593909058 shutdown_connections 2024-09-10T08:47:20.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.216+0000 7f721d400640 1 --2- 172.21.15.2:0/593909058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72180cd480 0x7f72181660d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:20.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.216+0000 7f721d400640 1 -- 172.21.15.2:0/593909058 >> 172.21.15.2:0/593909058 conn(0x7f721806bc10 msgr2=0x7f721806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:20.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.216+0000 7f721d400640 1 -- 172.21.15.2:0/593909058 shutdown_connections 2024-09-10T08:47:20.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.216+0000 7f721d400640 1 -- 172.21.15.2:0/593909058 wait complete. 2024-09-10T08:47:20.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.218+0000 7f721d400640 1 Processor -- start 2024-09-10T08:47:20.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.218+0000 7f721d400640 1 -- start start 2024-09-10T08:47:20.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.219+0000 7f721d400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72180cd480 0x7f7218139b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:20.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.219+0000 7f721d400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7218144250 0x7f7218143370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:20.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.219+0000 7f721d400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7218144c90 0x7f72180b3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:20.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.219+0000 7f721d400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f72180b3390 con 0x7f72180cd480 2024-09-10T08:47:20.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.219+0000 7f721d400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f72180700c0 con 0x7f7218144250 2024-09-10T08:47:20.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.219+0000 7f721d400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7218071f60 con 0x7f7218144c90 2024-09-10T08:47:20.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.219+0000 7f7216800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72180cd480 0x7f7218139b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:20.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.219+0000 7f7216800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72180cd480 0x7f7218139b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51262/0 (socket says 172.21.15.2:51262) 2024-09-10T08:47:20.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.219+0000 7f7216800640 1 -- 172.21.15.2:0/3094282548 learned_addr learned my addr 172.21.15.2:0/3094282548 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:20.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.220+0000 7f720fe00640 1 --2- 172.21.15.2:0/3094282548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7218144250 0x7f7218143370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:20.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.220+0000 7f7217200640 1 --2- 172.21.15.2:0/3094282548 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7218144c90 0x7f72180b3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:20.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.220+0000 7f7216800640 1 -- 172.21.15.2:0/3094282548 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7218144c90 msgr2=0x7f72180b3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:20.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.220+0000 7f7216800640 1 --2- 172.21.15.2:0/3094282548 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7218144c90 0x7f72180b3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:20.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.220+0000 7f7216800640 1 -- 172.21.15.2:0/3094282548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7218144250 msgr2=0x7f7218143370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:20.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.220+0000 7f7216800640 1 --2- 172.21.15.2:0/3094282548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7218144250 0x7f7218143370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:20.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.220+0000 7f7216800640 1 -- 172.21.15.2:0/3094282548 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72180b0450 con 0x7f72180cd480 2024-09-10T08:47:20.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.220+0000 7f7217200640 1 --2- 172.21.15.2:0/3094282548 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7218144c90 0x7f72180b3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:47:20.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.220+0000 7f7216800640 1 --2- 172.21.15.2:0/3094282548 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72180cd480 0x7f7218139b60 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f720800c520 tx=0x7f720800c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:20.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.220+0000 7f720ea00640 1 -- 172.21.15.2:0/3094282548 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7208017070 con 0x7f72180cd480 2024-09-10T08:47:20.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.220+0000 7f720ea00640 1 -- 172.21.15.2:0/3094282548 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72080052d0 con 0x7f72180cd480 2024-09-10T08:47:20.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.221+0000 7f721d400640 1 -- 172.21.15.2:0/3094282548 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72180b0730 con 0x7f72180cd480 2024-09-10T08:47:20.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.221+0000 7f720ea00640 1 -- 172.21.15.2:0/3094282548 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7208012870 con 0x7f72180cd480 2024-09-10T08:47:20.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.221+0000 7f721d400640 1 -- 172.21.15.2:0/3094282548 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72180b0cf0 con 0x7f72180cd480 2024-09-10T08:47:20.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.222+0000 7f721d400640 1 -- 172.21.15.2:0/3094282548 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72181447d0 con 0x7f72180cd480 2024-09-10T08:47:20.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.223+0000 7f720ea00640 1 -- 172.21.15.2:0/3094282548 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f720801a070 con 0x7f72180cd480 2024-09-10T08:47:20.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.224+0000 7f720ea00640 1 --2- 172.21.15.2:0/3094282548 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f71f406be60 0x7f71f406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:20.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.224+0000 7f720ea00640 1 -- 172.21.15.2:0/3094282548 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f720808a440 con 0x7f72180cd480 2024-09-10T08:47:20.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.224+0000 7f720fe00640 1 --2- 172.21.15.2:0/3094282548 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f71f406be60 0x7f71f406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:20.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.225+0000 7f720fe00640 1 --2- 172.21.15.2:0/3094282548 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f71f406be60 0x7f71f406e320 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7218142470 tx=0x7f7200009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:20.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.228+0000 7f720ea00640 1 -- 172.21.15.2:0/3094282548 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7208058470 con 0x7f72180cd480 2024-09-10T08:47:20.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.447+0000 7f721d400640 1 -- 172.21.15.2:0/3094282548 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f72180cd020 con 0x7f72180cd480 2024-09-10T08:47:20.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.448+0000 7f720ea00640 1 -- 172.21.15.2:0/3094282548 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5216 (secure 0 0 0) 0x7f720805c770 con 0x7f72180cd480 2024-09-10T08:47:20.449 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:47:20.449 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":9,"btime":"2024-09-10T08:47:13:450812+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/4081738683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":4081738683},{"type":"v1","addr":"172.21.15.2:6835","nonce":4081738683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1478106484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":1478106484},{"type":"v1","addr":"172.21.15.155:6837","nonce":1478106484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/800933941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":800933941},{"type":"v1","addr":"172.21.15.2:6834","nonce":800933941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:46:51.181258+0000","modified":"2024-09-10T08:47:12.877562+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6836/2996773231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2996773231},{"type":"v1","addr":"172.21.15.155:6836","nonce":2996773231}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":1}]} 2024-09-10T08:47:20.450 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 9 2024-09-10T08:47:20.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.450+0000 7f721d400640 1 -- 172.21.15.2:0/3094282548 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f71f406be60 msgr2=0x7f71f406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:20.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.450+0000 7f721d400640 1 --2- 172.21.15.2:0/3094282548 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f71f406be60 0x7f71f406e320 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7218142470 tx=0x7f7200009040 comp rx=0 tx=0).stop 2024-09-10T08:47:20.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.450+0000 7f721d400640 1 -- 172.21.15.2:0/3094282548 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72180cd480 msgr2=0x7f7218139b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:20.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.450+0000 7f721d400640 1 --2- 172.21.15.2:0/3094282548 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72180cd480 0x7f7218139b60 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f720800c520 tx=0x7f720800c9e0 comp rx=0 tx=0).stop 2024-09-10T08:47:20.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.450+0000 7f721d400640 1 -- 172.21.15.2:0/3094282548 shutdown_connections 2024-09-10T08:47:20.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.450+0000 7f721d400640 1 --2- 172.21.15.2:0/3094282548 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f71f406be60 0x7f71f406e320 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:20.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.450+0000 7f721d400640 1 --2- 172.21.15.2:0/3094282548 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7218144c90 0x7f72180b3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:20.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.450+0000 7f721d400640 1 --2- 172.21.15.2:0/3094282548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7218144250 0x7f7218143370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:20.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.450+0000 7f721d400640 1 --2- 172.21.15.2:0/3094282548 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72180cd480 0x7f7218139b60 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:20.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.450+0000 7f721d400640 1 -- 172.21.15.2:0/3094282548 >> 172.21.15.2:0/3094282548 conn(0x7f721806bc10 msgr2=0x7f7218072320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:20.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.450+0000 7f721d400640 1 -- 172.21.15.2:0/3094282548 shutdown_connections 2024-09-10T08:47:20.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:20.450+0000 7f721d400640 1 -- 172.21.15.2:0/3094282548 wait complete. 2024-09-10T08:47:20.869 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T08:46:51.181258+0000', 'modified': '2024-09-10T08:47:12.877562+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4288}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4288': {'gid': 4288, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.155:6836/2996773231', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 2996773231}, {'type': 'v1', 'addr': '172.21.15.155:6836', 'nonce': 2996773231}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4288, 'qdb_cluster': [4288]} 2024-09-10T08:47:20.870 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T08:47:20.870 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-10T08:47:21.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.028+0000 7f9e9b200640 1 Processor -- start 2024-09-10T08:47:21.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.028+0000 7f9e9b200640 1 -- start start 2024-09-10T08:47:21.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.029+0000 7f9e9b200640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9e94161b20 0x7f9e940adb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:21.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.029+0000 7f9e9b200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9e94073340 0x7f9e940737b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:21.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.030+0000 7f9e9b200640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e9406ea00 con 0x7f9e940b44f0 2024-09-10T08:47:21.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.030+0000 7f9e9b200640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f9e94161f00 con 0x7f9e94073340 2024-09-10T08:47:21.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.030+0000 7f9e9b200640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f9e940ae040 con 0x7f9e94161b20 2024-09-10T08:47:21.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.030+0000 7f9e99200640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f9e940b44f0 0x7f9e9406faa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48474/0 (socket says 172.21.15.2:48474) 2024-09-10T08:47:21.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.030+0000 7f9e99200640 1 -- 172.21.15.2:0/3705584625 learned_addr learned my addr 172.21.15.2:0/3705584625 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:47:21.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.030+0000 7f9e8be00640 1 --2- 172.21.15.2:0/3705584625 >> v2:172.21.15.2:3300/0 conn(0x7f9e94073340 0x7f9e940737b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:21.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.030+0000 7f9e93e00640 1 --2- 172.21.15.2:0/3705584625 >> v2:172.21.15.155:3300/0 conn(0x7f9e94161b20 0x7f9e940adb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:21.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.030+0000 7f9e93400640 1 -- 172.21.15.2:0/3705584625 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3258999185 0 0) 0x7f9e9406ea00 con 0x7f9e940b44f0 2024-09-10T08:47:21.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.030+0000 7f9e93400640 1 -- 172.21.15.2:0/3705584625 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e78003520 con 0x7f9e940b44f0 2024-09-10T08:47:21.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.030+0000 7f9e8be00640 1 -- 172.21.15.2:0/3705584625 >> v2:172.21.15.155:3300/0 conn(0x7f9e94161b20 msgr2=0x7f9e940adb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:21.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.030+0000 7f9e8be00640 1 --2- 172.21.15.2:0/3705584625 >> v2:172.21.15.155:3300/0 conn(0x7f9e94161b20 0x7f9e940adb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:21.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.030+0000 7f9e8be00640 1 -- 172.21.15.2:0/3705584625 >> v1:172.21.15.2:6789/0 conn(0x7f9e940b44f0 legacy=0x7f9e9406faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:21.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.030+0000 7f9e8be00640 1 -- 172.21.15.2:0/3705584625 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e9406ece0 con 0x7f9e94073340 2024-09-10T08:47:21.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.030+0000 7f9e93e00640 1 --2- 172.21.15.2:0/3705584625 >> v2:172.21.15.155:3300/0 conn(0x7f9e94161b20 0x7f9e940adb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:47:21.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.031+0000 7f9e8be00640 1 --2- 172.21.15.2:0/3705584625 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e94073340 0x7f9e940737b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9e94050090 tx=0x7f9e7c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b3dfcca5847721a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:21.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.032+0000 7f9e93400640 1 -- 172.21.15.2:0/3705584625 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e7c037070 con 0x7f9e94073340 2024-09-10T08:47:21.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.032+0000 7f9e93400640 1 -- 172.21.15.2:0/3705584625 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e7c032440 con 0x7f9e94073340 2024-09-10T08:47:21.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.032+0000 7f9e93400640 1 -- 172.21.15.2:0/3705584625 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e7c032810 con 0x7f9e94073340 2024-09-10T08:47:21.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.032+0000 7f9e9b200640 1 -- 172.21.15.2:0/3705584625 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e94073340 msgr2=0x7f9e940737b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:21.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.032+0000 7f9e9b200640 1 --2- 172.21.15.2:0/3705584625 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e94073340 0x7f9e940737b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9e94050090 tx=0x7f9e7c02a1a0 comp rx=0 tx=0).stop 2024-09-10T08:47:21.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.032+0000 7f9e9b200640 1 -- 172.21.15.2:0/3705584625 shutdown_connections 2024-09-10T08:47:21.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.032+0000 7f9e9b200640 1 --2- 172.21.15.2:0/3705584625 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e94073340 0x7f9e940737b0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:21.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.032+0000 7f9e9b200640 1 --2- 172.21.15.2:0/3705584625 >> v2:172.21.15.155:3300/0 conn(0x7f9e94161b20 0x7f9e940adb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:21.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.032+0000 7f9e9b200640 1 -- 172.21.15.2:0/3705584625 >> 172.21.15.2:0/3705584625 conn(0x7f9e94072820 msgr2=0x7f9e94072c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:21.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.032+0000 7f9e9b200640 1 -- 172.21.15.2:0/3705584625 shutdown_connections 2024-09-10T08:47:21.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.032+0000 7f9e9b200640 1 -- 172.21.15.2:0/3705584625 wait complete. 2024-09-10T08:47:21.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.034+0000 7f9e9b200640 1 Processor -- start 2024-09-10T08:47:21.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.034+0000 7f9e9b200640 1 -- start start 2024-09-10T08:47:21.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.035+0000 7f9e9b200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e94073340 0x7f9e9415c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:21.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.035+0000 7f9e9b200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e940b44f0 0x7f9e941f3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:21.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.035+0000 7f9e9b200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e94161b20 0x7f9e941f4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:21.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.035+0000 7f9e9b200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9e9406f580 con 0x7f9e94073340 2024-09-10T08:47:21.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.035+0000 7f9e9b200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9e9406f2a0 con 0x7f9e94161b20 2024-09-10T08:47:21.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.035+0000 7f9e9b200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9e940b3d30 con 0x7f9e940b44f0 2024-09-10T08:47:21.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.035+0000 7f9e93e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e94073340 0x7f9e9415c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:21.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.035+0000 7f9e93e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e94073340 0x7f9e9415c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51284/0 (socket says 172.21.15.2:51284) 2024-09-10T08:47:21.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.035+0000 7f9e93e00640 1 -- 172.21.15.2:0/3090951079 learned_addr learned my addr 172.21.15.2:0/3090951079 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:21.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.036+0000 7f9e93e00640 1 -- 172.21.15.2:0/3090951079 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e940b44f0 msgr2=0x7f9e941f3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:21.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.036+0000 7f9e93e00640 1 --2- 172.21.15.2:0/3090951079 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e940b44f0 0x7f9e941f3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:21.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.036+0000 7f9e93e00640 1 -- 172.21.15.2:0/3090951079 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e94161b20 msgr2=0x7f9e941f4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:21.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.036+0000 7f9e93e00640 1 --2- 172.21.15.2:0/3090951079 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e94161b20 0x7f9e941f4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:21.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.036+0000 7f9e93e00640 1 -- 172.21.15.2:0/3090951079 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e9415ce40 con 0x7f9e94073340 2024-09-10T08:47:21.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.036+0000 7f9e93e00640 1 --2- 172.21.15.2:0/3090951079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e94073340 0x7f9e9415c460 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9e8400e7e0 tx=0x7f9e8400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:21.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.036+0000 7f9e90c00640 1 -- 172.21.15.2:0/3090951079 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8400f040 con 0x7f9e94073340 2024-09-10T08:47:21.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.036+0000 7f9e90c00640 1 -- 172.21.15.2:0/3090951079 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e84004030 con 0x7f9e94073340 2024-09-10T08:47:21.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.036+0000 7f9e90c00640 1 -- 172.21.15.2:0/3090951079 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e84004400 con 0x7f9e94073340 2024-09-10T08:47:21.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.036+0000 7f9e9b200640 1 -- 172.21.15.2:0/3090951079 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e9415d120 con 0x7f9e94073340 2024-09-10T08:47:21.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.037+0000 7f9e9b200640 1 -- 172.21.15.2:0/3090951079 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e9415d6e0 con 0x7f9e94073340 2024-09-10T08:47:21.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.039+0000 7f9e90c00640 1 -- 172.21.15.2:0/3090951079 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9e8400c6d0 con 0x7f9e94073340 2024-09-10T08:47:21.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.039+0000 7f9e90c00640 1 --2- 172.21.15.2:0/3090951079 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f9e7006be30 0x7f9e7006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:21.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.039+0000 7f9e90c00640 1 -- 172.21.15.2:0/3090951079 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f9e8408b070 con 0x7f9e94073340 2024-09-10T08:47:21.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.041+0000 7f9e8be00640 1 --2- 172.21.15.2:0/3090951079 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f9e7006be30 0x7f9e7006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:21.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.041+0000 7f9e9e257740 1 Processor -- start 2024-09-10T08:47:21.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.041+0000 7f9e9e257740 1 -- start start 2024-09-10T08:47:21.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.041+0000 7f9e8be00640 1 --2- 172.21.15.2:0/3090951079 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f9e7006be30 0x7f9e7006e2f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c034000 tx=0x7f9e7c02c000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:21.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.041+0000 7f9e9e257740 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55fc15287cf0 0x55fc152cd490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:21.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.041+0000 7f9e9e257740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc152854b0 0x55fc152880d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:21.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.042+0000 7f9e9e257740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fc15289480 0x55fc15282570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:21.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.042+0000 7f9e9e257740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55fc151e63b0 con 0x55fc152854b0 2024-09-10T08:47:21.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.042+0000 7f9e9e257740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55fc151eb410 con 0x55fc15289480 2024-09-10T08:47:21.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.042+0000 7f9e9e257740 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x55fc15193620 con 0x55fc15287cf0 2024-09-10T08:47:21.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.042+0000 7f9e8be00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc152854b0 0x55fc152880d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:21.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.042+0000 7f9e8be00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc152854b0 0x55fc152880d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51290/0 (socket says 172.21.15.2:51290) 2024-09-10T08:47:21.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.042+0000 7f9e8be00640 1 -- 172.21.15.2:0/2023658656 learned_addr learned my addr 172.21.15.2:0/2023658656 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:21.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.042+0000 7f9e99200640 1 --2- 172.21.15.2:0/2023658656 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fc15289480 0x55fc15282570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:21.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.042+0000 7f9e93e00640 1 --2- 172.21.15.2:0/2023658656 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55fc15287cf0 0x55fc152cd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:21.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.042+0000 7f9e8be00640 1 -- 172.21.15.2:0/2023658656 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55fc15287cf0 msgr2=0x55fc152cd490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:21.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.042+0000 7f9e8be00640 1 --2- 172.21.15.2:0/2023658656 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55fc15287cf0 0x55fc152cd490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:21.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.042+0000 7f9e8be00640 1 -- 172.21.15.2:0/2023658656 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fc15289480 msgr2=0x55fc15282570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:21.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.042+0000 7f9e8be00640 1 --2- 172.21.15.2:0/2023658656 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fc15289480 0x55fc15282570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:21.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.042+0000 7f9e8be00640 1 -- 172.21.15.2:0/2023658656 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc14efe2d0 con 0x55fc152854b0 2024-09-10T08:47:21.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.043+0000 7f9e8be00640 1 --2- 172.21.15.2:0/2023658656 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc152854b0 0x55fc152880d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c009860 tx=0x7f9e7c008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ca520c54781ef38 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:21.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.043+0000 7f9e88c00640 1 -- 172.21.15.2:0/2023658656 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e7c037040 con 0x55fc152854b0 2024-09-10T08:47:21.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.043+0000 7f9e88c00640 1 -- 172.21.15.2:0/2023658656 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e7c04c070 con 0x55fc152854b0 2024-09-10T08:47:21.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.043+0000 7f9e88c00640 1 -- 172.21.15.2:0/2023658656 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e7c032ca0 con 0x55fc152854b0 2024-09-10T08:47:21.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.044+0000 7f9e9e257740 1 -- 172.21.15.2:0/2023658656 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc152854b0 msgr2=0x55fc152880d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:21.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.044+0000 7f9e9e257740 1 --2- 172.21.15.2:0/2023658656 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc152854b0 0x55fc152880d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c009860 tx=0x7f9e7c008030 comp rx=0 tx=0).stop 2024-09-10T08:47:21.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.044+0000 7f9e9e257740 1 -- 172.21.15.2:0/2023658656 shutdown_connections 2024-09-10T08:47:21.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.044+0000 7f9e9e257740 1 --2- 172.21.15.2:0/2023658656 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fc15289480 0x55fc15282570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:21.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.044+0000 7f9e9e257740 1 --2- 172.21.15.2:0/2023658656 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc152854b0 0x55fc152880d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:21.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.044+0000 7f9e9e257740 1 --2- 172.21.15.2:0/2023658656 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55fc15287cf0 0x55fc152cd490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:21.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.044+0000 7f9e9e257740 1 -- 172.21.15.2:0/2023658656 >> 172.21.15.2:0/2023658656 conn(0x55fc15284740 msgr2=0x55fc152cc960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:21.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.044+0000 7f9e9e257740 1 -- 172.21.15.2:0/2023658656 shutdown_connections 2024-09-10T08:47:21.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.044+0000 7f9e9e257740 1 -- 172.21.15.2:0/2023658656 wait complete. 2024-09-10T08:47:21.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.044+0000 7f9e9e257740 1 -- start start 2024-09-10T08:47:21.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.045+0000 7f9e9e257740 1 Processor -- start 2024-09-10T08:47:21.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.046+0000 7f9e9e257740 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55fc15287cf0 0x55fc152a9160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:21.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.046+0000 7f9e9e257740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fc15289480 0x55fc152a4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:21.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.046+0000 7f9e9e257740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc152e0d30 0x55fc152b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:21.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.046+0000 7f9e9e257740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55fc151a6780 con 0x55fc152e0d30 2024-09-10T08:47:21.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.046+0000 7f9e9e257740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55fc151e73d0 con 0x55fc15289480 2024-09-10T08:47:21.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.046+0000 7f9e9e257740 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x55fc15283be0 con 0x55fc15287cf0 2024-09-10T08:47:21.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.046+0000 7f9e9e257740 10 client.0 _ll_register_callbacks cb 0x55fc151e45d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:47:21.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.046+0000 7f9e99200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc152e0d30 0x55fc152b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:21.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.046+0000 7f9e99200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc152e0d30 0x55fc152b1f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51296/0 (socket says 172.21.15.2:51296) 2024-09-10T08:47:21.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.046+0000 7f9e99200640 1 -- 172.21.15.2:0/2780284616 learned_addr learned my addr 172.21.15.2:0/2780284616 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:21.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.046+0000 7f9e8be00640 1 --2- 172.21.15.2:0/2780284616 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fc15289480 0x55fc152a4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:21.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.046+0000 7f9e93e00640 1 --2- 172.21.15.2:0/2780284616 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55fc15287cf0 0x55fc152a9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:21.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.046+0000 7f9e99200640 1 -- 172.21.15.2:0/2780284616 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55fc15287cf0 msgr2=0x55fc152a9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:21.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.046+0000 7f9e99200640 1 --2- 172.21.15.2:0/2780284616 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55fc15287cf0 0x55fc152a9160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:21.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.046+0000 7f9e99200640 1 -- 172.21.15.2:0/2780284616 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fc15289480 msgr2=0x55fc152a4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:21.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.046+0000 7f9e99200640 1 --2- 172.21.15.2:0/2780284616 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fc15289480 0x55fc152a4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:21.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.046+0000 7f9e99200640 1 -- 172.21.15.2:0/2780284616 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc14fc86b0 con 0x55fc152e0d30 2024-09-10T08:47:21.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.046+0000 7f9e8be00640 1 --2- 172.21.15.2:0/2780284616 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fc15289480 0x55fc152a4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:47:21.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.047+0000 7f9e99200640 1 --2- 172.21.15.2:0/2780284616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc152e0d30 0x55fc152b1f20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c00f8f0 tx=0x7f9e8c00fcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6259f051f3fad92f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:21.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.047+0000 7f9e81600640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T08:47:21.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.047+0000 7f9e81600640 1 -- 172.21.15.2:0/2780284616 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8c00d940 con 0x55fc152e0d30 2024-09-10T08:47:21.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.047+0000 7f9e9e257740 1 -- 172.21.15.2:0/2780284616 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e7c04c070 con 0x55fc152e0d30 2024-09-10T08:47:21.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.047+0000 7f9e81600640 1 -- 172.21.15.2:0/2780284616 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f9e8c00dae0 con 0x55fc152e0d30 2024-09-10T08:47:21.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.047+0000 7f9e81600640 1 -- 172.21.15.2:0/2780284616 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f9e8c020050 con 0x55fc152e0d30 2024-09-10T08:47:21.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.047+0000 7f9e9e257740 10 client.4632 fetch_fsmap learned FSMap version 9 2024-09-10T08:47:21.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.047+0000 7f9e9e257740 1 -- 172.21.15.2:0/2780284616 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55fc152a9e00 con 0x55fc152e0d30 2024-09-10T08:47:21.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.047+0000 7f9e81600640 1 -- 172.21.15.2:0/2780284616 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e7c04c070 con 0x55fc152e0d30 2024-09-10T08:47:21.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.047+0000 7f9e81600640 1 -- 172.21.15.2:0/2780284616 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 9) ==== 3510+0+0 (secure 0 0 0) 0x7f9e8c023020 con 0x55fc152e0d30 2024-09-10T08:47:21.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.047+0000 7f9e9e257740 10 client.4632 fetch_fsmap finished waiting for FSMap version 9 2024-09-10T08:47:21.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.048+0000 7f9e9e257740 10 client.4632 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T08:47:21.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.048+0000 7f9e9e257740 20 client.4632 populate_metadata read hostname 'smithi002' 2024-09-10T08:47:21.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.048+0000 7f9e9e257740 1 --2- 172.21.15.2:0/2780284616 >> [v2:172.21.15.155:6834/2996773231,v1:172.21.15.155:6836/2996773231] conn(0x55fc152b0280 0x55fc152b0660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:21.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.048+0000 7f9e9e257740 4 client.4632 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:47:21.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.048+0000 7f9e9e257740 1 -- 172.21.15.2:0/2780284616 --> [v2:172.21.15.155:6834/2996773231,v1:172.21.15.155:6836/2996773231] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fc151f8b40 con 0x55fc152b0280 2024-09-10T08:47:21.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.048+0000 7f9e93e00640 1 --2- 172.21.15.2:0/2780284616 >> [v2:172.21.15.155:6834/2996773231,v1:172.21.15.155:6836/2996773231] conn(0x55fc152b0280 0x55fc152b0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:21.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.049+0000 7f9e93e00640 1 --2- 172.21.15.2:0/2780284616 >> [v2:172.21.15.155:6834/2996773231,v1:172.21.15.155:6836/2996773231] conn(0x55fc152b0280 0x55fc152b0660 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4c3a1e75c690a07 server_cookie=d8cd63344525f98d in_seq=0 out_seq=0 2024-09-10T08:47:21.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.049+0000 7f9e81600640 10 client.4632 ms_handle_connect on v2:172.21.15.155:6834/2996773231 2024-09-10T08:47:21.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.049+0000 7f9e81600640 1 -- 172.21.15.2:0/2780284616 <== mds.0 v2:172.21.15.155:6834/2996773231 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fc151f8b40 con 0x55fc152b0280 2024-09-10T08:47:21.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.049+0000 7f9e81600640 10 client.4632 handle_command_reply: tid=0 2024-09-10T08:47:21.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.050+0000 7f9e9e257740 1 client.4632 shutdown 2024-09-10T08:47:21.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.050+0000 7f9e9e257740 1 -- 172.21.15.2:0/2780284616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc152e0d30 msgr2=0x55fc152b1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:21.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.050+0000 7f9e9e257740 1 --2- 172.21.15.2:0/2780284616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc152e0d30 0x55fc152b1f20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c00f8f0 tx=0x7f9e8c00fcf0 comp rx=0 tx=0).stop 2024-09-10T08:47:21.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.050+0000 7f9e9e257740 1 -- 172.21.15.2:0/2780284616 shutdown_connections 2024-09-10T08:47:21.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.050+0000 7f9e9e257740 1 --2- 172.21.15.2:0/2780284616 >> [v2:172.21.15.155:6834/2996773231,v1:172.21.15.155:6836/2996773231] conn(0x55fc152b0280 0x55fc152b0660 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:21.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.050+0000 7f9e9e257740 1 --2- 172.21.15.2:0/2780284616 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc152e0d30 0x55fc152b1f20 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:21.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.050+0000 7f9e9e257740 1 --2- 172.21.15.2:0/2780284616 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fc15289480 0x55fc152a4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:21.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.050+0000 7f9e9e257740 1 --2- 172.21.15.2:0/2780284616 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55fc15287cf0 0x55fc152a9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:21.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.050+0000 7f9e81600640 0 client.4632 ms_handle_reset on v2:172.21.15.155:6834/2996773231 2024-09-10T08:47:21.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.050+0000 7f9e9e257740 1 -- 172.21.15.2:0/2780284616 >> 172.21.15.2:0/2780284616 conn(0x55fc152854b0 msgr2=0x55fc152ca9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:21.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.050+0000 7f9e9e257740 1 -- 172.21.15.2:0/2780284616 shutdown_connections 2024-09-10T08:47:21.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.050+0000 7f9e9e257740 1 -- 172.21.15.2:0/2780284616 wait complete. 2024-09-10T08:47:21.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.050+0000 7f9e9e257740 20 client.4632 trim_cache size 0 max 16384 2024-09-10T08:47:21.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.069+0000 7f9e9e257740 1 Processor -- start 2024-09-10T08:47:21.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.069+0000 7f9e9e257740 1 -- start start 2024-09-10T08:47:21.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.070+0000 7f9e9e257740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fc15287cf0 0x55fc152b0660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:21.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.070+0000 7f9e9e257740 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55fc15289480 0x55fc152acb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:21.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.070+0000 7f9e9e257740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc152e0d30 0x55fc152ca9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:21.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.070+0000 7f9e9e257740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9e94200ec0 con 0x55fc152e0d30 2024-09-10T08:47:21.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.070+0000 7f9e9e257740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9e94200220 con 0x55fc15287cf0 2024-09-10T08:47:21.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.070+0000 7f9e9e257740 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9e94200870 con 0x55fc15289480 2024-09-10T08:47:21.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.070+0000 7f9e99200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc152e0d30 0x55fc152ca9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:21.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.070+0000 7f9e99200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc152e0d30 0x55fc152ca9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51298/0 (socket says 172.21.15.2:51298) 2024-09-10T08:47:21.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.070+0000 7f9e99200640 1 -- 172.21.15.2:0/3768652755 learned_addr learned my addr 172.21.15.2:0/3768652755 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:21.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.070+0000 7f9e93e00640 1 --2- 172.21.15.2:0/3768652755 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fc15287cf0 0x55fc152b0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:21.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.070+0000 7f9e8be00640 1 --2- 172.21.15.2:0/3768652755 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55fc15289480 0x55fc152acb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:21.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.070+0000 7f9e99200640 1 -- 172.21.15.2:0/3768652755 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55fc15289480 msgr2=0x55fc152acb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:21.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.070+0000 7f9e99200640 1 --2- 172.21.15.2:0/3768652755 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55fc15289480 0x55fc152acb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:21.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.070+0000 7f9e99200640 1 -- 172.21.15.2:0/3768652755 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fc15287cf0 msgr2=0x55fc152b0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:21.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.070+0000 7f9e99200640 1 --2- 172.21.15.2:0/3768652755 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fc15287cf0 0x55fc152b0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:21.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.070+0000 7f9e99200640 1 -- 172.21.15.2:0/3768652755 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc152b2290 con 0x55fc152e0d30 2024-09-10T08:47:21.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.070+0000 7f9e93e00640 1 --2- 172.21.15.2:0/3768652755 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fc15287cf0 0x55fc152b0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:47:21.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.070+0000 7f9e8be00640 1 --2- 172.21.15.2:0/3768652755 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55fc15289480 0x55fc152acb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:47:21.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.071+0000 7f9e99200640 1 --2- 172.21.15.2:0/3768652755 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc152e0d30 0x55fc152ca9e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c00f8f0 tx=0x7f9e8c00a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=146c3a83c93accc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:21.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.071+0000 7f9e83e00640 1 -- 172.21.15.2:0/3768652755 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8c00d940 con 0x55fc152e0d30 2024-09-10T08:47:21.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.071+0000 7f9e83e00640 1 -- 172.21.15.2:0/3768652755 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e8c018070 con 0x55fc152e0d30 2024-09-10T08:47:21.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.071+0000 7f9e83e00640 1 -- 172.21.15.2:0/3768652755 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8c01b420 con 0x55fc152e0d30 2024-09-10T08:47:21.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.072+0000 7f9e9e257740 1 -- 172.21.15.2:0/3768652755 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc152e0d30 msgr2=0x55fc152ca9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:21.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.072+0000 7f9e9e257740 1 --2- 172.21.15.2:0/3768652755 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc152e0d30 0x55fc152ca9e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c00f8f0 tx=0x7f9e8c00a000 comp rx=0 tx=0).stop 2024-09-10T08:47:21.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.072+0000 7f9e9e257740 1 -- 172.21.15.2:0/3768652755 shutdown_connections 2024-09-10T08:47:21.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.072+0000 7f9e9e257740 1 --2- 172.21.15.2:0/3768652755 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc152e0d30 0x55fc152ca9e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:21.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.072+0000 7f9e9e257740 1 --2- 172.21.15.2:0/3768652755 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55fc15289480 0x55fc152acb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:21.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.072+0000 7f9e9e257740 1 --2- 172.21.15.2:0/3768652755 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fc15287cf0 0x55fc152b0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:21.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.072+0000 7f9e9e257740 1 -- 172.21.15.2:0/3768652755 >> 172.21.15.2:0/3768652755 conn(0x55fc152854b0 msgr2=0x55fc1527dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:21.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.072+0000 7f9e9e257740 1 -- 172.21.15.2:0/3768652755 shutdown_connections 2024-09-10T08:47:21.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.072+0000 7f9e9e257740 1 -- 172.21.15.2:0/3768652755 wait complete. 2024-09-10T08:47:21.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.072+0000 7f9e9e257740 1 -- start start 2024-09-10T08:47:21.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.073+0000 7f9e9e257740 1 Processor -- start 2024-09-10T08:47:21.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.073+0000 7f9e9e257740 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55fc15287cf0 0x55fc152a7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:21.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.073+0000 7f9e9e257740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fc15289480 0x55fc152cca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:21.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.073+0000 7f9e9e257740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc152e0d30 0x55fc1534dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:21.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.073+0000 7f9e9e257740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x55fc152ab340 con 0x55fc152e0d30 2024-09-10T08:47:21.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.073+0000 7f9e9e257740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55fc152aa370 con 0x55fc15289480 2024-09-10T08:47:21.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.073+0000 7f9e9e257740 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x55fc152ab990 con 0x55fc15287cf0 2024-09-10T08:47:21.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.073+0000 7f9e9e257740 10 client.0 _ll_register_callbacks cb 0x7f9e8c001d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:47:21.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.074+0000 7f9e99200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc152e0d30 0x55fc1534dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:21.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.074+0000 7f9e99200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc152e0d30 0x55fc1534dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51310/0 (socket says 172.21.15.2:51310) 2024-09-10T08:47:21.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.074+0000 7f9e99200640 1 -- 172.21.15.2:0/400872909 learned_addr learned my addr 172.21.15.2:0/400872909 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:21.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.074+0000 7f9e8be00640 1 --2- 172.21.15.2:0/400872909 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fc15289480 0x55fc152cca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:21.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.074+0000 7f9e93e00640 1 --2- 172.21.15.2:0/400872909 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55fc15287cf0 0x55fc152a7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:21.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.074+0000 7f9e99200640 1 -- 172.21.15.2:0/400872909 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55fc15287cf0 msgr2=0x55fc152a7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:21.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.074+0000 7f9e99200640 1 --2- 172.21.15.2:0/400872909 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55fc15287cf0 0x55fc152a7680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:21.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.074+0000 7f9e99200640 1 -- 172.21.15.2:0/400872909 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fc15289480 msgr2=0x55fc152cca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:21.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.074+0000 7f9e99200640 1 --2- 172.21.15.2:0/400872909 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fc15289480 0x55fc152cca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:21.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.074+0000 7f9e99200640 1 -- 172.21.15.2:0/400872909 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc15285c00 con 0x55fc152e0d30 2024-09-10T08:47:21.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.074+0000 7f9e8be00640 1 --2- 172.21.15.2:0/400872909 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fc15289480 0x55fc152cca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:47:21.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.074+0000 7f9e99200640 1 --2- 172.21.15.2:0/400872909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc152e0d30 0x55fc1534dfa0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c005c00 tx=0x7f9e8c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ad47a7f3c1b6700 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:21.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.074+0000 7f9e81600640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T08:47:21.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.075+0000 7f9e81600640 1 -- 172.21.15.2:0/400872909 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8c034020 con 0x55fc152e0d30 2024-09-10T08:47:21.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.075+0000 7f9e9e257740 1 -- 172.21.15.2:0/400872909 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e8c018070 con 0x55fc152e0d30 2024-09-10T08:47:21.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.075+0000 7f9e81600640 1 -- 172.21.15.2:0/400872909 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f9e8c01b830 con 0x55fc152e0d30 2024-09-10T08:47:21.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.075+0000 7f9e81600640 1 -- 172.21.15.2:0/400872909 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f9e8c03b050 con 0x55fc152e0d30 2024-09-10T08:47:21.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.075+0000 7f9e9e257740 10 client.4638 fetch_fsmap learned FSMap version 9 2024-09-10T08:47:21.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.075+0000 7f9e9e257740 1 -- 172.21.15.2:0/400872909 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55fc152ca270 con 0x55fc152e0d30 2024-09-10T08:47:21.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.075+0000 7f9e81600640 1 -- 172.21.15.2:0/400872909 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e8c018070 con 0x55fc152e0d30 2024-09-10T08:47:21.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.075+0000 7f9e81600640 1 -- 172.21.15.2:0/400872909 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 9) ==== 3510+0+0 (secure 0 0 0) 0x7f9e8c03e020 con 0x55fc152e0d30 2024-09-10T08:47:21.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.075+0000 7f9e9e257740 10 client.4638 fetch_fsmap finished waiting for FSMap version 9 2024-09-10T08:47:21.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.075+0000 7f9e9e257740 10 client.4638 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-10T08:47:21.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.075+0000 7f9e9e257740 20 client.4638 populate_metadata read hostname 'smithi002' 2024-09-10T08:47:21.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.075+0000 7f9e9e257740 1 --2- 172.21.15.2:0/400872909 >> [v2:172.21.15.155:6834/2996773231,v1:172.21.15.155:6836/2996773231] conn(0x55fc152ad090 0x55fc152cfb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:21.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.075+0000 7f9e9e257740 4 client.4638 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T08:47:21.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.075+0000 7f9e9e257740 1 -- 172.21.15.2:0/400872909 --> [v2:172.21.15.155:6834/2996773231,v1:172.21.15.155:6836/2996773231] -- command(tid 0: {"prefix": "status"}) -- 0x55fc151f2e90 con 0x55fc152ad090 2024-09-10T08:47:21.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.076+0000 7f9e93e00640 1 --2- 172.21.15.2:0/400872909 >> [v2:172.21.15.155:6834/2996773231,v1:172.21.15.155:6836/2996773231] conn(0x55fc152ad090 0x55fc152cfb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:21.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.076+0000 7f9e93e00640 1 --2- 172.21.15.2:0/400872909 >> [v2:172.21.15.155:6834/2996773231,v1:172.21.15.155:6836/2996773231] conn(0x55fc152ad090 0x55fc152cfb90 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45d28488e8ad772c server_cookie=26af628fee22d89b in_seq=0 out_seq=0 2024-09-10T08:47:21.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.076+0000 7f9e81600640 10 client.4638 ms_handle_connect on v2:172.21.15.155:6834/2996773231 2024-09-10T08:47:21.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.076+0000 7f9e81600640 1 -- 172.21.15.2:0/400872909 <== mds.0 v2:172.21.15.155:6834/2996773231 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x55fc151f2e90 con 0x55fc152ad090 2024-09-10T08:47:21.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.077+0000 7f9e81600640 10 client.4638 handle_command_reply: tid=0 2024-09-10T08:47:21.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.077+0000 7f9e9e257740 1 client.4638 shutdown 2024-09-10T08:47:21.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.077+0000 7f9e9e257740 1 -- 172.21.15.2:0/400872909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc152e0d30 msgr2=0x55fc1534dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:21.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.077+0000 7f9e9e257740 1 --2- 172.21.15.2:0/400872909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc152e0d30 0x55fc1534dfa0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c005c00 tx=0x7f9e8c012000 comp rx=0 tx=0).stop 2024-09-10T08:47:21.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.077+0000 7f9e9e257740 1 -- 172.21.15.2:0/400872909 shutdown_connections 2024-09-10T08:47:21.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.077+0000 7f9e9e257740 1 --2- 172.21.15.2:0/400872909 >> [v2:172.21.15.155:6834/2996773231,v1:172.21.15.155:6836/2996773231] conn(0x55fc152ad090 0x55fc152cfb90 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:21.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.077+0000 7f9e9e257740 1 --2- 172.21.15.2:0/400872909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x55fc152e0d30 0x55fc1534dfa0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:21.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.077+0000 7f9e9e257740 1 --2- 172.21.15.2:0/400872909 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fc15289480 0x55fc152cca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:21.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.077+0000 7f9e9e257740 1 --2- 172.21.15.2:0/400872909 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55fc15287cf0 0x55fc152a7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:21.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.077+0000 7f9e81600640 0 client.4638 ms_handle_reset on v2:172.21.15.155:6834/2996773231 2024-09-10T08:47:21.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.077+0000 7f9e9e257740 1 -- 172.21.15.2:0/400872909 >> 172.21.15.2:0/400872909 conn(0x55fc152854b0 msgr2=0x55fc152ca9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:21.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.077+0000 7f9e9e257740 1 -- 172.21.15.2:0/400872909 shutdown_connections 2024-09-10T08:47:21.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.077+0000 7f9e9e257740 1 -- 172.21.15.2:0/400872909 wait complete. 2024-09-10T08:47:21.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.077+0000 7f9e9e257740 20 client.4638 trim_cache size 0 max 16384 2024-09-10T08:47:21.083 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T08:47:21.083 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "f20a15a7-d363-4d44-98cb-4f4f466b52b8", 2024-09-10T08:47:21.083 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 0, 2024-09-10T08:47:21.083 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 4288, 2024-09-10T08:47:21.083 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2024-09-10T08:47:21.083 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2024-09-10T08:47:21.083 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2024-09-10T08:47:21.084 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 29.312578812000002, 2024-09-10T08:47:21.084 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 9, 2024-09-10T08:47:21.084 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 24, 2024-09-10T08:47:21.084 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 24, 2024-09-10T08:47:21.084 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 35.355301378999997 2024-09-10T08:47:21.084 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T08:47:21.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.078+0000 7f9e9b200640 1 -- 172.21.15.2:0/3090951079 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f9e7006be30 msgr2=0x7f9e7006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:21.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.078+0000 7f9e9b200640 1 --2- 172.21.15.2:0/3090951079 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f9e7006be30 0x7f9e7006e2f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c034000 tx=0x7f9e7c02c000 comp rx=0 tx=0).stop 2024-09-10T08:47:21.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.078+0000 7f9e9b200640 1 -- 172.21.15.2:0/3090951079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e94073340 msgr2=0x7f9e9415c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:21.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.078+0000 7f9e9b200640 1 --2- 172.21.15.2:0/3090951079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e94073340 0x7f9e9415c460 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9e8400e7e0 tx=0x7f9e8400eca0 comp rx=0 tx=0).stop 2024-09-10T08:47:21.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.078+0000 7f9e9b200640 1 -- 172.21.15.2:0/3090951079 shutdown_connections 2024-09-10T08:47:21.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.078+0000 7f9e9b200640 1 --2- 172.21.15.2:0/3090951079 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e94161b20 0x7f9e941f4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:21.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.078+0000 7f9e9b200640 1 --2- 172.21.15.2:0/3090951079 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f9e7006be30 0x7f9e7006e2f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:21.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.078+0000 7f9e9b200640 1 --2- 172.21.15.2:0/3090951079 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e940b44f0 0x7f9e941f3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:21.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.078+0000 7f9e9b200640 1 --2- 172.21.15.2:0/3090951079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e94073340 0x7f9e9415c460 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:21.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.078+0000 7f9e9b200640 1 -- 172.21.15.2:0/3090951079 >> 172.21.15.2:0/3090951079 conn(0x7f9e94072820 msgr2=0x7f9e940b0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:21.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.078+0000 7f9e9b200640 1 -- 172.21.15.2:0/3090951079 shutdown_connections 2024-09-10T08:47:21.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:21.078+0000 7f9e9b200640 1 -- 172.21.15.2:0/3090951079 wait complete. 2024-09-10T08:47:21.095 INFO:teuthology.run_tasks:Running task sequential... 2024-09-10T08:47:21.105 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-10T08:47:21.105 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-10T08:47:21.106 INFO:teuthology.task.print:Enabling mgr modules 2024-09-10T08:47:21.106 INFO:teuthology.run_tasks:Running task kclient... 2024-09-10T08:47:21.149 INFO:tasks.kclient:Mounting kernel clients... 2024-09-10T08:47:21.150 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-09-10T08:47:21.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:47:21.150 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2024-09-10T08:47:21.185 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-10T08:47:21.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:47:21.186 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-10T08:47:21.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:47:21.283 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link delete ceph-brx 2024-09-10T08:47:21.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:47:21.551 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2024-09-10T08:47:21.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:47:21.587 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link delete ceph-brx 2024-09-10T08:47:21.686 INFO:teuthology.orchestra.run.smithi002.stderr:Cannot find device "ceph-brx" 2024-09-10T08:47:21.689 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T08:47:21.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:47:21.689 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2024-09-10T08:47:21.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:47:21.730 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link delete ceph-brx 2024-09-10T08:47:21.834 INFO:teuthology.orchestra.run.smithi155.stderr:Cannot find device "ceph-brx" 2024-09-10T08:47:21.836 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T08:47:21.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:47:21.837 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2024-09-10T08:47:21.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:47:21.873 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link delete ceph-brx 2024-09-10T08:47:21.971 INFO:teuthology.orchestra.run.smithi155.stderr:Cannot find device "ceph-brx" 2024-09-10T08:47:21.973 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T08:47:21.974 INFO:tasks.kclient:client.0 config is {'snapdirname': '.customsnapkernel', 'syntax': 'v2'} 2024-09-10T08:47:21.974 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-10T08:47:21.974 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T08:47:21.974 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T08:47:22.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.131+0000 7ff3fd800640 1 Processor -- start 2024-09-10T08:47:22.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.131+0000 7ff3fd800640 1 -- start start 2024-09-10T08:47:22.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.132+0000 7ff3fd800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3f8145d20 0x7ff3f815c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:22.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.132+0000 7ff3fd800640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff3f80cd460 0x7ff3f8160980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:22.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.132+0000 7ff3fd800640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3f806e4d0 con 0x7ff3f806df80 2024-09-10T08:47:22.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.132+0000 7ff3fd800640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7ff3f8146100 con 0x7ff3f80cd460 2024-09-10T08:47:22.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.132+0000 7ff3fd800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff3f8160ec0 con 0x7ff3f8145d20 2024-09-10T08:47:22.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.133+0000 7ff3f6a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3f8145d20 0x7ff3f815c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:22.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.133+0000 7ff3f7400640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff3f80cd460 0x7ff3f8160980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:22.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.133+0000 7ff3f6a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3f8145d20 0x7ff3f815c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.2:40756/0 (socket says 172.21.15.2:40756) 2024-09-10T08:47:22.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.133+0000 7ff3f6a00640 1 -- 172.21.15.2:0/3241552088 learned_addr learned my addr 172.21.15.2:0/3241552088 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:22.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.133+0000 7ff3f6000640 1 --1- 172.21.15.2:0/3241552088 >> v1:172.21.15.155:6789/0 conn(0x7ff3f806df80 0x7ff3f80ccd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.2:44264/0 (socket says 172.21.15.2:44264) 2024-09-10T08:47:22.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.133+0000 7ff3f6a00640 1 -- 172.21.15.2:0/3241552088 >> v2:172.21.15.155:3300/0 conn(0x7ff3f80cd460 msgr2=0x7ff3f8160980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:22.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.133+0000 7ff3f6a00640 1 --2- 172.21.15.2:0/3241552088 >> v2:172.21.15.155:3300/0 conn(0x7ff3f80cd460 0x7ff3f8160980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:22.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.133+0000 7ff3f6a00640 1 -- 172.21.15.2:0/3241552088 >> v1:172.21.15.155:6789/0 conn(0x7ff3f806df80 legacy=0x7ff3f80ccd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:22.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.133+0000 7ff3f6a00640 1 -- 172.21.15.2:0/3241552088 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3f806e7b0 con 0x7ff3f8145d20 2024-09-10T08:47:22.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.134+0000 7ff3f6a00640 1 --2- 172.21.15.2:0/3241552088 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3f8145d20 0x7ff3f815c9e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8009870 tx=0x7ff3e802a140 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89c056bdbdfe641e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:22.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.135+0000 7ff3f5600640 1 -- 172.21.15.2:0/3241552088 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e8037070 con 0x7ff3f8145d20 2024-09-10T08:47:22.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.135+0000 7ff3f5600640 1 -- 172.21.15.2:0/3241552088 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3e8032440 con 0x7ff3f8145d20 2024-09-10T08:47:22.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.135+0000 7ff3f5600640 1 -- 172.21.15.2:0/3241552088 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e8032810 con 0x7ff3f8145d20 2024-09-10T08:47:22.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.135+0000 7ff3fd800640 1 -- 172.21.15.2:0/3241552088 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3f8145d20 msgr2=0x7ff3f815c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:22.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.135+0000 7ff3fd800640 1 --2- 172.21.15.2:0/3241552088 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3f8145d20 0x7ff3f815c9e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8009870 tx=0x7ff3e802a140 comp rx=0 tx=0).stop 2024-09-10T08:47:22.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.135+0000 7ff3fd800640 1 -- 172.21.15.2:0/3241552088 shutdown_connections 2024-09-10T08:47:22.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.135+0000 7ff3fd800640 1 --2- 172.21.15.2:0/3241552088 >> v2:172.21.15.155:3300/0 conn(0x7ff3f80cd460 0x7ff3f8160980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:22.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.135+0000 7ff3fd800640 1 --2- 172.21.15.2:0/3241552088 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3f8145d20 0x7ff3f815c9e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:22.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.135+0000 7ff3fd800640 1 -- 172.21.15.2:0/3241552088 >> 172.21.15.2:0/3241552088 conn(0x7ff3f806bc10 msgr2=0x7ff3f806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:22.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.135+0000 7ff3fd800640 1 -- 172.21.15.2:0/3241552088 shutdown_connections 2024-09-10T08:47:22.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.135+0000 7ff3fd800640 1 -- 172.21.15.2:0/3241552088 wait complete. 2024-09-10T08:47:22.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.137+0000 7ff3fd800640 1 Processor -- start 2024-09-10T08:47:22.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.137+0000 7ff3fd800640 1 -- start start 2024-09-10T08:47:22.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.138+0000 7ff3fd800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3f806df80 0x7ff3f815ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:22.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.138+0000 7ff3fd800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3f80cd460 0x7ff3f813a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:22.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.138+0000 7ff3fd800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3f8145d20 0x7ff3f813f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:22.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.138+0000 7ff3fd800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f806ed70 con 0x7ff3f80cd460 2024-09-10T08:47:22.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.138+0000 7ff3fd800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f80ce6b0 con 0x7ff3f8145d20 2024-09-10T08:47:22.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.138+0000 7ff3fd800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff3f80ceb40 con 0x7ff3f806df80 2024-09-10T08:47:22.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.138+0000 7ff3f6000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3f80cd460 0x7ff3f813a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:22.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.139+0000 7ff3f6000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3f80cd460 0x7ff3f813a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51318/0 (socket says 172.21.15.2:51318) 2024-09-10T08:47:22.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.139+0000 7ff3f6000640 1 -- 172.21.15.2:0/3861087203 learned_addr learned my addr 172.21.15.2:0/3861087203 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:22.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.139+0000 7ff3f6a00640 1 --2- 172.21.15.2:0/3861087203 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3f806df80 0x7ff3f815ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:22.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.139+0000 7ff3f7400640 1 --2- 172.21.15.2:0/3861087203 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3f8145d20 0x7ff3f813f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:22.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.139+0000 7ff3f6000640 1 -- 172.21.15.2:0/3861087203 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3f806df80 msgr2=0x7ff3f815ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:22.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.139+0000 7ff3f6000640 1 --2- 172.21.15.2:0/3861087203 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3f806df80 0x7ff3f815ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:22.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.139+0000 7ff3f6000640 1 -- 172.21.15.2:0/3861087203 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3f8145d20 msgr2=0x7ff3f813f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:22.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.139+0000 7ff3f6000640 1 --2- 172.21.15.2:0/3861087203 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3f8145d20 0x7ff3f813f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:22.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.139+0000 7ff3f6000640 1 -- 172.21.15.2:0/3861087203 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3f80adb10 con 0x7ff3f80cd460 2024-09-10T08:47:22.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.139+0000 7ff3f6000640 1 --2- 172.21.15.2:0/3861087203 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3f80cd460 0x7ff3f813a5b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff3e400c470 tx=0x7ff3e4001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:22.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.140+0000 7ff3eea00640 1 -- 172.21.15.2:0/3861087203 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e40074e0 con 0x7ff3f80cd460 2024-09-10T08:47:22.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.140+0000 7ff3eea00640 1 -- 172.21.15.2:0/3861087203 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3e4007680 con 0x7ff3f80cd460 2024-09-10T08:47:22.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.140+0000 7ff3fd800640 1 -- 172.21.15.2:0/3861087203 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3f80addf0 con 0x7ff3f80cd460 2024-09-10T08:47:22.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.140+0000 7ff3eea00640 1 -- 172.21.15.2:0/3861087203 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e4004a20 con 0x7ff3f80cd460 2024-09-10T08:47:22.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.140+0000 7ff3fd800640 1 -- 172.21.15.2:0/3861087203 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3f813aaf0 con 0x7ff3f80cd460 2024-09-10T08:47:22.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.141+0000 7ff3fd800640 1 -- 172.21.15.2:0/3861087203 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3f8160980 con 0x7ff3f80cd460 2024-09-10T08:47:22.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.142+0000 7ff3eea00640 1 -- 172.21.15.2:0/3861087203 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff3e401a020 con 0x7ff3f80cd460 2024-09-10T08:47:22.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.143+0000 7ff3eea00640 1 --2- 172.21.15.2:0/3861087203 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7ff3d806be30 0x7ff3d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:22.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.143+0000 7ff3eea00640 1 -- 172.21.15.2:0/3861087203 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff3e408a900 con 0x7ff3f80cd460 2024-09-10T08:47:22.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.144+0000 7ff3f6a00640 1 --2- 172.21.15.2:0/3861087203 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7ff3d806be30 0x7ff3d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:22.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.144+0000 7ff3f6a00640 1 --2- 172.21.15.2:0/3861087203 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7ff3d806be30 0x7ff3d806e2f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8034000 tx=0x7ff3e802e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:22.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.148+0000 7ff3eea00640 1 -- 172.21.15.2:0/3861087203 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff3e4058880 con 0x7ff3f80cd460 2024-09-10T08:47:22.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.367+0000 7ff3fd800640 1 -- 172.21.15.2:0/3861087203 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ff3f81451f0 con 0x7ff3f80cd460 2024-09-10T08:47:22.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.367+0000 7ff3eea00640 1 -- 172.21.15.2:0/3861087203 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7ff3e405cb80 con 0x7ff3f80cd460 2024-09-10T08:47:22.369 INFO:teuthology.orchestra.run.smithi002.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-10T08:47:22.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.369+0000 7ff3fd800640 1 -- 172.21.15.2:0/3861087203 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7ff3d806be30 msgr2=0x7ff3d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:22.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.369+0000 7ff3fd800640 1 --2- 172.21.15.2:0/3861087203 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7ff3d806be30 0x7ff3d806e2f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8034000 tx=0x7ff3e802e000 comp rx=0 tx=0).stop 2024-09-10T08:47:22.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.369+0000 7ff3fd800640 1 -- 172.21.15.2:0/3861087203 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3f80cd460 msgr2=0x7ff3f813a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:22.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.369+0000 7ff3fd800640 1 --2- 172.21.15.2:0/3861087203 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3f80cd460 0x7ff3f813a5b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff3e400c470 tx=0x7ff3e4001e70 comp rx=0 tx=0).stop 2024-09-10T08:47:22.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.369+0000 7ff3fd800640 1 -- 172.21.15.2:0/3861087203 shutdown_connections 2024-09-10T08:47:22.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.369+0000 7ff3fd800640 1 --2- 172.21.15.2:0/3861087203 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3f8145d20 0x7ff3f813f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:22.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.369+0000 7ff3fd800640 1 --2- 172.21.15.2:0/3861087203 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3f80cd460 0x7ff3f813a5b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:22.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.369+0000 7ff3fd800640 1 --2- 172.21.15.2:0/3861087203 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7ff3d806be30 0x7ff3d806e2f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:22.371 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.369+0000 7ff3fd800640 1 --2- 172.21.15.2:0/3861087203 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3f806df80 0x7ff3f815ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:22.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.369+0000 7ff3fd800640 1 -- 172.21.15.2:0/3861087203 >> 172.21.15.2:0/3861087203 conn(0x7ff3f806bc10 msgr2=0x7ff3f80b03c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:22.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.369+0000 7ff3fd800640 1 -- 172.21.15.2:0/3861087203 shutdown_connections 2024-09-10T08:47:22.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22.370+0000 7ff3fd800640 1 -- 172.21.15.2:0/3861087203 wait complete. 2024-09-10T08:47:22.386 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T08:47:22.386 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T08:47:22.386 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi002.front.sepia.ceph.com 2024-09-10T08:47:22.386 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T08:47:22.387 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T08:47:22.387 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T08:47:22.387 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T08:47:22.387 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T08:47:22.387 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T08:47:22.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:47:22.387 DEBUG:teuthology.orchestra.run.smithi002:> ip addr 2024-09-10T08:47:22.423 INFO:teuthology.orchestra.run.smithi002.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T08:47:22.423 INFO:teuthology.orchestra.run.smithi002.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T08:47:22.423 INFO:teuthology.orchestra.run.smithi002.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T08:47:22.423 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:47:22.423 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 ::1/128 scope host 2024-09-10T08:47:22.423 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:47:22.423 INFO:teuthology.orchestra.run.smithi002.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:47:22.423 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:02 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:47:22.423 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f0 2024-09-10T08:47:22.424 INFO:teuthology.orchestra.run.smithi002.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:47:22.424 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:03 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:47:22.424 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f1 2024-09-10T08:47:22.424 INFO:teuthology.orchestra.run.smithi002.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T08:47:22.424 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:20 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:47:22.424 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f0 2024-09-10T08:47:22.424 INFO:teuthology.orchestra.run.smithi002.stdout: inet 172.21.15.2/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-10T08:47:22.424 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft 42664sec preferred_lft 42664sec 2024-09-10T08:47:22.424 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::ec4:7aff:febd:1920/64 scope link 2024-09-10T08:47:22.424 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:47:22.424 INFO:teuthology.orchestra.run.smithi002.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:47:22.425 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:21 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:47:22.425 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f1 2024-09-10T08:47:22.425 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-10T08:47:22.425 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T08:47:22.425 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-09-10T08:47:22.425 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link add name ceph-brx type bridge 2024-09-10T08:47:22.425 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip addr flush dev ceph-brx 2024-09-10T08:47:22.425 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set ceph-brx up 2024-09-10T08:47:22.425 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-10T08:47:22.425 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-09-10T08:47:22.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:47:22.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:47:22.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:47:22.647 DEBUG:teuthology.orchestra.run.smithi002:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T08:47:22.700 INFO:teuthology.orchestra.run.smithi002.stdout:1 2024-09-10T08:47:22.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:47:22.703 DEBUG:teuthology.orchestra.run.smithi002:> route 2024-09-10T08:47:22.740 INFO:teuthology.orchestra.run.smithi002.stdout:Kernel IP routing table 2024-09-10T08:47:22.740 INFO:teuthology.orchestra.run.smithi002.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T08:47:22.740 INFO:teuthology.orchestra.run.smithi002.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-10T08:47:22.740 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-10T08:47:22.740 INFO:teuthology.orchestra.run.smithi002.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T08:47:22.740 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T08:47:22.740 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-09-10T08:47:22.740 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-10T08:47:22.741 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-10T08:47:22.741 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-10T08:47:22.741 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-09-10T08:47:22.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:47:22.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:47:22.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:47:22.938 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2024-09-10T08:47:22.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:47:22.973 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list-id 2024-09-10T08:47:23.048 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T08:47:23.048 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-09-10T08:47:23.049 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T08:47:23.049 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-10T08:47:23.049 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-09-10T08:47:23.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:47:23.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:47:23.226 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-10T08:47:23.226 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T08:47:23.226 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-09-10T08:47:23.226 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-10T08:47:23.226 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-10T08:47:23.227 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-10T08:47:23.227 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-10T08:47:23.227 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-10T08:47:23.227 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-09-10T08:47:23.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:47:23.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:47:23.447 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T08:47:23.447 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-09-10T08:47:23.447 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set brx.0 up 2024-09-10T08:47:23.447 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set dev brx.0 master ceph-brx 2024-09-10T08:47:23.447 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-09-10T08:47:23.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:47:23.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:47:23.615 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T08:47:23.615 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T08:47:23.650 INFO:teuthology.orchestra.run.smithi002.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T08:47:23.650 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T08:47:23.650 DEBUG:teuthology.orchestra.run.smithi002:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T08:47:23.726 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-10T08:47:23.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:47:23.726 DEBUG:teuthology.orchestra.run.smithi002:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,snapdirname=.customsnapkernel,nofallback 2024-09-10T08:47:23.856 INFO:teuthology.orchestra.run.smithi002.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,snapdirname=.customsnapkernel,nofallback 2024-09-10T08:47:23.857 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes,snapdirname=.customsnapkernel". 2024-09-10T08:47:24.482 INFO:teuthology.orchestra.run.smithi002.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,snapdirname=.customsnapkernel,nofallback 2024-09-10T08:47:24.482 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes,snapdirname=.customsnapkernel". 2024-09-10T08:47:24.482 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: resolved to: "172.21.15.2:3300,172.21.15.155:3300,172.21.15.155:3301" 2024-09-10T08:47:24.483 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: trying mount with new device syntax: 0@f20a15a7-d363-4d44-98cb-4f4f466b52b8.cephfs=/ 2024-09-10T08:47:24.483 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes,snapdirname=.customsnapkernel,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.2:3300/172.21.15.155:3300/172.21.15.155:3301" will pass to kernel 2024-09-10T08:47:24.485 INFO:teuthology.orchestra.run.smithi002.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-10T08:47:24.485 INFO:teuthology.orchestra.run.smithi002.stdout: You just mounted a file system that supports labels which does not 2024-09-10T08:47:24.485 INFO:teuthology.orchestra.run.smithi002.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T08:47:24.486 INFO:teuthology.orchestra.run.smithi002.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T08:47:24.486 INFO:teuthology.orchestra.run.smithi002.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T08:47:24.488 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T08:47:24.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:47:24.489 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T08:47:24.546 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T08:47:24.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:24 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:47:24.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:47:24.639 INFO:teuthology.orchestra.run.smithi002.stdout:client4505 2024-09-10T08:47:24.639 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T08:47:24.639 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:47:24.675 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T08:47:24.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:24 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:47:24.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:47:24.805 INFO:teuthology.orchestra.run.smithi002.stdout:client4505 2024-09-10T08:47:24.805 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T08:47:24.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:24 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:47:24.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:47:24.895 INFO:teuthology.orchestra.run.smithi002.stdout:client4505 2024-09-10T08:47:24.895 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/f20a15a7-d363-4d44-98cb-4f4f466b52b8.client4505/status') 2024-09-10T08:47:24.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:47:24.995 INFO:teuthology.orchestra.run.smithi002.stdout:instance: client.4505 (3)172.21.15.2:0/3853842372 2024-09-10T08:47:24.995 INFO:teuthology.orchestra.run.smithi002.stdout:blocklisted: false 2024-09-10T08:47:24.995 INFO:teuthology.orchestra.run.smithi002.stderr:0+1 records in 2024-09-10T08:47:24.995 INFO:teuthology.orchestra.run.smithi002.stderr:0+1 records out 2024-09-10T08:47:24.995 INFO:teuthology.orchestra.run.smithi002.stderr:69 bytes copied, 5.5782e-05 s, 1.2 MB/s 2024-09-10T08:47:24.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:47:25.005 INFO:tasks.kclient:client.2 config is {'snapdirname': '.customsnapkernel', 'syntax': 'v2'} 2024-09-10T08:47:25.006 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-10T08:47:25.006 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-10T08:47:25.006 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T08:47:25.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.161+0000 7ff267600640 1 Processor -- start 2024-09-10T08:47:25.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.161+0000 7ff267600640 1 -- start start 2024-09-10T08:47:25.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.163+0000 7ff267600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2600cfa40 0x7ff2600d1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:25.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.163+0000 7ff267600640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff2600cfe20 0x7ff26006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:25.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.163+0000 7ff267600640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2600d11f0 con 0x7ff26006c150 2024-09-10T08:47:25.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.163+0000 7ff267600640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7ff2600d0fd0 con 0x7ff2600cfe20 2024-09-10T08:47:25.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.163+0000 7ff267600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff26006c920 con 0x7ff2600cfa40 2024-09-10T08:47:25.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.163+0000 7ff25fe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff2600cfe20 0x7ff26006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:25.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.163+0000 7ff25fe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff2600cfe20 0x7ff26006bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51330/0 (socket says 172.21.15.2:51330) 2024-09-10T08:47:25.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.163+0000 7ff25fe00640 1 -- 172.21.15.2:0/420442265 learned_addr learned my addr 172.21.15.2:0/420442265 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:25.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.163+0000 7ff264c00640 1 --2- 172.21.15.2:0/420442265 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2600cfa40 0x7ff2600d1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:25.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.163+0000 7ff25fe00640 1 -- 172.21.15.2:0/420442265 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2600cfa40 msgr2=0x7ff2600d1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:25.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.163+0000 7ff25fe00640 1 --2- 172.21.15.2:0/420442265 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2600cfa40 0x7ff2600d1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:25.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.163+0000 7ff25fe00640 1 -- 172.21.15.2:0/420442265 >> v1:172.21.15.155:6789/0 conn(0x7ff26006c150 legacy=0x7ff2600cdcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:25.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.163+0000 7ff25fe00640 1 -- 172.21.15.2:0/420442265 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2600d14b0 con 0x7ff2600cfe20 2024-09-10T08:47:25.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.164+0000 7ff25fe00640 1 --2- 172.21.15.2:0/420442265 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2600cfe20 0x7ff26006bc10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff24c009870 tx=0x7ff24c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=277178c9f79cf426 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:25.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.165+0000 7ff25f400640 1 -- 172.21.15.2:0/420442265 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff24c037070 con 0x7ff2600cfe20 2024-09-10T08:47:25.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.165+0000 7ff25f400640 1 -- 172.21.15.2:0/420442265 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff24c032440 con 0x7ff2600cfe20 2024-09-10T08:47:25.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.165+0000 7ff25f400640 1 -- 172.21.15.2:0/420442265 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff24c032810 con 0x7ff2600cfe20 2024-09-10T08:47:25.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.165+0000 7ff267600640 1 -- 172.21.15.2:0/420442265 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2600cfe20 msgr2=0x7ff26006bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:25.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.165+0000 7ff267600640 1 --2- 172.21.15.2:0/420442265 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2600cfe20 0x7ff26006bc10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff24c009870 tx=0x7ff24c02a270 comp rx=0 tx=0).stop 2024-09-10T08:47:25.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.165+0000 7ff267600640 1 -- 172.21.15.2:0/420442265 shutdown_connections 2024-09-10T08:47:25.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.165+0000 7ff267600640 1 --2- 172.21.15.2:0/420442265 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2600cfe20 0x7ff26006bc10 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:25.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.165+0000 7ff267600640 1 --2- 172.21.15.2:0/420442265 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2600cfa40 0x7ff2600d1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:25.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.165+0000 7ff267600640 1 -- 172.21.15.2:0/420442265 >> 172.21.15.2:0/420442265 conn(0x7ff2600b6a00 msgr2=0x7ff26009aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:25.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.165+0000 7ff267600640 1 -- 172.21.15.2:0/420442265 shutdown_connections 2024-09-10T08:47:25.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.165+0000 7ff267600640 1 -- 172.21.15.2:0/420442265 wait complete. 2024-09-10T08:47:25.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.167+0000 7ff267600640 1 Processor -- start 2024-09-10T08:47:25.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.167+0000 7ff267600640 1 -- start start 2024-09-10T08:47:25.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.168+0000 7ff267600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff26006c150 0x7ff260150ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:25.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.168+0000 7ff267600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2600cfa40 0x7ff2601541f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:25.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.168+0000 7ff267600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2600cfe20 0x7ff260156250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:25.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.168+0000 7ff267600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff2600d0220 con 0x7ff2600cfa40 2024-09-10T08:47:25.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.168+0000 7ff267600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff26006c5e0 con 0x7ff26006c150 2024-09-10T08:47:25.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.168+0000 7ff267600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff2600d03a0 con 0x7ff2600cfe20 2024-09-10T08:47:25.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.168+0000 7ff25fe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2600cfa40 0x7ff2601541f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:25.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.168+0000 7ff25fe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2600cfa40 0x7ff2601541f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51332/0 (socket says 172.21.15.2:51332) 2024-09-10T08:47:25.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.168+0000 7ff25fe00640 1 -- 172.21.15.2:0/1237170941 learned_addr learned my addr 172.21.15.2:0/1237170941 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:25.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.168+0000 7ff264c00640 1 --2- 172.21.15.2:0/1237170941 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff26006c150 0x7ff260150ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:25.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.168+0000 7ff265600640 1 --2- 172.21.15.2:0/1237170941 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2600cfe20 0x7ff260156250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:25.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.169+0000 7ff25fe00640 1 -- 172.21.15.2:0/1237170941 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2600cfe20 msgr2=0x7ff260156250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:25.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.169+0000 7ff25fe00640 1 --2- 172.21.15.2:0/1237170941 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2600cfe20 0x7ff260156250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:25.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.169+0000 7ff25fe00640 1 -- 172.21.15.2:0/1237170941 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff26006c150 msgr2=0x7ff260150ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:25.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.169+0000 7ff25fe00640 1 --2- 172.21.15.2:0/1237170941 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff26006c150 0x7ff260150ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:25.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.169+0000 7ff25fe00640 1 -- 172.21.15.2:0/1237170941 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2600b1b90 con 0x7ff2600cfa40 2024-09-10T08:47:25.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.169+0000 7ff265600640 1 --2- 172.21.15.2:0/1237170941 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2600cfe20 0x7ff260156250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:47:25.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.169+0000 7ff25fe00640 1 --2- 172.21.15.2:0/1237170941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2600cfa40 0x7ff2601541f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff24c02a2b0 tx=0x7ff24c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:25.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.169+0000 7ff25cc00640 1 -- 172.21.15.2:0/1237170941 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff24c041030 con 0x7ff2600cfa40 2024-09-10T08:47:25.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.169+0000 7ff25cc00640 1 -- 172.21.15.2:0/1237170941 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff24c030440 con 0x7ff2600cfa40 2024-09-10T08:47:25.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.169+0000 7ff25cc00640 1 -- 172.21.15.2:0/1237170941 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff24c037040 con 0x7ff2600cfa40 2024-09-10T08:47:25.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.169+0000 7ff267600640 1 -- 172.21.15.2:0/1237170941 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2600b1e70 con 0x7ff2600cfa40 2024-09-10T08:47:25.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.169+0000 7ff267600640 1 -- 172.21.15.2:0/1237170941 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2601539f0 con 0x7ff2600cfa40 2024-09-10T08:47:25.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.170+0000 7ff267600640 1 -- 172.21.15.2:0/1237170941 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff26006bc10 con 0x7ff2600cfa40 2024-09-10T08:47:25.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.171+0000 7ff25cc00640 1 -- 172.21.15.2:0/1237170941 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff24c044070 con 0x7ff2600cfa40 2024-09-10T08:47:25.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.172+0000 7ff25cc00640 1 --2- 172.21.15.2:0/1237170941 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7ff24006be60 0x7ff24006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:25.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.172+0000 7ff25cc00640 1 -- 172.21.15.2:0/1237170941 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff24c0ab7f0 con 0x7ff2600cfa40 2024-09-10T08:47:25.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.173+0000 7ff264c00640 1 --2- 172.21.15.2:0/1237170941 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7ff24006be60 0x7ff24006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:25.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.173+0000 7ff264c00640 1 --2- 172.21.15.2:0/1237170941 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7ff24006be60 0x7ff24006e320 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff254009b40 tx=0x7ff254009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:25.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.176+0000 7ff25cc00640 1 -- 172.21.15.2:0/1237170941 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff24c079dc0 con 0x7ff2600cfa40 2024-09-10T08:47:25.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.396+0000 7ff267600640 1 -- 172.21.15.2:0/1237170941 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ff260155d30 con 0x7ff2600cfa40 2024-09-10T08:47:25.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.396+0000 7ff25cc00640 1 -- 172.21.15.2:0/1237170941 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7ff24c0796c0 con 0x7ff2600cfa40 2024-09-10T08:47:25.397 INFO:teuthology.orchestra.run.smithi002.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-10T08:47:25.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.398+0000 7ff267600640 1 -- 172.21.15.2:0/1237170941 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7ff24006be60 msgr2=0x7ff24006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:25.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.398+0000 7ff267600640 1 --2- 172.21.15.2:0/1237170941 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7ff24006be60 0x7ff24006e320 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff254009b40 tx=0x7ff254009190 comp rx=0 tx=0).stop 2024-09-10T08:47:25.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.398+0000 7ff267600640 1 -- 172.21.15.2:0/1237170941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2600cfa40 msgr2=0x7ff2601541f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:25.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.398+0000 7ff267600640 1 --2- 172.21.15.2:0/1237170941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2600cfa40 0x7ff2601541f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff24c02a2b0 tx=0x7ff24c0046c0 comp rx=0 tx=0).stop 2024-09-10T08:47:25.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.398+0000 7ff267600640 1 -- 172.21.15.2:0/1237170941 shutdown_connections 2024-09-10T08:47:25.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.398+0000 7ff267600640 1 --2- 172.21.15.2:0/1237170941 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7ff24006be60 0x7ff24006e320 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:25.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.398+0000 7ff267600640 1 --2- 172.21.15.2:0/1237170941 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff2600cfe20 0x7ff260156250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:25.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.398+0000 7ff267600640 1 --2- 172.21.15.2:0/1237170941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2600cfa40 0x7ff2601541f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:25.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.398+0000 7ff267600640 1 --2- 172.21.15.2:0/1237170941 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff26006c150 0x7ff260150ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:25.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.398+0000 7ff267600640 1 -- 172.21.15.2:0/1237170941 >> 172.21.15.2:0/1237170941 conn(0x7ff2600b6a00 msgr2=0x7ff2600b02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:25.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.398+0000 7ff267600640 1 -- 172.21.15.2:0/1237170941 shutdown_connections 2024-09-10T08:47:25.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25.398+0000 7ff267600640 1 -- 172.21.15.2:0/1237170941 wait complete. 2024-09-10T08:47:25.414 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T08:47:25.414 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T08:47:25.414 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi002.front.sepia.ceph.com 2024-09-10T08:47:25.414 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-09-10T08:47:25.414 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-10T08:47:25.414 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T08:47:25.415 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T08:47:25.415 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T08:47:25.415 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-09-10T08:47:25.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:47:25.415 DEBUG:teuthology.orchestra.run.smithi002:> ip addr 2024-09-10T08:47:25.450 INFO:teuthology.orchestra.run.smithi002.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T08:47:25.451 INFO:teuthology.orchestra.run.smithi002.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T08:47:25.451 INFO:teuthology.orchestra.run.smithi002.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T08:47:25.451 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:47:25.451 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 ::1/128 scope host 2024-09-10T08:47:25.451 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:47:25.451 INFO:teuthology.orchestra.run.smithi002.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:47:25.451 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:02 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:47:25.451 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f0 2024-09-10T08:47:25.451 INFO:teuthology.orchestra.run.smithi002.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:47:25.451 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:03 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:47:25.451 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f1 2024-09-10T08:47:25.451 INFO:teuthology.orchestra.run.smithi002.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T08:47:25.452 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:20 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:47:25.452 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f0 2024-09-10T08:47:25.452 INFO:teuthology.orchestra.run.smithi002.stdout: inet 172.21.15.2/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-10T08:47:25.452 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft 42661sec preferred_lft 42661sec 2024-09-10T08:47:25.452 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::ec4:7aff:febd:1920/64 scope link 2024-09-10T08:47:25.452 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:47:25.452 INFO:teuthology.orchestra.run.smithi002.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:47:25.452 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:21 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:47:25.452 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f1 2024-09-10T08:47:25.452 INFO:teuthology.orchestra.run.smithi002.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T08:47:25.452 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 4a:fe:68:67:28:1a brd ff:ff:ff:ff:ff:ff 2024-09-10T08:47:25.452 INFO:teuthology.orchestra.run.smithi002.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T08:47:25.452 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:47:25.453 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::7ccf:c7ff:fe19:c365/64 scope link 2024-09-10T08:47:25.453 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:47:25.453 INFO:teuthology.orchestra.run.smithi002.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T08:47:25.453 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 4a:fe:68:67:28:1a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T08:47:25.453 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::48fe:68ff:fe67:281a/64 scope link 2024-09-10T08:47:25.453 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:47:25.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:47:25.453 DEBUG:teuthology.orchestra.run.smithi002:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T08:47:25.545 INFO:teuthology.orchestra.run.smithi002.stdout:1 2024-09-10T08:47:25.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:47:25.548 DEBUG:teuthology.orchestra.run.smithi002:> route 2024-09-10T08:47:25.584 INFO:teuthology.orchestra.run.smithi002.stdout:Kernel IP routing table 2024-09-10T08:47:25.584 INFO:teuthology.orchestra.run.smithi002.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T08:47:25.584 INFO:teuthology.orchestra.run.smithi002.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-10T08:47:25.584 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-10T08:47:25.585 INFO:teuthology.orchestra.run.smithi002.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T08:47:25.585 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T08:47:25.585 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-09-10T08:47:25.585 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-10T08:47:25.585 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-10T08:47:25.585 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-10T08:47:25.585 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-09-10T08:47:25.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:47:25.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:47:25.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:47:25.781 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2024-09-10T08:47:25.817 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T08:47:25.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:47:25.817 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list-id 2024-09-10T08:47:25.892 INFO:teuthology.orchestra.run.smithi002.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-09-10T08:47:25.893 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T08:47:25.893 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-09-10T08:47:25.893 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T08:47:25.893 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-09-10T08:47:25.893 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-09-10T08:47:26.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:47:26.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:47:26.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:47:26.070 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-10T08:47:26.125 INFO:teuthology.orchestra.run.smithi002.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T08:47:26.126 INFO:teuthology.orchestra.run.smithi002.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T08:47:26.126 INFO:teuthology.orchestra.run.smithi002.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T08:47:26.126 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:47:26.126 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 ::1/128 scope host 2024-09-10T08:47:26.126 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:47:26.126 INFO:teuthology.orchestra.run.smithi002.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T08:47:26.126 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether ae:e1:32:e2:7b:6c brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-10T08:47:26.126 INFO:teuthology.orchestra.run.smithi002.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-10T08:47:26.126 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:47:26.126 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::ace1:32ff:fee2:7b6c/64 scope link 2024-09-10T08:47:26.126 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:47:26.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:47:26.128 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-10T08:47:26.184 INFO:teuthology.orchestra.run.smithi002.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T08:47:26.184 INFO:teuthology.orchestra.run.smithi002.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T08:47:26.184 INFO:teuthology.orchestra.run.smithi002.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T08:47:26.184 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:47:26.185 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 ::1/128 scope host 2024-09-10T08:47:26.185 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:47:26.185 INFO:teuthology.orchestra.run.smithi002.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T08:47:26.185 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether ae:e1:32:e2:7b:6c brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-10T08:47:26.185 INFO:teuthology.orchestra.run.smithi002.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-10T08:47:26.185 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:47:26.185 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::ace1:32ff:fee2:7b6c/64 scope link 2024-09-10T08:47:26.185 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:47:26.187 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-09-10T08:47:26.187 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T08:47:26.187 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-09-10T08:47:26.188 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-09-10T08:47:26.188 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-10T08:47:26.188 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-09-10T08:47:26.188 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-09-10T08:47:26.188 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-09-10T08:47:26.188 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-09-10T08:47:26.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:47:26.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:47:26.406 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T08:47:26.406 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-09-10T08:47:26.406 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set brx.1 up 2024-09-10T08:47:26.406 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set dev brx.1 master ceph-brx 2024-09-10T08:47:26.406 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-09-10T08:47:26.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:47:26.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:47:26.572 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T08:47:26.573 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-09-10T08:47:26.608 INFO:teuthology.orchestra.run.smithi002.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-09-10T08:47:26.608 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T08:47:26.608 DEBUG:teuthology.orchestra.run.smithi002:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-09-10T08:47:26.682 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2024-09-10T08:47:26.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:47:26.683 DEBUG:teuthology.orchestra.run.smithi002:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,snapdirname=.customsnapkernel,nofallback 2024-09-10T08:47:26.810 INFO:teuthology.orchestra.run.smithi002.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,snapdirname=.customsnapkernel,nofallback 2024-09-10T08:47:26.811 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes,snapdirname=.customsnapkernel". 2024-09-10T08:47:26.839 INFO:teuthology.orchestra.run.smithi002.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,snapdirname=.customsnapkernel,nofallback 2024-09-10T08:47:26.840 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes,snapdirname=.customsnapkernel". 2024-09-10T08:47:26.840 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: resolved to: "172.21.15.2:3300,172.21.15.155:3300,172.21.15.155:3301" 2024-09-10T08:47:26.840 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: trying mount with new device syntax: 2@f20a15a7-d363-4d44-98cb-4f4f466b52b8.cephfs=/ 2024-09-10T08:47:26.840 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes,snapdirname=.customsnapkernel,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.2:3300/172.21.15.155:3300/172.21.15.155:3301" will pass to kernel 2024-09-10T08:47:26.841 INFO:teuthology.orchestra.run.smithi002.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-09-10T08:47:26.841 INFO:teuthology.orchestra.run.smithi002.stdout: You just mounted a file system that supports labels which does not 2024-09-10T08:47:26.841 INFO:teuthology.orchestra.run.smithi002.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T08:47:26.841 INFO:teuthology.orchestra.run.smithi002.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T08:47:26.841 INFO:teuthology.orchestra.run.smithi002.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T08:47:26.844 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T08:47:26.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:47:26.844 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-09-10T08:47:26.900 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T08:47:26.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:26 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:47:26.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:47:26.990 INFO:teuthology.orchestra.run.smithi002.stdout:client4514 2024-09-10T08:47:26.991 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T08:47:26.991 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:47:27.026 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T08:47:27.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:47:27.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:47:27.155 INFO:teuthology.orchestra.run.smithi002.stdout:client4514 2024-09-10T08:47:27.156 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T08:47:27.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:47:27.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:47:27.245 INFO:teuthology.orchestra.run.smithi002.stdout:client4514 2024-09-10T08:47:27.245 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/f20a15a7-d363-4d44-98cb-4f4f466b52b8.client4514/status') 2024-09-10T08:47:27.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:47:27.345 INFO:teuthology.orchestra.run.smithi002.stdout:instance: client.4514 (3)172.21.15.2:0/3672411120 2024-09-10T08:47:27.345 INFO:teuthology.orchestra.run.smithi002.stdout:blocklisted: false 2024-09-10T08:47:27.345 INFO:teuthology.orchestra.run.smithi002.stderr:0+1 records in 2024-09-10T08:47:27.345 INFO:teuthology.orchestra.run.smithi002.stderr:0+1 records out 2024-09-10T08:47:27.345 INFO:teuthology.orchestra.run.smithi002.stderr:69 bytes copied, 5.463e-05 s, 1.3 MB/s 2024-09-10T08:47:27.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:47:27.356 INFO:tasks.kclient:client.1 config is {'snapdirname': '.customsnapkernel', 'syntax': 'v2'} 2024-09-10T08:47:27.356 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-10T08:47:27.356 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-10T08:47:27.356 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T08:47:27.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.512+0000 7f1a32e00640 1 Processor -- start 2024-09-10T08:47:27.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.512+0000 7f1a32e00640 1 -- start start 2024-09-10T08:47:27.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.513+0000 7f1a32e00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f1a2c0d27f0 0x7f1a2c0b3a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:27.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.513+0000 7f1a32e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1a2c0b3fa0 0x7f1a2c161850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:27.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.513+0000 7f1a32e00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a2c0d1820 con 0x7f1a2c0d2bd0 2024-09-10T08:47:27.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.513+0000 7f1a32e00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f1a2c0cf010 con 0x7f1a2c0b3fa0 2024-09-10T08:47:27.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.513+0000 7f1a32e00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f1a2c0d1de0 con 0x7f1a2c0d27f0 2024-09-10T08:47:27.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.514+0000 7f1a32400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f1a2c0d2bd0 0x7f1a2c0cfa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:58218/0 (socket says 172.21.15.2:58218) 2024-09-10T08:47:27.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.514+0000 7f1a32400640 1 -- 172.21.15.2:0/397159704 learned_addr learned my addr 172.21.15.2:0/397159704 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:47:27.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.514+0000 7f1a31000640 1 --2- 172.21.15.2:0/397159704 >> v2:172.21.15.2:3300/0 conn(0x7f1a2c0b3fa0 0x7f1a2c161850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:27.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.514+0000 7f1a31a00640 1 --2- 172.21.15.2:0/397159704 >> v2:172.21.15.155:3300/0 conn(0x7f1a2c0d27f0 0x7f1a2c0b3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:27.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.514+0000 7f1a31000640 1 -- 172.21.15.2:0/397159704 >> v2:172.21.15.155:3300/0 conn(0x7f1a2c0d27f0 msgr2=0x7f1a2c0b3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:27.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.514+0000 7f1a31000640 1 --2- 172.21.15.2:0/397159704 >> v2:172.21.15.155:3300/0 conn(0x7f1a2c0d27f0 0x7f1a2c0b3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:27.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.514+0000 7f1a31000640 1 -- 172.21.15.2:0/397159704 >> v1:172.21.15.2:6789/0 conn(0x7f1a2c0d2bd0 legacy=0x7f1a2c0cfa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:27.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.514+0000 7f1a2be00640 1 -- 172.21.15.2:0/397159704 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2057604705 0 0) 0x7f1a2c0d1820 con 0x7f1a2c0d2bd0 2024-09-10T08:47:27.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.514+0000 7f1a31000640 1 -- 172.21.15.2:0/397159704 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a2c0d1b00 con 0x7f1a2c0b3fa0 2024-09-10T08:47:27.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.515+0000 7f1a31000640 1 --2- 172.21.15.2:0/397159704 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a2c0b3fa0 0x7f1a2c161850 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c0b7000 tx=0x7f1a1802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b82fb8bfa96beef server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:27.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.515+0000 7f1a2be00640 1 -- 172.21.15.2:0/397159704 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a18037070 con 0x7f1a2c0b3fa0 2024-09-10T08:47:27.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.516+0000 7f1a2be00640 1 -- 172.21.15.2:0/397159704 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a18032440 con 0x7f1a2c0b3fa0 2024-09-10T08:47:27.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.516+0000 7f1a2be00640 1 -- 172.21.15.2:0/397159704 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a18032810 con 0x7f1a2c0b3fa0 2024-09-10T08:47:27.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.516+0000 7f1a32e00640 1 -- 172.21.15.2:0/397159704 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a2c0b3fa0 msgr2=0x7f1a2c161850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:27.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.516+0000 7f1a32e00640 1 --2- 172.21.15.2:0/397159704 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a2c0b3fa0 0x7f1a2c161850 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c0b7000 tx=0x7f1a1802a1a0 comp rx=0 tx=0).stop 2024-09-10T08:47:27.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.516+0000 7f1a32e00640 1 -- 172.21.15.2:0/397159704 shutdown_connections 2024-09-10T08:47:27.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.516+0000 7f1a32e00640 1 --2- 172.21.15.2:0/397159704 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a2c0b3fa0 0x7f1a2c161850 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:27.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.516+0000 7f1a32e00640 1 --2- 172.21.15.2:0/397159704 >> v2:172.21.15.155:3300/0 conn(0x7f1a2c0d27f0 0x7f1a2c0b3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:27.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.516+0000 7f1a32e00640 1 -- 172.21.15.2:0/397159704 >> 172.21.15.2:0/397159704 conn(0x7f1a2c09d740 msgr2=0x7f1a2c0d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:27.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.516+0000 7f1a32e00640 1 -- 172.21.15.2:0/397159704 shutdown_connections 2024-09-10T08:47:27.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.516+0000 7f1a32e00640 1 -- 172.21.15.2:0/397159704 wait complete. 2024-09-10T08:47:27.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.518+0000 7f1a32e00640 1 Processor -- start 2024-09-10T08:47:27.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.518+0000 7f1a32e00640 1 -- start start 2024-09-10T08:47:27.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.519+0000 7f1a32e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1a2c0d27f0 0x7f1a2c152080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:27.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.519+0000 7f1a32e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a2c0d2bd0 0x7f1a2c1517c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:27.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.519+0000 7f1a32e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1a2c153700 0x7f1a2c155570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:27.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.519+0000 7f1a32e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1a2c0d0150 con 0x7f1a2c0d2bd0 2024-09-10T08:47:27.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.519+0000 7f1a32e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1a2c0cf520 con 0x7f1a2c153700 2024-09-10T08:47:27.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.519+0000 7f1a32e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1a2c0d02d0 con 0x7f1a2c0d27f0 2024-09-10T08:47:27.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.519+0000 7f1a31000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a2c0d2bd0 0x7f1a2c1517c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:27.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.519+0000 7f1a31000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a2c0d2bd0 0x7f1a2c1517c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51212/0 (socket says 172.21.15.2:51212) 2024-09-10T08:47:27.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.519+0000 7f1a31000640 1 -- 172.21.15.2:0/747751030 learned_addr learned my addr 172.21.15.2:0/747751030 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:27.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.519+0000 7f1a31a00640 1 --2- 172.21.15.2:0/747751030 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1a2c0d27f0 0x7f1a2c152080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:27.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.519+0000 7f1a32400640 1 --2- 172.21.15.2:0/747751030 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1a2c153700 0x7f1a2c155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:27.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.520+0000 7f1a31000640 1 -- 172.21.15.2:0/747751030 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1a2c0d27f0 msgr2=0x7f1a2c152080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:27.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.520+0000 7f1a31000640 1 --2- 172.21.15.2:0/747751030 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1a2c0d27f0 0x7f1a2c152080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:27.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.520+0000 7f1a31000640 1 -- 172.21.15.2:0/747751030 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1a2c153700 msgr2=0x7f1a2c155570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:27.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.520+0000 7f1a31000640 1 --2- 172.21.15.2:0/747751030 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1a2c153700 0x7f1a2c155570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:27.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.520+0000 7f1a31000640 1 -- 172.21.15.2:0/747751030 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a2c152660 con 0x7f1a2c0d2bd0 2024-09-10T08:47:27.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.520+0000 7f1a32400640 1 --2- 172.21.15.2:0/747751030 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1a2c153700 0x7f1a2c155570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:47:27.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.520+0000 7f1a31000640 1 --2- 172.21.15.2:0/747751030 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a2c0d2bd0 0x7f1a2c1517c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1a18000c00 tx=0x7f1a180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:27.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.520+0000 7f1a29600640 1 -- 172.21.15.2:0/747751030 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a18037050 con 0x7f1a2c0d2bd0 2024-09-10T08:47:27.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.520+0000 7f1a29600640 1 -- 172.21.15.2:0/747751030 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a18038040 con 0x7f1a2c0d2bd0 2024-09-10T08:47:27.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.520+0000 7f1a29600640 1 -- 172.21.15.2:0/747751030 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a18004470 con 0x7f1a2c0d2bd0 2024-09-10T08:47:27.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.520+0000 7f1a32e00640 1 -- 172.21.15.2:0/747751030 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a2c152940 con 0x7f1a2c0d2bd0 2024-09-10T08:47:27.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.521+0000 7f1a32e00640 1 -- 172.21.15.2:0/747751030 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a2c152f00 con 0x7f1a2c0d2bd0 2024-09-10T08:47:27.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.522+0000 7f1a32e00640 1 -- 172.21.15.2:0/747751030 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a2c0b3a60 con 0x7f1a2c0d2bd0 2024-09-10T08:47:27.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.523+0000 7f1a29600640 1 -- 172.21.15.2:0/747751030 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1a18030900 con 0x7f1a2c0d2bd0 2024-09-10T08:47:27.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.523+0000 7f1a29600640 1 --2- 172.21.15.2:0/747751030 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f1a0c06be30 0x7f1a0c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:27.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.523+0000 7f1a29600640 1 -- 172.21.15.2:0/747751030 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f1a180abd20 con 0x7f1a2c0d2bd0 2024-09-10T08:47:27.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.524+0000 7f1a31a00640 1 --2- 172.21.15.2:0/747751030 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f1a0c06be30 0x7f1a0c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:27.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.525+0000 7f1a31a00640 1 --2- 172.21.15.2:0/747751030 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f1a0c06be30 0x7f1a0c06e2f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1a200079a0 tx=0x7f1a20008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:27.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.528+0000 7f1a29600640 1 -- 172.21.15.2:0/747751030 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1a1807a4a0 con 0x7f1a2c0d2bd0 2024-09-10T08:47:27.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.747+0000 7f1a32e00640 1 -- 172.21.15.2:0/747751030 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f1a2c0d5380 con 0x7f1a2c0d2bd0 2024-09-10T08:47:27.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.748+0000 7f1a29600640 1 -- 172.21.15.2:0/747751030 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f1a18079da0 con 0x7f1a2c0d2bd0 2024-09-10T08:47:27.748 INFO:teuthology.orchestra.run.smithi002.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-10T08:47:27.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.750+0000 7f1a32e00640 1 -- 172.21.15.2:0/747751030 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f1a0c06be30 msgr2=0x7f1a0c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:27.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.750+0000 7f1a32e00640 1 --2- 172.21.15.2:0/747751030 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f1a0c06be30 0x7f1a0c06e2f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1a200079a0 tx=0x7f1a20008040 comp rx=0 tx=0).stop 2024-09-10T08:47:27.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.750+0000 7f1a32e00640 1 -- 172.21.15.2:0/747751030 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a2c0d2bd0 msgr2=0x7f1a2c1517c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:27.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.750+0000 7f1a32e00640 1 --2- 172.21.15.2:0/747751030 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a2c0d2bd0 0x7f1a2c1517c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1a18000c00 tx=0x7f1a180046c0 comp rx=0 tx=0).stop 2024-09-10T08:47:27.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.750+0000 7f1a32e00640 1 -- 172.21.15.2:0/747751030 shutdown_connections 2024-09-10T08:47:27.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.750+0000 7f1a32e00640 1 --2- 172.21.15.2:0/747751030 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1a2c153700 0x7f1a2c155570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:27.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.750+0000 7f1a32e00640 1 --2- 172.21.15.2:0/747751030 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1a2c0d2bd0 0x7f1a2c1517c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:27.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.750+0000 7f1a32e00640 1 --2- 172.21.15.2:0/747751030 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f1a0c06be30 0x7f1a0c06e2f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:27.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.750+0000 7f1a32e00640 1 --2- 172.21.15.2:0/747751030 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1a2c0d27f0 0x7f1a2c152080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:27.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.750+0000 7f1a32e00640 1 -- 172.21.15.2:0/747751030 >> 172.21.15.2:0/747751030 conn(0x7f1a2c09d740 msgr2=0x7f1a2c0b6780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:27.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.750+0000 7f1a32e00640 1 -- 172.21.15.2:0/747751030 shutdown_connections 2024-09-10T08:47:27.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:27.750+0000 7f1a32e00640 1 -- 172.21.15.2:0/747751030 wait complete. 2024-09-10T08:47:27.765 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T08:47:27.765 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T08:47:27.765 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi155.front.sepia.ceph.com 2024-09-10T08:47:27.766 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-10T08:47:27.766 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-10T08:47:27.766 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T08:47:27.766 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T08:47:27.766 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T08:47:27.766 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-10T08:47:27.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:47:27.766 DEBUG:teuthology.orchestra.run.smithi155:> ip addr 2024-09-10T08:47:27.806 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T08:47:27.807 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T08:47:27.807 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T08:47:27.807 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:47:27.807 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2024-09-10T08:47:27.807 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:47:27.807 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:47:27.807 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2024-09-10T08:47:27.807 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f0 2024-09-10T08:47:27.807 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:47:27.807 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2024-09-10T08:47:27.807 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f1 2024-09-10T08:47:27.807 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:47:27.808 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2024-09-10T08:47:27.808 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T08:47:27.808 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2024-09-10T08:47:27.808 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T08:47:27.808 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 42656sec preferred_lft 42656sec 2024-09-10T08:47:27.808 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link noprefixroute 2024-09-10T08:47:27.808 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:47:27.808 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-10T08:47:27.808 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T08:47:27.809 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-09-10T08:47:27.809 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link add name ceph-brx type bridge 2024-09-10T08:47:27.809 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip addr flush dev ceph-brx 2024-09-10T08:47:27.809 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set ceph-brx up 2024-09-10T08:47:27.809 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-10T08:47:27.809 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-09-10T08:47:27.928 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:47:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:47:28.221 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:47:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:47:28.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:47:28.229 DEBUG:teuthology.orchestra.run.smithi155:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T08:47:28.287 INFO:teuthology.orchestra.run.smithi155.stdout:1 2024-09-10T08:47:28.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:47:28.290 DEBUG:teuthology.orchestra.run.smithi155:> route 2024-09-10T08:47:28.340 INFO:teuthology.orchestra.run.smithi155.stdout:Kernel IP routing table 2024-09-10T08:47:28.340 INFO:teuthology.orchestra.run.smithi155.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T08:47:28.340 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T08:47:28.340 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T08:47:28.340 INFO:teuthology.orchestra.run.smithi155.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T08:47:28.341 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T08:47:28.341 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-09-10T08:47:28.341 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T08:47:28.341 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T08:47:28.341 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T08:47:28.341 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-09-10T08:47:28.420 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:47:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:47:28.944 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:47:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:47:28.952 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:47:28.952 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2024-09-10T08:47:28.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:47:28.989 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list-id 2024-09-10T08:47:29.064 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T08:47:29.064 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-09-10T08:47:29.064 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T08:47:29.064 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-10T08:47:29.064 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-09-10T08:47:29.199 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:47:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:47:29.252 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:47:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:47:29.263 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-10T08:47:29.264 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T08:47:29.264 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-09-10T08:47:29.264 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-10T08:47:29.264 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-10T08:47:29.264 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-10T08:47:29.264 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-10T08:47:29.264 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-10T08:47:29.264 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-09-10T08:47:29.342 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:47:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:47:29.503 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:47:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:47:29.512 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T08:47:29.512 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-09-10T08:47:29.512 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set brx.0 up 2024-09-10T08:47:29.512 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set dev brx.0 master ceph-brx 2024-09-10T08:47:29.512 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-09-10T08:47:29.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:47:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:47:29.673 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:47:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:47:29.682 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T08:47:29.682 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-10T08:47:29.718 INFO:teuthology.orchestra.run.smithi155.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-10T08:47:29.718 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T08:47:29.718 DEBUG:teuthology.orchestra.run.smithi155:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-10T08:47:29.793 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-10T08:47:29.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:47:29.794 DEBUG:teuthology.orchestra.run.smithi155:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,snapdirname=.customsnapkernel,nofallback 2024-09-10T08:47:29.929 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,snapdirname=.customsnapkernel,nofallback 2024-09-10T08:47:29.930 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes,snapdirname=.customsnapkernel". 2024-09-10T08:47:30.562 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,snapdirname=.customsnapkernel,nofallback 2024-09-10T08:47:30.562 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes,snapdirname=.customsnapkernel". 2024-09-10T08:47:30.563 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: resolved to: "172.21.15.2:3300,172.21.15.155:3300,172.21.15.155:3301" 2024-09-10T08:47:30.563 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: trying mount with new device syntax: 1@f20a15a7-d363-4d44-98cb-4f4f466b52b8.cephfs=/ 2024-09-10T08:47:30.563 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes,snapdirname=.customsnapkernel,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.2:3300/172.21.15.155:3300/172.21.15.155:3301" will pass to kernel 2024-09-10T08:47:30.566 INFO:teuthology.orchestra.run.smithi155.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-10T08:47:30.566 INFO:teuthology.orchestra.run.smithi155.stdout: You just mounted a file system that supports labels which does not 2024-09-10T08:47:30.566 INFO:teuthology.orchestra.run.smithi155.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T08:47:30.566 INFO:teuthology.orchestra.run.smithi155.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T08:47:30.566 INFO:teuthology.orchestra.run.smithi155.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T08:47:30.569 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T08:47:30.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:47:30.569 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-10T08:47:30.625 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T08:47:30.704 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:47:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:47:30.707 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:47:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:47:30.715 INFO:teuthology.orchestra.run.smithi155.stdout:client4659 2024-09-10T08:47:30.716 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-10T08:47:30.716 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:47:30.752 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T08:47:30.868 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:47:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:47:30.872 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:47:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:47:30.880 INFO:teuthology.orchestra.run.smithi155.stdout:client4659 2024-09-10T08:47:30.881 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T08:47:30.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:47:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:47:30.961 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:47:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:47:30.969 INFO:teuthology.orchestra.run.smithi155.stdout:client4659 2024-09-10T08:47:30.970 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/f20a15a7-d363-4d44-98cb-4f4f466b52b8.client4659/status') 2024-09-10T08:47:31.047 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:47:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:47:31.068 INFO:teuthology.orchestra.run.smithi155.stdout:instance: client.4659 (3)172.21.15.155:0/4136231761 2024-09-10T08:47:31.068 INFO:teuthology.orchestra.run.smithi155.stdout:blocklisted: false 2024-09-10T08:47:31.068 INFO:teuthology.orchestra.run.smithi155.stderr:0+1 records in 2024-09-10T08:47:31.068 INFO:teuthology.orchestra.run.smithi155.stderr:0+1 records out 2024-09-10T08:47:31.068 INFO:teuthology.orchestra.run.smithi155.stderr:71 bytes copied, 0.00010621 s, 668 kB/s 2024-09-10T08:47:31.070 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:47:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:47:31.079 INFO:tasks.kclient:client.3 config is {'snapdirname': '.customsnapkernel', 'syntax': 'v2'} 2024-09-10T08:47:31.079 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-10T08:47:31.079 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-10T08:47:31.079 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T08:47:31.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.246+0000 7fdc19600640 1 Processor -- start 2024-09-10T08:47:31.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.246+0000 7fdc19600640 1 -- start start 2024-09-10T08:47:31.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.248+0000 7fdc19600640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fdc140cd460 0x7fdc1415c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:31.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.248+0000 7fdc19600640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc1406e4d0 con 0x7fdc14145d20 2024-09-10T08:47:31.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.248+0000 7fdc19600640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc1406e7b0 con 0x7fdc1406df80 2024-09-10T08:47:31.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.248+0000 7fdc19600640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fdc14146100 con 0x7fdc140cd460 2024-09-10T08:47:31.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.248+0000 7fdc12a00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fdc14145d20 0x7fdc140ccd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:58234/0 (socket says 172.21.15.2:58234) 2024-09-10T08:47:31.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.248+0000 7fdc12a00640 1 -- 172.21.15.2:0/4281836710 learned_addr learned my addr 172.21.15.2:0/4281836710 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:47:31.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.248+0000 7fdc0be00640 1 --2- 172.21.15.2:0/4281836710 >> v2:172.21.15.155:3300/0 conn(0x7fdc140cd460 0x7fdc1415c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:31.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.248+0000 7fdc12000640 1 -- 172.21.15.2:0/4281836710 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1140094947 0 0) 0x7fdc1406e4d0 con 0x7fdc14145d20 2024-09-10T08:47:31.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.248+0000 7fdc12000640 1 -- 172.21.15.2:0/4281836710 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdbf8003520 con 0x7fdc14145d20 2024-09-10T08:47:31.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.248+0000 7fdc12000640 1 -- 172.21.15.2:0/4281836710 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1997815813 0 0) 0x7fdc1406e7b0 con 0x7fdc1406df80 2024-09-10T08:47:31.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.248+0000 7fdc12000640 1 -- 172.21.15.2:0/4281836710 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc1406e4d0 con 0x7fdc1406df80 2024-09-10T08:47:31.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.248+0000 7fdc0be00640 1 -- 172.21.15.2:0/4281836710 >> v1:172.21.15.155:6789/0 conn(0x7fdc1406df80 legacy=0x7fdc140ceb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:31.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.249+0000 7fdc0be00640 1 -- 172.21.15.2:0/4281836710 >> v1:172.21.15.2:6789/0 conn(0x7fdc14145d20 legacy=0x7fdc140ccd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:31.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.249+0000 7fdc0be00640 1 -- 172.21.15.2:0/4281836710 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc1406ea90 con 0x7fdc140cd460 2024-09-10T08:47:31.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.250+0000 7fdc0be00640 1 --2- 172.21.15.2:0/4281836710 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc140cd460 0x7fdc1415c9e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc0097a0 tx=0x7fdbfc02a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=414d3be165f8bb9e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:31.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.250+0000 7fdc12000640 1 -- 172.21.15.2:0/4281836710 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbfc037070 con 0x7fdc140cd460 2024-09-10T08:47:31.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.250+0000 7fdc12000640 1 -- 172.21.15.2:0/4281836710 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbfc032440 con 0x7fdc140cd460 2024-09-10T08:47:31.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.250+0000 7fdc12000640 1 -- 172.21.15.2:0/4281836710 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbfc02ae60 con 0x7fdc140cd460 2024-09-10T08:47:31.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.250+0000 7fdc19600640 1 -- 172.21.15.2:0/4281836710 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc140cd460 msgr2=0x7fdc1415c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:31.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.250+0000 7fdc19600640 1 --2- 172.21.15.2:0/4281836710 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc140cd460 0x7fdc1415c9e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc0097a0 tx=0x7fdbfc02a110 comp rx=0 tx=0).stop 2024-09-10T08:47:31.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.250+0000 7fdc19600640 1 -- 172.21.15.2:0/4281836710 shutdown_connections 2024-09-10T08:47:31.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.250+0000 7fdc19600640 1 --2- 172.21.15.2:0/4281836710 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc140cd460 0x7fdc1415c9e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:31.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.250+0000 7fdc19600640 1 -- 172.21.15.2:0/4281836710 >> 172.21.15.2:0/4281836710 conn(0x7fdc1406bc10 msgr2=0x7fdc1406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:31.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.251+0000 7fdc19600640 1 -- 172.21.15.2:0/4281836710 shutdown_connections 2024-09-10T08:47:31.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.251+0000 7fdc19600640 1 -- 172.21.15.2:0/4281836710 wait complete. 2024-09-10T08:47:31.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.252+0000 7fdc19600640 1 Processor -- start 2024-09-10T08:47:31.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.252+0000 7fdc19600640 1 -- start start 2024-09-10T08:47:31.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.253+0000 7fdc19600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc1406df80 0x7fdc1413e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:31.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.253+0000 7fdc19600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc140cd460 0x7fdc141f4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:31.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.253+0000 7fdc19600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc14145d20 0x7fdc1413f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:31.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.253+0000 7fdc19600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdc14160980 con 0x7fdc140cd460 2024-09-10T08:47:31.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.253+0000 7fdc19600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fdc140ce6b0 con 0x7fdc1406df80 2024-09-10T08:47:31.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.253+0000 7fdc19600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fdc14160b00 con 0x7fdc14145d20 2024-09-10T08:47:31.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.253+0000 7fdc0be00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc140cd460 0x7fdc141f4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:31.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.253+0000 7fdc0be00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc140cd460 0x7fdc141f4aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51218/0 (socket says 172.21.15.2:51218) 2024-09-10T08:47:31.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.253+0000 7fdc0be00640 1 -- 172.21.15.2:0/1720625060 learned_addr learned my addr 172.21.15.2:0/1720625060 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:31.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.253+0000 7fdc12a00640 1 --2- 172.21.15.2:0/1720625060 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc1406df80 0x7fdc1413e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:31.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.253+0000 7fdc13400640 1 --2- 172.21.15.2:0/1720625060 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc14145d20 0x7fdc1413f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:31.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.254+0000 7fdc0be00640 1 -- 172.21.15.2:0/1720625060 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc14145d20 msgr2=0x7fdc1413f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:31.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.254+0000 7fdc0be00640 1 --2- 172.21.15.2:0/1720625060 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc14145d20 0x7fdc1413f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:31.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.254+0000 7fdc0be00640 1 -- 172.21.15.2:0/1720625060 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc1406df80 msgr2=0x7fdc1413e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:31.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.254+0000 7fdc0be00640 1 --2- 172.21.15.2:0/1720625060 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc1406df80 0x7fdc1413e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:31.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.254+0000 7fdc0be00640 1 -- 172.21.15.2:0/1720625060 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc1413eaa0 con 0x7fdc140cd460 2024-09-10T08:47:31.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.254+0000 7fdc12a00640 1 --2- 172.21.15.2:0/1720625060 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc1406df80 0x7fdc1413e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:47:31.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.254+0000 7fdc0be00640 1 --2- 172.21.15.2:0/1720625060 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc140cd460 0x7fdc141f4aa0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc02a150 tx=0x7fdbfc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:31.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.254+0000 7fdc0aa00640 1 -- 172.21.15.2:0/1720625060 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbfc041030 con 0x7fdc140cd460 2024-09-10T08:47:31.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.254+0000 7fdc0aa00640 1 -- 172.21.15.2:0/1720625060 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbfc030440 con 0x7fdc140cd460 2024-09-10T08:47:31.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.254+0000 7fdc0aa00640 1 -- 172.21.15.2:0/1720625060 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbfc037040 con 0x7fdc140cd460 2024-09-10T08:47:31.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.254+0000 7fdc19600640 1 -- 172.21.15.2:0/1720625060 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc1413ed80 con 0x7fdc140cd460 2024-09-10T08:47:31.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.255+0000 7fdc19600640 1 -- 172.21.15.2:0/1720625060 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc1413f340 con 0x7fdc140cd460 2024-09-10T08:47:31.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.256+0000 7fdc19600640 1 -- 172.21.15.2:0/1720625060 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc1415db60 con 0x7fdc140cd460 2024-09-10T08:47:31.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.256+0000 7fdc0aa00640 1 -- 172.21.15.2:0/1720625060 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdbfc044070 con 0x7fdc140cd460 2024-09-10T08:47:31.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.257+0000 7fdc0aa00640 1 --2- 172.21.15.2:0/1720625060 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fdbf006be30 0x7fdbf006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:31.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.257+0000 7fdc0aa00640 1 -- 172.21.15.2:0/1720625060 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fdbfc0ab820 con 0x7fdc140cd460 2024-09-10T08:47:31.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.258+0000 7fdc12a00640 1 --2- 172.21.15.2:0/1720625060 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fdbf006be30 0x7fdbf006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:31.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.259+0000 7fdc12a00640 1 --2- 172.21.15.2:0/1720625060 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fdbf006be30 0x7fdbf006e2f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdc04000f60 tx=0x7fdc04009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:31.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.262+0000 7fdc0aa00640 1 -- 172.21.15.2:0/1720625060 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdbfc0797b0 con 0x7fdc140cd460 2024-09-10T08:47:31.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.486+0000 7fdc19600640 1 -- 172.21.15.2:0/1720625060 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fdc140b0cc0 con 0x7fdc140cd460 2024-09-10T08:47:31.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.486+0000 7fdc0aa00640 1 -- 172.21.15.2:0/1720625060 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7fdbfc07dab0 con 0x7fdc140cd460 2024-09-10T08:47:31.486 INFO:teuthology.orchestra.run.smithi002.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-10T08:47:31.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.488+0000 7fdc19600640 1 -- 172.21.15.2:0/1720625060 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fdbf006be30 msgr2=0x7fdbf006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:31.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.488+0000 7fdc19600640 1 --2- 172.21.15.2:0/1720625060 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fdbf006be30 0x7fdbf006e2f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdc04000f60 tx=0x7fdc04009040 comp rx=0 tx=0).stop 2024-09-10T08:47:31.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.488+0000 7fdc19600640 1 -- 172.21.15.2:0/1720625060 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc140cd460 msgr2=0x7fdc141f4aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:31.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.488+0000 7fdc19600640 1 --2- 172.21.15.2:0/1720625060 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc140cd460 0x7fdc141f4aa0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc02a150 tx=0x7fdbfc0046c0 comp rx=0 tx=0).stop 2024-09-10T08:47:31.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.488+0000 7fdc19600640 1 -- 172.21.15.2:0/1720625060 shutdown_connections 2024-09-10T08:47:31.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.488+0000 7fdc19600640 1 --2- 172.21.15.2:0/1720625060 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fdbf006be30 0x7fdbf006e2f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:31.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.488+0000 7fdc19600640 1 --2- 172.21.15.2:0/1720625060 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc14145d20 0x7fdc1413f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:31.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.488+0000 7fdc19600640 1 --2- 172.21.15.2:0/1720625060 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc140cd460 0x7fdc141f4aa0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:31.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.488+0000 7fdc19600640 1 --2- 172.21.15.2:0/1720625060 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc1406df80 0x7fdc1413e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:31.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.488+0000 7fdc19600640 1 -- 172.21.15.2:0/1720625060 >> 172.21.15.2:0/1720625060 conn(0x7fdc1406bc10 msgr2=0x7fdc140cea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:31.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.488+0000 7fdc19600640 1 -- 172.21.15.2:0/1720625060 shutdown_connections 2024-09-10T08:47:31.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:31.488+0000 7fdc19600640 1 -- 172.21.15.2:0/1720625060 wait complete. 2024-09-10T08:47:31.505 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-10T08:47:31.505 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T08:47:31.505 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi155.front.sepia.ceph.com 2024-09-10T08:47:31.505 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-09-10T08:47:31.505 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-10T08:47:31.505 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-10T08:47:31.505 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-10T08:47:31.505 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T08:47:31.505 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-09-10T08:47:31.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:47:31.506 DEBUG:teuthology.orchestra.run.smithi155:> ip addr 2024-09-10T08:47:31.550 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T08:47:31.550 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T08:47:31.550 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T08:47:31.550 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:47:31.550 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2024-09-10T08:47:31.551 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:47:31.551 INFO:teuthology.orchestra.run.smithi155.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:47:31.551 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fa brd ff:ff:ff:ff:ff:ff 2024-09-10T08:47:31.551 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f0 2024-09-10T08:47:31.551 INFO:teuthology.orchestra.run.smithi155.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:47:31.551 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:d9:a0:fb brd ff:ff:ff:ff:ff:ff 2024-09-10T08:47:31.551 INFO:teuthology.orchestra.run.smithi155.stdout: altname enp7s0f1 2024-09-10T08:47:31.551 INFO:teuthology.orchestra.run.smithi155.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:47:31.551 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ec brd ff:ff:ff:ff:ff:ff 2024-09-10T08:47:31.551 INFO:teuthology.orchestra.run.smithi155.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T08:47:31.551 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 0c:c4:7a:88:6d:ed brd ff:ff:ff:ff:ff:ff 2024-09-10T08:47:31.551 INFO:teuthology.orchestra.run.smithi155.stdout: inet 172.21.15.155/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-10T08:47:31.552 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft 42652sec preferred_lft 42652sec 2024-09-10T08:47:31.552 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::ec4:7aff:fe88:6ded/64 scope link noprefixroute 2024-09-10T08:47:31.552 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:47:31.552 INFO:teuthology.orchestra.run.smithi155.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T08:47:31.552 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 72:5d:99:c3:43:23 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:47:31.552 INFO:teuthology.orchestra.run.smithi155.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T08:47:31.552 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:47:31.552 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::bce9:daff:fea8:bb40/64 scope link 2024-09-10T08:47:31.552 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:47:31.552 INFO:teuthology.orchestra.run.smithi155.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T08:47:31.552 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether 72:5d:99:c3:43:23 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T08:47:31.552 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::705d:99ff:fec3:4323/64 scope link 2024-09-10T08:47:31.552 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:47:31.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:47:31.554 DEBUG:teuthology.orchestra.run.smithi155:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T08:47:31.648 INFO:teuthology.orchestra.run.smithi155.stdout:1 2024-09-10T08:47:31.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:47:31.651 DEBUG:teuthology.orchestra.run.smithi155:> route 2024-09-10T08:47:31.687 INFO:teuthology.orchestra.run.smithi155.stdout:Kernel IP routing table 2024-09-10T08:47:31.687 INFO:teuthology.orchestra.run.smithi155.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T08:47:31.687 INFO:teuthology.orchestra.run.smithi155.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-10T08:47:31.687 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-10T08:47:31.687 INFO:teuthology.orchestra.run.smithi155.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T08:47:31.687 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T08:47:31.688 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-09-10T08:47:31.688 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-10T08:47:31.688 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-10T08:47:31.688 DEBUG:teuthology.orchestra.run.smithi155:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-10T08:47:31.688 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-09-10T08:47:31.808 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:47:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:47:31.880 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:47:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:47:31.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:47:31.889 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2024-09-10T08:47:31.923 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-10T08:47:31.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:47:31.924 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list-id 2024-09-10T08:47:31.999 INFO:teuthology.orchestra.run.smithi155.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-09-10T08:47:31.999 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T08:47:31.999 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-09-10T08:47:31.999 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-10T08:47:32.000 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-09-10T08:47:32.000 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-09-10T08:47:32.116 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:47:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:47:32.167 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:47:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:47:32.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:47:32.176 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-10T08:47:32.232 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T08:47:32.232 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T08:47:32.232 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T08:47:32.232 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:47:32.232 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2024-09-10T08:47:32.232 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:47:32.232 INFO:teuthology.orchestra.run.smithi155.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T08:47:32.232 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether b2:61:3c:c6:62:c7 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-10T08:47:32.232 INFO:teuthology.orchestra.run.smithi155.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-10T08:47:32.232 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:47:32.233 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::b061:3cff:fec6:62c7/64 scope link 2024-09-10T08:47:32.233 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:47:32.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:47:32.235 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-10T08:47:32.290 INFO:teuthology.orchestra.run.smithi155.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T08:47:32.290 INFO:teuthology.orchestra.run.smithi155.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T08:47:32.290 INFO:teuthology.orchestra.run.smithi155.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T08:47:32.290 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:47:32.290 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 ::1/128 scope host 2024-09-10T08:47:32.290 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:47:32.291 INFO:teuthology.orchestra.run.smithi155.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T08:47:32.291 INFO:teuthology.orchestra.run.smithi155.stdout: link/ether b2:61:3c:c6:62:c7 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-10T08:47:32.291 INFO:teuthology.orchestra.run.smithi155.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-10T08:47:32.291 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:47:32.291 INFO:teuthology.orchestra.run.smithi155.stdout: inet6 fe80::b061:3cff:fec6:62c7/64 scope link 2024-09-10T08:47:32.291 INFO:teuthology.orchestra.run.smithi155.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:47:32.293 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-09-10T08:47:32.293 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T08:47:32.293 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-09-10T08:47:32.293 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-09-10T08:47:32.293 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-10T08:47:32.293 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-09-10T08:47:32.293 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-09-10T08:47:32.294 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-09-10T08:47:32.294 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-09-10T08:47:32.372 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:47:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:47:32.502 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:47:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:47:32.511 DEBUG:teuthology.orchestra.run.smithi155:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T08:47:32.511 DEBUG:teuthology.orchestra.run.smithi155:> set -e 2024-09-10T08:47:32.511 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set brx.1 up 2024-09-10T08:47:32.511 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link set dev brx.1 master ceph-brx 2024-09-10T08:47:32.511 DEBUG:teuthology.orchestra.run.smithi155:> ') 2024-09-10T08:47:32.596 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:47:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:47:32.677 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:47:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:47:32.685 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T08:47:32.685 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-09-10T08:47:32.721 INFO:teuthology.orchestra.run.smithi155.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-09-10T08:47:32.721 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T08:47:32.721 DEBUG:teuthology.orchestra.run.smithi155:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-09-10T08:47:32.796 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2024-09-10T08:47:32.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:47:32.797 DEBUG:teuthology.orchestra.run.smithi155:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,snapdirname=.customsnapkernel,nofallback 2024-09-10T08:47:32.925 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,snapdirname=.customsnapkernel,nofallback 2024-09-10T08:47:32.926 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes,snapdirname=.customsnapkernel". 2024-09-10T08:47:32.954 INFO:teuthology.orchestra.run.smithi155.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,snapdirname=.customsnapkernel,nofallback 2024-09-10T08:47:33.174 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes,snapdirname=.customsnapkernel". 2024-09-10T08:47:33.175 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: resolved to: "172.21.15.2:3300,172.21.15.155:3300,172.21.15.155:3301" 2024-09-10T08:47:33.175 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: trying mount with new device syntax: 3@f20a15a7-d363-4d44-98cb-4f4f466b52b8.cephfs=/ 2024-09-10T08:47:33.175 INFO:teuthology.orchestra.run.smithi155.stdout:mount.ceph: options "norequire_active_mds,norbytes,snapdirname=.customsnapkernel,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.2:3300/172.21.15.155:3300/172.21.15.155:3301" will pass to kernel 2024-09-10T08:47:33.176 INFO:teuthology.orchestra.run.smithi155.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-09-10T08:47:33.176 INFO:teuthology.orchestra.run.smithi155.stdout: You just mounted a file system that supports labels which does not 2024-09-10T08:47:33.176 INFO:teuthology.orchestra.run.smithi155.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T08:47:33.176 INFO:teuthology.orchestra.run.smithi155.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T08:47:33.176 INFO:teuthology.orchestra.run.smithi155.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T08:47:33.176 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T08:47:33.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:47:33.177 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-09-10T08:47:33.233 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T08:47:33.311 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:47:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:47:33.314 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:47:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:47:33.322 INFO:teuthology.orchestra.run.smithi155.stdout:client4663 2024-09-10T08:47:33.322 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-10T08:47:33.322 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:47:33.358 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T08:47:33.476 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:47:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:47:33.480 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:47:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:47:33.488 INFO:teuthology.orchestra.run.smithi155.stdout:client4663 2024-09-10T08:47:33.488 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T08:47:33.567 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:47:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:47:33.570 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:47:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:47:33.578 INFO:teuthology.orchestra.run.smithi155.stdout:client4663 2024-09-10T08:47:33.578 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/f20a15a7-d363-4d44-98cb-4f4f466b52b8.client4663/status') 2024-09-10T08:47:33.656 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:47:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:47:33.677 INFO:teuthology.orchestra.run.smithi155.stdout:instance: client.4663 (3)192.168.0.2:0/3486662362 2024-09-10T08:47:33.677 INFO:teuthology.orchestra.run.smithi155.stdout:blocklisted: false 2024-09-10T08:47:33.677 INFO:teuthology.orchestra.run.smithi155.stderr:0+1 records in 2024-09-10T08:47:33.677 INFO:teuthology.orchestra.run.smithi155.stderr:0+1 records out 2024-09-10T08:47:33.677 INFO:teuthology.orchestra.run.smithi155.stderr:69 bytes copied, 8.4605e-05 s, 816 kB/s 2024-09-10T08:47:33.679 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-10T08:47:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:47:33.687 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-09-10T08:47:33.718 INFO:tasks.cephfs_test_runner:Starting test: test_snap_dir_name (tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir) Test the correctness of snap directory name 2024-09-10T08:47:33.718 INFO:tasks.cephfs_test_runner:test_snap_dir_name (tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir) 2024-09-10T08:47:33.719 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:47:33.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:33.886+0000 7f8169800640 1 Processor -- start 2024-09-10T08:47:33.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:33.886+0000 7f8169800640 1 -- start start 2024-09-10T08:47:33.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:33.887+0000 7f8169800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8164145b20 0x7f81640af130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:33.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:33.887+0000 7f8169800640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f81640ad640 0x7f81640b30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:33.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:33.887+0000 7f8169800640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f816406eaf0 con 0x7f81640af670 2024-09-10T08:47:33.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:33.887+0000 7f8169800640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f816406f700 con 0x7f81640ad640 2024-09-10T08:47:33.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:33.887+0000 7f8169800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f816406edd0 con 0x7f8164145b20 2024-09-10T08:47:33.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:33.887+0000 7f8163e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8164145b20 0x7f81640af130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:33.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:33.887+0000 7f8163e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8164145b20 0x7f81640af130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.2:42240/0 (socket says 172.21.15.2:42240) 2024-09-10T08:47:33.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:33.887+0000 7f8163e00640 1 -- 172.21.15.2:0/3455966268 learned_addr learned my addr 172.21.15.2:0/3455966268 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:33.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:33.887+0000 7f8168e00640 1 --2- 172.21.15.2:0/3455966268 >> v2:172.21.15.155:3300/0 conn(0x7f81640ad640 0x7f81640b30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:33.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:33.888+0000 7f8163e00640 1 -- 172.21.15.2:0/3455966268 >> v2:172.21.15.155:3300/0 conn(0x7f81640ad640 msgr2=0x7f81640b30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:33.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:33.888+0000 7f8163e00640 1 --2- 172.21.15.2:0/3455966268 >> v2:172.21.15.155:3300/0 conn(0x7f81640ad640 0x7f81640b30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:33.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:33.888+0000 7f8163e00640 1 -- 172.21.15.2:0/3455966268 >> v1:172.21.15.155:6789/0 conn(0x7f81640af670 legacy=0x7f81640acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:33.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:33.888+0000 7f8163e00640 1 -- 172.21.15.2:0/3455966268 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f816406f0b0 con 0x7f8164145b20 2024-09-10T08:47:33.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:33.889+0000 7f8163e00640 1 --2- 172.21.15.2:0/3455966268 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8164145b20 0x7f81640af130 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8154009870 tx=0x7f815402a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a3908ef040fa11b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:33.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:33.889+0000 7f8163400640 1 -- 172.21.15.2:0/3455966268 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8154037070 con 0x7f8164145b20 2024-09-10T08:47:33.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:33.889+0000 7f8163400640 1 -- 172.21.15.2:0/3455966268 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8154032440 con 0x7f8164145b20 2024-09-10T08:47:33.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:33.889+0000 7f8163400640 1 -- 172.21.15.2:0/3455966268 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8154032810 con 0x7f8164145b20 2024-09-10T08:47:33.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:33.890+0000 7f8169800640 1 -- 172.21.15.2:0/3455966268 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8164145b20 msgr2=0x7f81640af130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:33.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:33.890+0000 7f8169800640 1 --2- 172.21.15.2:0/3455966268 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8164145b20 0x7f81640af130 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8154009870 tx=0x7f815402a250 comp rx=0 tx=0).stop 2024-09-10T08:47:33.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:33.890+0000 7f8169800640 1 -- 172.21.15.2:0/3455966268 shutdown_connections 2024-09-10T08:47:33.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:33.890+0000 7f8169800640 1 --2- 172.21.15.2:0/3455966268 >> v2:172.21.15.155:3300/0 conn(0x7f81640ad640 0x7f81640b30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:33.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:33.890+0000 7f8169800640 1 --2- 172.21.15.2:0/3455966268 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8164145b20 0x7f81640af130 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:33.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:33.890+0000 7f8169800640 1 -- 172.21.15.2:0/3455966268 >> 172.21.15.2:0/3455966268 conn(0x7f816406c210 msgr2=0x7f81640b1c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:33.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:33.890+0000 7f8169800640 1 -- 172.21.15.2:0/3455966268 shutdown_connections 2024-09-10T08:47:33.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:33.890+0000 7f8169800640 1 -- 172.21.15.2:0/3455966268 wait complete. 2024-09-10T08:47:33.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:33.891+0000 7f8169800640 1 Processor -- start 2024-09-10T08:47:33.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:33.892+0000 7f8169800640 1 -- start start 2024-09-10T08:47:33.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:33.892+0000 7f8169800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81640ad640 0x7f816415ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:33.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:33.892+0000 7f8169800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8164145b20 0x7f81641f8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:33.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:33.893+0000 7f8169800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f816413bb10 0x7f81641f4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:33.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:33.893+0000 7f8169800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f816406e6a0 con 0x7f81640ad640 2024-09-10T08:47:33.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:33.893+0000 7f8169800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8164145f00 con 0x7f816413bb10 2024-09-10T08:47:33.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:33.893+0000 7f8169800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f816406e820 con 0x7f8164145b20 2024-09-10T08:47:33.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:33.893+0000 7f8163e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81640ad640 0x7f816415ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:33.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:33.893+0000 7f8163e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81640ad640 0x7f816415ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51234/0 (socket says 172.21.15.2:51234) 2024-09-10T08:47:33.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:33.893+0000 7f8163e00640 1 -- 172.21.15.2:0/1919151632 learned_addr learned my addr 172.21.15.2:0/1919151632 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:33.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:33.893+0000 7f8168e00640 1 --2- 172.21.15.2:0/1919151632 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f816413bb10 0x7f81641f4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:33.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:33.893+0000 7f815be00640 1 --2- 172.21.15.2:0/1919151632 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8164145b20 0x7f81641f8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:33.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:33.893+0000 7f8163e00640 1 -- 172.21.15.2:0/1919151632 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8164145b20 msgr2=0x7f81641f8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:33.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:33.893+0000 7f8163e00640 1 --2- 172.21.15.2:0/1919151632 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8164145b20 0x7f81641f8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:33.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:33.893+0000 7f8163e00640 1 -- 172.21.15.2:0/1919151632 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f816413bb10 msgr2=0x7f81641f4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:33.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:33.893+0000 7f8163e00640 1 --2- 172.21.15.2:0/1919151632 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f816413bb10 0x7f81641f4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:33.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:33.893+0000 7f8163e00640 1 -- 172.21.15.2:0/1919151632 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8164158be0 con 0x7f81640ad640 2024-09-10T08:47:33.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:33.894+0000 7f8163e00640 1 --2- 172.21.15.2:0/1919151632 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81640ad640 0x7f816415ecd0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f81540090b0 tx=0x7f81540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:33.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:33.894+0000 7f8160c00640 1 -- 172.21.15.2:0/1919151632 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8154041030 con 0x7f81640ad640 2024-09-10T08:47:33.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:33.894+0000 7f8160c00640 1 -- 172.21.15.2:0/1919151632 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8154030440 con 0x7f81640ad640 2024-09-10T08:47:33.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:33.894+0000 7f8160c00640 1 -- 172.21.15.2:0/1919151632 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8154037040 con 0x7f81640ad640 2024-09-10T08:47:33.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:33.894+0000 7f8169800640 1 -- 172.21.15.2:0/1919151632 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f816413bf90 con 0x7f81640ad640 2024-09-10T08:47:33.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:33.894+0000 7f8169800640 1 -- 172.21.15.2:0/1919151632 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f816415f5e0 con 0x7f81640ad640 2024-09-10T08:47:33.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:33.895+0000 7f8169800640 1 -- 172.21.15.2:0/1919151632 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81640af130 con 0x7f81640ad640 2024-09-10T08:47:33.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:33.896+0000 7f8160c00640 1 -- 172.21.15.2:0/1919151632 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8154044070 con 0x7f81640ad640 2024-09-10T08:47:33.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:33.897+0000 7f8160c00640 1 --2- 172.21.15.2:0/1919151632 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f814006be30 0x7f814006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:33.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:33.897+0000 7f8160c00640 1 -- 172.21.15.2:0/1919151632 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f81540ab890 con 0x7f81640ad640 2024-09-10T08:47:33.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:33.898+0000 7f815be00640 1 --2- 172.21.15.2:0/1919151632 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f814006be30 0x7f814006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:33.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:33.899+0000 7f815be00640 1 --2- 172.21.15.2:0/1919151632 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f814006be30 0x7f814006e2f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f816409dbd0 tx=0x7f814c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:33.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:33.902+0000 7f8160c00640 1 -- 172.21.15.2:0/1919151632 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8154079e10 con 0x7f81640ad640 2024-09-10T08:47:34.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.087+0000 7f8169800640 1 -- 172.21.15.2:0/1919151632 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f81640b28a0 con 0x7f81640ad640 2024-09-10T08:47:34.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.089+0000 7f8160c00640 1 -- 172.21.15.2:0/1919151632 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18973 (secure 0 0 0) 0x7f8154079710 con 0x7f81640ad640 2024-09-10T08:47:34.089 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:47:34.090 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"fsid":"f20a15a7-d363-4d44-98cb-4f4f466b52b8","created":"2024-09-10T08:46:26.481619+0000","modified":"2024-09-10T08:47:32.517513+0000","last_up_change":"2024-09-10T08:46:39.323912+0000","last_in_change":"2024-09-10T08:46:29.499894+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:46:39.426180+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:46:49.214595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T08:46:50.168313+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T08:46:53.833162+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c90be333-506b-46d1-b00a-10d089a84776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6822","nonce":298678486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6823","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6826","nonce":298678486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6831","nonce":298678486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6829","nonce":298678486}]},"public_addr":"172.21.15.2:6822/298678486","cluster_addr":"172.21.15.2:6826/298678486","heartbeat_back_addr":"172.21.15.2:6831/298678486","heartbeat_front_addr":"172.21.15.2:6829/298678486","state":["exists","up"]},{"osd":1,"uuid":"3f8bdde8-6cd3-4112-8939-a876191c7368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6809","nonce":1619566025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6811","nonce":1619566025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6815","nonce":1619566025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6813","nonce":1619566025}]},"public_addr":"172.21.15.2:6809/1619566025","cluster_addr":"172.21.15.2:6811/1619566025","heartbeat_back_addr":"172.21.15.2:6815/1619566025","heartbeat_front_addr":"172.21.15.2:6813/1619566025","state":["exists","up"]},{"osd":2,"uuid":"3835f5ab-ed3a-4f46-ae6c-f0edf21708d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6801","nonce":3992427579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6803","nonce":3992427579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6807","nonce":3992427579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6805","nonce":3992427579}]},"public_addr":"172.21.15.2:6801/3992427579","cluster_addr":"172.21.15.2:6803/3992427579","heartbeat_back_addr":"172.21.15.2:6807/3992427579","heartbeat_front_addr":"172.21.15.2:6805/3992427579","state":["exists","up"]},{"osd":3,"uuid":"add6ad27-b411-4a82-9622-b0c1c1782cf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6817","nonce":1270626884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6819","nonce":1270626884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6827","nonce":1270626884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6824","nonce":1270626884}]},"public_addr":"172.21.15.2:6817/1270626884","cluster_addr":"172.21.15.2:6819/1270626884","heartbeat_back_addr":"172.21.15.2:6827/1270626884","heartbeat_front_addr":"172.21.15.2:6824/1270626884","state":["exists","up"]},{"osd":4,"uuid":"c7b642f4-8bd2-4262-9a82-ee1061cfab7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6803","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6806","nonce":553254873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6813","nonce":553254873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6822","nonce":553254873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6819","nonce":553254873}]},"public_addr":"172.21.15.155:6806/553254873","cluster_addr":"172.21.15.155:6813/553254873","heartbeat_back_addr":"172.21.15.155:6822/553254873","heartbeat_front_addr":"172.21.15.155:6819/553254873","state":["exists","up"]},{"osd":5,"uuid":"fb53289a-419f-46d8-9e3a-384ac529dc57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6805","nonce":2107688472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6811","nonce":2107688472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6823","nonce":2107688472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6817","nonce":2107688472}]},"public_addr":"172.21.15.155:6805/2107688472","cluster_addr":"172.21.15.155:6811/2107688472","heartbeat_back_addr":"172.21.15.155:6823/2107688472","heartbeat_front_addr":"172.21.15.155:6817/2107688472","state":["exists","up"]},{"osd":6,"uuid":"3f9ddd54-ede4-4565-aff6-ae1c07e7c678","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6825","nonce":944542383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6827","nonce":944542383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6831","nonce":944542383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6829","nonce":944542383}]},"public_addr":"172.21.15.155:6825/944542383","cluster_addr":"172.21.15.155:6827/944542383","heartbeat_back_addr":"172.21.15.155:6831/944542383","heartbeat_front_addr":"172.21.15.155:6829/944542383","state":["exists","up"]},{"osd":7,"uuid":"328d0681-eef4-4556-94e1-9745bd4adbe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6801","nonce":2220093913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6807","nonce":2220093913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6818","nonce":2220093913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6812","nonce":2220093913}]},"public_addr":"172.21.15.155:6801/2220093913","cluster_addr":"172.21.15.155:6807/2220093913","heartbeat_back_addr":"172.21.15.155:6818/2220093913","heartbeat_front_addr":"172.21.15.155:6812/2220093913","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.052980+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.104550+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.025661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:35.784354+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:35.863363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.322312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.100890+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:35.763584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:47:34.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.091+0000 7f8169800640 1 -- 172.21.15.2:0/1919151632 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f814006be30 msgr2=0x7f814006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:34.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.091+0000 7f8169800640 1 --2- 172.21.15.2:0/1919151632 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f814006be30 0x7f814006e2f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f816409dbd0 tx=0x7f814c009040 comp rx=0 tx=0).stop 2024-09-10T08:47:34.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.091+0000 7f8169800640 1 -- 172.21.15.2:0/1919151632 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81640ad640 msgr2=0x7f816415ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:34.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.091+0000 7f8169800640 1 --2- 172.21.15.2:0/1919151632 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81640ad640 0x7f816415ecd0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f81540090b0 tx=0x7f81540046c0 comp rx=0 tx=0).stop 2024-09-10T08:47:34.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.091+0000 7f8169800640 1 -- 172.21.15.2:0/1919151632 shutdown_connections 2024-09-10T08:47:34.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.091+0000 7f8169800640 1 --2- 172.21.15.2:0/1919151632 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f816413bb10 0x7f81641f4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:34.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.091+0000 7f8169800640 1 --2- 172.21.15.2:0/1919151632 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f814006be30 0x7f814006e2f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:34.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.091+0000 7f8169800640 1 --2- 172.21.15.2:0/1919151632 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8164145b20 0x7f81641f8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:34.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.091+0000 7f8169800640 1 --2- 172.21.15.2:0/1919151632 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81640ad640 0x7f816415ecd0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:34.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.091+0000 7f8169800640 1 -- 172.21.15.2:0/1919151632 >> 172.21.15.2:0/1919151632 conn(0x7f816406c210 msgr2=0x7f81640b4050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:34.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.092+0000 7f8169800640 1 -- 172.21.15.2:0/1919151632 shutdown_connections 2024-09-10T08:47:34.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.092+0000 7f8169800640 1 -- 172.21.15.2:0/1919151632 wait complete. 2024-09-10T08:47:34.108 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T08:46:39.426180+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-10T08:46:49.214595+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-10T08:46:50.168313+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-10T08:46:53.833162+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-10T08:47:34.108 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T08:47:34.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.267+0000 7f5c6f400640 1 Processor -- start 2024-09-10T08:47:34.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.267+0000 7f5c6f400640 1 -- start start 2024-09-10T08:47:34.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.268+0000 7f5c6f400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5c6809b150 0x7f5c68169520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:34.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.268+0000 7f5c6f400640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c680d08f0 con 0x7f5c6806eb00 2024-09-10T08:47:34.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.268+0000 7f5c6f400640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c680cda20 con 0x7f5c6815e6a0 2024-09-10T08:47:34.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.268+0000 7f5c6f400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5c680ce630 con 0x7f5c6809b150 2024-09-10T08:47:34.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.268+0000 7f5c67e00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f5c6806eb00 0x7f5c6809aa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:58244/0 (socket says 172.21.15.2:58244) 2024-09-10T08:47:34.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.268+0000 7f5c67e00640 1 -- 172.21.15.2:0/2176804583 learned_addr learned my addr 172.21.15.2:0/2176804583 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:47:34.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.268+0000 7f5c6d400640 1 --2- 172.21.15.2:0/2176804583 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5c6809b150 0x7f5c68169520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:34.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.269+0000 7f5c67400640 1 -- 172.21.15.2:0/2176804583 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 611178061 0 0) 0x7f5c680d08f0 con 0x7f5c6806eb00 2024-09-10T08:47:34.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.269+0000 7f5c67400640 1 -- 172.21.15.2:0/2176804583 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c50003520 con 0x7f5c6806eb00 2024-09-10T08:47:34.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.269+0000 7f5c67400640 1 -- 172.21.15.2:0/2176804583 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1451792190 0 0) 0x7f5c680cda20 con 0x7f5c6815e6a0 2024-09-10T08:47:34.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.269+0000 7f5c6d400640 1 -- 172.21.15.2:0/2176804583 >> v1:172.21.15.155:6789/0 conn(0x7f5c6815e6a0 legacy=0x7f5c680d01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:34.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.269+0000 7f5c6d400640 1 -- 172.21.15.2:0/2176804583 >> v1:172.21.15.2:6789/0 conn(0x7f5c6806eb00 legacy=0x7f5c6809aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:34.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.269+0000 7f5c6d400640 1 -- 172.21.15.2:0/2176804583 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c680cdd00 con 0x7f5c6809b150 2024-09-10T08:47:34.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.270+0000 7f5c6d400640 1 --2- 172.21.15.2:0/2176804583 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5c6809b150 0x7f5c68169520 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5c60009dc0 tx=0x7f5c6002a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4c6833ab68b949e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:34.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.270+0000 7f5c67400640 1 -- 172.21.15.2:0/2176804583 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c60007740 con 0x7f5c6809b150 2024-09-10T08:47:34.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.270+0000 7f5c67400640 1 -- 172.21.15.2:0/2176804583 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c600078e0 con 0x7f5c6809b150 2024-09-10T08:47:34.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.270+0000 7f5c67400640 1 -- 172.21.15.2:0/2176804583 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c60007cb0 con 0x7f5c6809b150 2024-09-10T08:47:34.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.271+0000 7f5c6f400640 1 -- 172.21.15.2:0/2176804583 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5c6809b150 msgr2=0x7f5c68169520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:34.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.271+0000 7f5c6f400640 1 --2- 172.21.15.2:0/2176804583 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5c6809b150 0x7f5c68169520 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5c60009dc0 tx=0x7f5c6002a6d0 comp rx=0 tx=0).stop 2024-09-10T08:47:34.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.271+0000 7f5c6f400640 1 -- 172.21.15.2:0/2176804583 shutdown_connections 2024-09-10T08:47:34.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.271+0000 7f5c6f400640 1 --2- 172.21.15.2:0/2176804583 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5c6809b150 0x7f5c68169520 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:34.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.271+0000 7f5c6f400640 1 -- 172.21.15.2:0/2176804583 >> 172.21.15.2:0/2176804583 conn(0x7f5c680b3ed0 msgr2=0x7f5c680b42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:34.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.271+0000 7f5c6f400640 1 -- 172.21.15.2:0/2176804583 shutdown_connections 2024-09-10T08:47:34.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.271+0000 7f5c6f400640 1 -- 172.21.15.2:0/2176804583 wait complete. 2024-09-10T08:47:34.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.272+0000 7f5c6f400640 1 Processor -- start 2024-09-10T08:47:34.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.273+0000 7f5c6f400640 1 -- start start 2024-09-10T08:47:34.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.273+0000 7f5c6f400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5c6806eb00 0x7f5c681f4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:34.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.273+0000 7f5c6f400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c6809b150 0x7f5c6815b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:34.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.274+0000 7f5c6f400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5c6815e6a0 0x7f5c6815b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:34.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.274+0000 7f5c6f400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f5c6815ea80 con 0x7f5c6809b150 2024-09-10T08:47:34.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.274+0000 7f5c6f400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5c680ce2c0 con 0x7f5c6806eb00 2024-09-10T08:47:34.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.274+0000 7f5c6f400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f5c680cd4b0 con 0x7f5c6815e6a0 2024-09-10T08:47:34.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.274+0000 7f5c67e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c6809b150 0x7f5c6815b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:34.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.274+0000 7f5c67e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c6809b150 0x7f5c6815b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51242/0 (socket says 172.21.15.2:51242) 2024-09-10T08:47:34.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.274+0000 7f5c67e00640 1 -- 172.21.15.2:0/733770173 learned_addr learned my addr 172.21.15.2:0/733770173 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:34.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.274+0000 7f5c6d400640 1 --2- 172.21.15.2:0/733770173 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5c6815e6a0 0x7f5c6815b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:34.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.274+0000 7f5c6ca00640 1 --2- 172.21.15.2:0/733770173 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5c6806eb00 0x7f5c681f4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:34.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.274+0000 7f5c67e00640 1 -- 172.21.15.2:0/733770173 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5c6815e6a0 msgr2=0x7f5c6815b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:34.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.274+0000 7f5c67e00640 1 --2- 172.21.15.2:0/733770173 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5c6815e6a0 0x7f5c6815b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:34.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.274+0000 7f5c67e00640 1 -- 172.21.15.2:0/733770173 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5c6806eb00 msgr2=0x7f5c681f4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:34.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.274+0000 7f5c67e00640 1 --2- 172.21.15.2:0/733770173 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5c6806eb00 0x7f5c681f4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:34.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.274+0000 7f5c67e00640 1 -- 172.21.15.2:0/733770173 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c681f50f0 con 0x7f5c6809b150 2024-09-10T08:47:34.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.274+0000 7f5c6d400640 1 --2- 172.21.15.2:0/733770173 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5c6815e6a0 0x7f5c6815b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:47:34.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.275+0000 7f5c67e00640 1 --2- 172.21.15.2:0/733770173 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c6809b150 0x7f5c6815b020 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5c5400c430 tx=0x7f5c5400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:34.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.275+0000 7f5c64c00640 1 -- 172.21.15.2:0/733770173 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c54017070 con 0x7f5c6809b150 2024-09-10T08:47:34.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.275+0000 7f5c64c00640 1 -- 172.21.15.2:0/733770173 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c54005d00 con 0x7f5c6809b150 2024-09-10T08:47:34.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.275+0000 7f5c64c00640 1 -- 172.21.15.2:0/733770173 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c54007310 con 0x7f5c6809b150 2024-09-10T08:47:34.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.275+0000 7f5c6f400640 1 -- 172.21.15.2:0/733770173 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c68161bc0 con 0x7f5c6809b150 2024-09-10T08:47:34.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.275+0000 7f5c6f400640 1 -- 172.21.15.2:0/733770173 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c68160e00 con 0x7f5c6809b150 2024-09-10T08:47:34.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.276+0000 7f5c6f400640 1 -- 172.21.15.2:0/733770173 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c6809aa40 con 0x7f5c6809b150 2024-09-10T08:47:34.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.277+0000 7f5c64c00640 1 -- 172.21.15.2:0/733770173 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5c5401a070 con 0x7f5c6809b150 2024-09-10T08:47:34.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.278+0000 7f5c64c00640 1 --2- 172.21.15.2:0/733770173 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f5c4806be30 0x7f5c4806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:34.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.278+0000 7f5c64c00640 1 -- 172.21.15.2:0/733770173 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f5c5408a6b0 con 0x7f5c6809b150 2024-09-10T08:47:34.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.278+0000 7f5c6ca00640 1 --2- 172.21.15.2:0/733770173 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f5c4806be30 0x7f5c4806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:34.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.279+0000 7f5c6ca00640 1 --2- 172.21.15.2:0/733770173 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f5c4806be30 0x7f5c4806e2f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5c681f1d20 tx=0x7f5c5c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:34.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.282+0000 7f5c64c00640 1 -- 172.21.15.2:0/733770173 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5c681f50f0 con 0x7f5c6809b150 2024-09-10T08:47:34.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.469+0000 7f5c6f400640 1 -- 172.21.15.2:0/733770173 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5c680b8360 con 0x7f5c6809b150 2024-09-10T08:47:34.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.469+0000 7f5c64c00640 1 -- 172.21.15.2:0/733770173 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7f5c540585e0 con 0x7f5c6809b150 2024-09-10T08:47:34.470 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2024-09-10T08:47:34.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.471+0000 7f5c6f400640 1 -- 172.21.15.2:0/733770173 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f5c4806be30 msgr2=0x7f5c4806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:34.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.471+0000 7f5c6f400640 1 --2- 172.21.15.2:0/733770173 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f5c4806be30 0x7f5c4806e2f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5c681f1d20 tx=0x7f5c5c009040 comp rx=0 tx=0).stop 2024-09-10T08:47:34.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.472+0000 7f5c6f400640 1 -- 172.21.15.2:0/733770173 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c6809b150 msgr2=0x7f5c6815b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:34.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.472+0000 7f5c6f400640 1 --2- 172.21.15.2:0/733770173 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c6809b150 0x7f5c6815b020 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5c5400c430 tx=0x7f5c5400c8f0 comp rx=0 tx=0).stop 2024-09-10T08:47:34.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.472+0000 7f5c6f400640 1 -- 172.21.15.2:0/733770173 shutdown_connections 2024-09-10T08:47:34.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.472+0000 7f5c6f400640 1 --2- 172.21.15.2:0/733770173 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f5c4806be30 0x7f5c4806e2f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:34.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.472+0000 7f5c6f400640 1 --2- 172.21.15.2:0/733770173 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5c6815e6a0 0x7f5c6815b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:34.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.472+0000 7f5c6f400640 1 --2- 172.21.15.2:0/733770173 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5c6809b150 0x7f5c6815b020 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:34.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.472+0000 7f5c6f400640 1 --2- 172.21.15.2:0/733770173 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5c6806eb00 0x7f5c681f4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:34.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.472+0000 7f5c6f400640 1 -- 172.21.15.2:0/733770173 >> 172.21.15.2:0/733770173 conn(0x7f5c680b3ed0 msgr2=0x7f5c680d0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:34.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.472+0000 7f5c6f400640 1 -- 172.21.15.2:0/733770173 shutdown_connections 2024-09-10T08:47:34.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.472+0000 7f5c6f400640 1 -- 172.21.15.2:0/733770173 wait complete. 2024-09-10T08:47:34.488 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-10T08:47:34.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.648+0000 7f9e0d400640 1 Processor -- start 2024-09-10T08:47:34.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.648+0000 7f9e0d400640 1 -- start start 2024-09-10T08:47:34.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.649+0000 7f9e0d400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9e0815c460 0x7f9e0815d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:34.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.649+0000 7f9e0d400640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9e0806df50 0x7f9e080cec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:34.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.649+0000 7f9e0d400640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e080cf580 con 0x7f9e080cf140 2024-09-10T08:47:34.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.649+0000 7f9e0d400640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f9e08161030 con 0x7f9e0815c460 2024-09-10T08:47:34.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.649+0000 7f9e0d400640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f9e0815da70 con 0x7f9e0806df50 2024-09-10T08:47:34.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.649+0000 7f9e06800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9e0815c460 0x7f9e0815d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:34.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.649+0000 7f9e06800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9e0815c460 0x7f9e0815d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51254/0 (socket says 172.21.15.2:51254) 2024-09-10T08:47:34.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.649+0000 7f9e06800640 1 -- 172.21.15.2:0/3764596830 learned_addr learned my addr 172.21.15.2:0/3764596830 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:34.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.650+0000 7f9e05e00640 1 --2- 172.21.15.2:0/3764596830 >> v2:172.21.15.155:3300/0 conn(0x7f9e0806df50 0x7f9e080cec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:34.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.650+0000 7f9e06800640 1 -- 172.21.15.2:0/3764596830 >> v2:172.21.15.155:3300/0 conn(0x7f9e0806df50 msgr2=0x7f9e080cec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:34.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.650+0000 7f9e06800640 1 --2- 172.21.15.2:0/3764596830 >> v2:172.21.15.155:3300/0 conn(0x7f9e0806df50 0x7f9e080cec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:34.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.650+0000 7f9e06800640 1 -- 172.21.15.2:0/3764596830 >> v1:172.21.15.155:6789/0 conn(0x7f9e080cf140 legacy=0x7f9e080ccc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:34.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.650+0000 7f9e06800640 1 -- 172.21.15.2:0/3764596830 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e081603b0 con 0x7f9e0815c460 2024-09-10T08:47:34.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.651+0000 7f9e06800640 1 --2- 172.21.15.2:0/3764596830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e0815c460 0x7f9e0815d530 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9e080cc870 tx=0x7f9df802a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2994c39ba519cb66 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:34.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.651+0000 7f9e05400640 1 -- 172.21.15.2:0/3764596830 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df8037070 con 0x7f9e0815c460 2024-09-10T08:47:34.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.651+0000 7f9e05400640 1 -- 172.21.15.2:0/3764596830 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9df8032440 con 0x7f9e0815c460 2024-09-10T08:47:34.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.651+0000 7f9e05400640 1 -- 172.21.15.2:0/3764596830 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df8032810 con 0x7f9e0815c460 2024-09-10T08:47:34.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.652+0000 7f9e0d400640 1 -- 172.21.15.2:0/3764596830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e0815c460 msgr2=0x7f9e0815d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:34.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.652+0000 7f9e0d400640 1 --2- 172.21.15.2:0/3764596830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e0815c460 0x7f9e0815d530 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9e080cc870 tx=0x7f9df802a2a0 comp rx=0 tx=0).stop 2024-09-10T08:47:34.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.652+0000 7f9e0d400640 1 -- 172.21.15.2:0/3764596830 shutdown_connections 2024-09-10T08:47:34.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.652+0000 7f9e0d400640 1 --2- 172.21.15.2:0/3764596830 >> v2:172.21.15.155:3300/0 conn(0x7f9e0806df50 0x7f9e080cec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:34.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.652+0000 7f9e0d400640 1 --2- 172.21.15.2:0/3764596830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e0815c460 0x7f9e0815d530 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:34.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.652+0000 7f9e0d400640 1 -- 172.21.15.2:0/3764596830 >> 172.21.15.2:0/3764596830 conn(0x7f9e080d02c0 msgr2=0x7f9e080d06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:34.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.652+0000 7f9e0d400640 1 -- 172.21.15.2:0/3764596830 shutdown_connections 2024-09-10T08:47:34.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.652+0000 7f9e0d400640 1 -- 172.21.15.2:0/3764596830 wait complete. 2024-09-10T08:47:34.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.653+0000 7f9e0d400640 1 Processor -- start 2024-09-10T08:47:34.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.654+0000 7f9e0d400640 1 -- start start 2024-09-10T08:47:34.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.654+0000 7f9e0d400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e0806df50 0x7f9e0809de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:34.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.655+0000 7f9e0d400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e080cf140 0x7f9e08156da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:34.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.655+0000 7f9e0d400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e0815c460 0x7f9e0815a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:34.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.655+0000 7f9e0d400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9e08160c50 con 0x7f9e0806df50 2024-09-10T08:47:34.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.655+0000 7f9e0d400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9e08160970 con 0x7f9e0815c460 2024-09-10T08:47:34.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.655+0000 7f9e0d400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9e08160080 con 0x7f9e080cf140 2024-09-10T08:47:34.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.655+0000 7f9e06800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e0806df50 0x7f9e0809de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:34.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.655+0000 7f9e06800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e0806df50 0x7f9e0809de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51264/0 (socket says 172.21.15.2:51264) 2024-09-10T08:47:34.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.655+0000 7f9e06800640 1 -- 172.21.15.2:0/3386293041 learned_addr learned my addr 172.21.15.2:0/3386293041 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:34.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.655+0000 7f9e05e00640 1 --2- 172.21.15.2:0/3386293041 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e080cf140 0x7f9e08156da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:34.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.655+0000 7f9e07200640 1 --2- 172.21.15.2:0/3386293041 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e0815c460 0x7f9e0815a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:34.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.655+0000 7f9e06800640 1 -- 172.21.15.2:0/3386293041 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e080cf140 msgr2=0x7f9e08156da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:34.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.655+0000 7f9e06800640 1 --2- 172.21.15.2:0/3386293041 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e080cf140 0x7f9e08156da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:34.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.655+0000 7f9e06800640 1 -- 172.21.15.2:0/3386293041 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e0815c460 msgr2=0x7f9e0815a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:34.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.655+0000 7f9e06800640 1 --2- 172.21.15.2:0/3386293041 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e0815c460 0x7f9e0815a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:34.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.655+0000 7f9e06800640 1 -- 172.21.15.2:0/3386293041 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e0809ad70 con 0x7f9e0806df50 2024-09-10T08:47:34.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.656+0000 7f9e06800640 1 --2- 172.21.15.2:0/3386293041 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e0806df50 0x7f9e0809de40 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9df8000c00 tx=0x7f9df80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:34.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.656+0000 7f9dfea00640 1 -- 172.21.15.2:0/3386293041 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df8041020 con 0x7f9e0806df50 2024-09-10T08:47:34.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.656+0000 7f9dfea00640 1 -- 172.21.15.2:0/3386293041 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9df80306c0 con 0x7f9e0806df50 2024-09-10T08:47:34.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.656+0000 7f9e0d400640 1 -- 172.21.15.2:0/3386293041 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e0809b050 con 0x7f9e0806df50 2024-09-10T08:47:34.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.656+0000 7f9dfea00640 1 -- 172.21.15.2:0/3386293041 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df8037040 con 0x7f9e0806df50 2024-09-10T08:47:34.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.656+0000 7f9e0d400640 1 -- 172.21.15.2:0/3386293041 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e081572e0 con 0x7f9e0806df50 2024-09-10T08:47:34.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.657+0000 7f9e0d400640 1 -- 172.21.15.2:0/3386293041 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e0815c840 con 0x7f9e0806df50 2024-09-10T08:47:34.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.658+0000 7f9dfea00640 1 -- 172.21.15.2:0/3386293041 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9df8044020 con 0x7f9e0806df50 2024-09-10T08:47:34.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.659+0000 7f9dfea00640 1 --2- 172.21.15.2:0/3386293041 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f9de806be30 0x7f9de806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:34.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.659+0000 7f9dfea00640 1 -- 172.21.15.2:0/3386293041 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f9df80aba90 con 0x7f9e0806df50 2024-09-10T08:47:34.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.659+0000 7f9e05e00640 1 --2- 172.21.15.2:0/3386293041 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f9de806be30 0x7f9de806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:34.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.660+0000 7f9e05e00640 1 --2- 172.21.15.2:0/3386293041 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f9de806be30 0x7f9de806e2f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9e08157f90 tx=0x7f9df4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:34.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.664+0000 7f9dfea00640 1 -- 172.21.15.2:0/3386293041 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9df804b030 con 0x7f9e0806df50 2024-09-10T08:47:34.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.847+0000 7f9e0d400640 1 -- 172.21.15.2:0/3386293041 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f9e080cdea0 con 0x7f9e0806df50 2024-09-10T08:47:34.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.848+0000 7f9dfea00640 1 -- 172.21.15.2:0/3386293041 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f9df8079930 con 0x7f9e0806df50 2024-09-10T08:47:34.848 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2024-09-10T08:47:34.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.850+0000 7f9e0d400640 1 -- 172.21.15.2:0/3386293041 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f9de806be30 msgr2=0x7f9de806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:34.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.850+0000 7f9e0d400640 1 --2- 172.21.15.2:0/3386293041 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f9de806be30 0x7f9de806e2f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9e08157f90 tx=0x7f9df4008040 comp rx=0 tx=0).stop 2024-09-10T08:47:34.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.850+0000 7f9e0d400640 1 -- 172.21.15.2:0/3386293041 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e0806df50 msgr2=0x7f9e0809de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:34.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.850+0000 7f9e0d400640 1 --2- 172.21.15.2:0/3386293041 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e0806df50 0x7f9e0809de40 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9df8000c00 tx=0x7f9df80046c0 comp rx=0 tx=0).stop 2024-09-10T08:47:34.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.850+0000 7f9e0d400640 1 -- 172.21.15.2:0/3386293041 shutdown_connections 2024-09-10T08:47:34.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.850+0000 7f9e0d400640 1 --2- 172.21.15.2:0/3386293041 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e0815c460 0x7f9e0815a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:34.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.850+0000 7f9e0d400640 1 --2- 172.21.15.2:0/3386293041 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f9de806be30 0x7f9de806e2f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:34.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.850+0000 7f9e0d400640 1 --2- 172.21.15.2:0/3386293041 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e080cf140 0x7f9e08156da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:34.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.850+0000 7f9e0d400640 1 --2- 172.21.15.2:0/3386293041 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e0806df50 0x7f9e0809de40 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:34.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.850+0000 7f9e0d400640 1 -- 172.21.15.2:0/3386293041 >> 172.21.15.2:0/3386293041 conn(0x7f9e080d02c0 msgr2=0x7f9e080b4a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:34.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.851+0000 7f9e0d400640 1 -- 172.21.15.2:0/3386293041 shutdown_connections 2024-09-10T08:47:34.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:34.851+0000 7f9e0d400640 1 -- 172.21.15.2:0/3386293041 wait complete. 2024-09-10T08:47:34.867 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-10T08:47:35.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.026+0000 7f0e73400640 1 Processor -- start 2024-09-10T08:47:35.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.026+0000 7f0e73400640 1 -- start start 2024-09-10T08:47:35.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.027+0000 7f0e73400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0e6c0d2d30 0x7f0e6c0cf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:35.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.027+0000 7f0e73400640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0e6c0cf6f0 0x7f0e6c06d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:35.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.027+0000 7f0e73400640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e6c0cfe50 con 0x7f0e6c161ca0 2024-09-10T08:47:35.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.027+0000 7f0e73400640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f0e6c0d34a0 con 0x7f0e6c0d2d30 2024-09-10T08:47:35.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.027+0000 7f0e73400640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f0e6c06cdf0 con 0x7f0e6c0cf6f0 2024-09-10T08:47:35.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.027+0000 7f0e6be00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0e6c0d2d30 0x7f0e6c0cf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:35.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.027+0000 7f0e70a00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f0e6c161ca0 0x7f0e6c0d2620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:58256/0 (socket says 172.21.15.2:58256) 2024-09-10T08:47:35.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.027+0000 7f0e70a00640 1 -- 172.21.15.2:0/2719902106 learned_addr learned my addr 172.21.15.2:0/2719902106 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:47:35.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.027+0000 7f0e71400640 1 --2- 172.21.15.2:0/2719902106 >> v2:172.21.15.155:3300/0 conn(0x7f0e6c0cf6f0 0x7f0e6c06d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:35.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.028+0000 7f0e6be00640 1 -- 172.21.15.2:0/2719902106 >> v2:172.21.15.155:3300/0 conn(0x7f0e6c0cf6f0 msgr2=0x7f0e6c06d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:35.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.028+0000 7f0e6be00640 1 --2- 172.21.15.2:0/2719902106 >> v2:172.21.15.155:3300/0 conn(0x7f0e6c0cf6f0 0x7f0e6c06d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:35.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.028+0000 7f0e6be00640 1 -- 172.21.15.2:0/2719902106 >> v1:172.21.15.2:6789/0 conn(0x7f0e6c161ca0 legacy=0x7f0e6c0d2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:35.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.028+0000 7f0e6be00640 1 -- 172.21.15.2:0/2719902106 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e6c0d0130 con 0x7f0e6c0d2d30 2024-09-10T08:47:35.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.028+0000 7f0e71400640 1 --2- 172.21.15.2:0/2719902106 >> v2:172.21.15.155:3300/0 conn(0x7f0e6c0cf6f0 0x7f0e6c06d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:47:35.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.028+0000 7f0e6b400640 1 -- 172.21.15.2:0/2719902106 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3443982027 0 0) 0x7f0e6c0cfe50 con 0x7f0e6c161ca0 2024-09-10T08:47:35.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.029+0000 7f0e6be00640 1 --2- 172.21.15.2:0/2719902106 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e6c0d2d30 0x7f0e6c0cf1b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c08e580 tx=0x7f0e5802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7f8a9d9cccf2573 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:35.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.029+0000 7f0e6b400640 1 -- 172.21.15.2:0/2719902106 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e58037070 con 0x7f0e6c0d2d30 2024-09-10T08:47:35.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.029+0000 7f0e6b400640 1 -- 172.21.15.2:0/2719902106 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e58032440 con 0x7f0e6c0d2d30 2024-09-10T08:47:35.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.029+0000 7f0e6b400640 1 -- 172.21.15.2:0/2719902106 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e5802ae60 con 0x7f0e6c0d2d30 2024-09-10T08:47:35.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.029+0000 7f0e73400640 1 -- 172.21.15.2:0/2719902106 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e6c0d2d30 msgr2=0x7f0e6c0cf1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:35.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.029+0000 7f0e73400640 1 --2- 172.21.15.2:0/2719902106 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e6c0d2d30 0x7f0e6c0cf1b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c08e580 tx=0x7f0e5802a110 comp rx=0 tx=0).stop 2024-09-10T08:47:35.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.030+0000 7f0e73400640 1 -- 172.21.15.2:0/2719902106 shutdown_connections 2024-09-10T08:47:35.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.030+0000 7f0e73400640 1 --2- 172.21.15.2:0/2719902106 >> v2:172.21.15.155:3300/0 conn(0x7f0e6c0cf6f0 0x7f0e6c06d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:35.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.030+0000 7f0e73400640 1 --2- 172.21.15.2:0/2719902106 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e6c0d2d30 0x7f0e6c0cf1b0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:35.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.030+0000 7f0e73400640 1 -- 172.21.15.2:0/2719902106 >> 172.21.15.2:0/2719902106 conn(0x7f0e6c08bfd0 msgr2=0x7f0e6c0d45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:35.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.030+0000 7f0e73400640 1 -- 172.21.15.2:0/2719902106 shutdown_connections 2024-09-10T08:47:35.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.030+0000 7f0e73400640 1 -- 172.21.15.2:0/2719902106 wait complete. 2024-09-10T08:47:35.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.031+0000 7f0e73400640 1 Processor -- start 2024-09-10T08:47:35.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.031+0000 7f0e73400640 1 -- start start 2024-09-10T08:47:35.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.032+0000 7f0e73400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e6c0cf6f0 0x7f0e6c0c80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:35.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.032+0000 7f0e73400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e6c0d2d30 0x7f0e6c0b15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:35.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.032+0000 7f0e73400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e6c161ca0 0x7f0e6c0b1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:35.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.032+0000 7f0e73400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0e6c0cfb60 con 0x7f0e6c161ca0 2024-09-10T08:47:35.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.032+0000 7f0e73400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0e6c06d040 con 0x7f0e6c0d2d30 2024-09-10T08:47:35.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.032+0000 7f0e73400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f0e6c06daa0 con 0x7f0e6c0cf6f0 2024-09-10T08:47:35.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.033+0000 7f0e71400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e6c161ca0 0x7f0e6c0b1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:35.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.033+0000 7f0e71400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e6c161ca0 0x7f0e6c0b1b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51272/0 (socket says 172.21.15.2:51272) 2024-09-10T08:47:35.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.033+0000 7f0e71400640 1 -- 172.21.15.2:0/1260629158 learned_addr learned my addr 172.21.15.2:0/1260629158 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:35.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.033+0000 7f0e6be00640 1 --2- 172.21.15.2:0/1260629158 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e6c0d2d30 0x7f0e6c0b15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:35.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.033+0000 7f0e70a00640 1 --2- 172.21.15.2:0/1260629158 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e6c0cf6f0 0x7f0e6c0c80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:35.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.033+0000 7f0e71400640 1 -- 172.21.15.2:0/1260629158 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e6c0cf6f0 msgr2=0x7f0e6c0c80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:35.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.033+0000 7f0e71400640 1 --2- 172.21.15.2:0/1260629158 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e6c0cf6f0 0x7f0e6c0c80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:35.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.033+0000 7f0e71400640 1 -- 172.21.15.2:0/1260629158 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e6c0d2d30 msgr2=0x7f0e6c0b15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:35.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.033+0000 7f0e71400640 1 --2- 172.21.15.2:0/1260629158 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e6c0d2d30 0x7f0e6c0b15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:35.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.033+0000 7f0e71400640 1 -- 172.21.15.2:0/1260629158 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e6c0b8900 con 0x7f0e6c161ca0 2024-09-10T08:47:35.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.033+0000 7f0e6be00640 1 --2- 172.21.15.2:0/1260629158 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e6c0d2d30 0x7f0e6c0b15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:47:35.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.033+0000 7f0e70a00640 1 --2- 172.21.15.2:0/1260629158 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e6c0cf6f0 0x7f0e6c0c80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:47:35.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.033+0000 7f0e71400640 1 --2- 172.21.15.2:0/1260629158 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e6c161ca0 0x7f0e6c0b1b20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0e64007ef0 tx=0x7f0e6400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:35.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.033+0000 7f0e68c00640 1 -- 172.21.15.2:0/1260629158 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e6401a070 con 0x7f0e6c161ca0 2024-09-10T08:47:35.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.034+0000 7f0e68c00640 1 -- 172.21.15.2:0/1260629158 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e64003b90 con 0x7f0e6c161ca0 2024-09-10T08:47:35.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.034+0000 7f0e68c00640 1 -- 172.21.15.2:0/1260629158 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e64004030 con 0x7f0e6c161ca0 2024-09-10T08:47:35.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.034+0000 7f0e73400640 1 -- 172.21.15.2:0/1260629158 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e6c0ccb50 con 0x7f0e6c161ca0 2024-09-10T08:47:35.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.034+0000 7f0e73400640 1 -- 172.21.15.2:0/1260629158 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e6c0b8ba0 con 0x7f0e6c161ca0 2024-09-10T08:47:35.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.035+0000 7f0e73400640 1 -- 172.21.15.2:0/1260629158 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e6c06d560 con 0x7f0e6c161ca0 2024-09-10T08:47:35.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.036+0000 7f0e68c00640 1 -- 172.21.15.2:0/1260629158 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0e6401d070 con 0x7f0e6c161ca0 2024-09-10T08:47:35.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.037+0000 7f0e68c00640 1 --2- 172.21.15.2:0/1260629158 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f0e4c06be30 0x7f0e4c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:35.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.037+0000 7f0e68c00640 1 -- 172.21.15.2:0/1260629158 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f0e6408b440 con 0x7f0e6c161ca0 2024-09-10T08:47:35.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.037+0000 7f0e70a00640 1 --2- 172.21.15.2:0/1260629158 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f0e4c06be30 0x7f0e4c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:35.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.038+0000 7f0e70a00640 1 --2- 172.21.15.2:0/1260629158 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f0e4c06be30 0x7f0e4c06e2f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0e60000f60 tx=0x7f0e60009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:35.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.041+0000 7f0e68c00640 1 -- 172.21.15.2:0/1260629158 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0e64010070 con 0x7f0e6c161ca0 2024-09-10T08:47:35.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.226+0000 7f0e73400640 1 -- 172.21.15.2:0/1260629158 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f0e6c0c8610 con 0x7f0e6c161ca0 2024-09-10T08:47:35.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.226+0000 7f0e68c00640 1 -- 172.21.15.2:0/1260629158 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7f0e64059370 con 0x7f0e6c161ca0 2024-09-10T08:47:35.226 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2024-09-10T08:47:35.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.229+0000 7f0e73400640 1 -- 172.21.15.2:0/1260629158 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f0e4c06be30 msgr2=0x7f0e4c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:35.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.229+0000 7f0e73400640 1 --2- 172.21.15.2:0/1260629158 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f0e4c06be30 0x7f0e4c06e2f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0e60000f60 tx=0x7f0e60009040 comp rx=0 tx=0).stop 2024-09-10T08:47:35.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.229+0000 7f0e73400640 1 -- 172.21.15.2:0/1260629158 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e6c161ca0 msgr2=0x7f0e6c0b1b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:35.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.229+0000 7f0e73400640 1 --2- 172.21.15.2:0/1260629158 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e6c161ca0 0x7f0e6c0b1b20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0e64007ef0 tx=0x7f0e6400d4a0 comp rx=0 tx=0).stop 2024-09-10T08:47:35.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.229+0000 7f0e73400640 1 -- 172.21.15.2:0/1260629158 shutdown_connections 2024-09-10T08:47:35.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.229+0000 7f0e73400640 1 --2- 172.21.15.2:0/1260629158 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0e6c161ca0 0x7f0e6c0b1b20 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:35.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.229+0000 7f0e73400640 1 --2- 172.21.15.2:0/1260629158 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e6c0d2d30 0x7f0e6c0b15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:35.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.229+0000 7f0e73400640 1 --2- 172.21.15.2:0/1260629158 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f0e4c06be30 0x7f0e4c06e2f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:35.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.229+0000 7f0e73400640 1 --2- 172.21.15.2:0/1260629158 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0e6c0cf6f0 0x7f0e6c0c80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:35.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.229+0000 7f0e73400640 1 -- 172.21.15.2:0/1260629158 >> 172.21.15.2:0/1260629158 conn(0x7f0e6c08bfd0 msgr2=0x7f0e6c0d0780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:35.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.229+0000 7f0e73400640 1 -- 172.21.15.2:0/1260629158 shutdown_connections 2024-09-10T08:47:35.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.229+0000 7f0e73400640 1 -- 172.21.15.2:0/1260629158 wait complete. 2024-09-10T08:47:35.246 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-10T08:47:35.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.405+0000 7f2d89400640 1 Processor -- start 2024-09-10T08:47:35.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.405+0000 7f2d89400640 1 -- start start 2024-09-10T08:47:35.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.406+0000 7f2d89400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d840cf310 0x7f2d8415d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:35.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.406+0000 7f2d89400640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f2d8406df50 0x7f2d840b43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:35.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.406+0000 7f2d89400640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d841603b0 con 0x7f2d8415c460 2024-09-10T08:47:35.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.406+0000 7f2d89400640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f2d84161030 con 0x7f2d840cf310 2024-09-10T08:47:35.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.406+0000 7f2d89400640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f2d8415da70 con 0x7f2d8406df50 2024-09-10T08:47:35.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.406+0000 7f2d79e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d840cf310 0x7f2d8415d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:35.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.406+0000 7f2d79e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2d840cf310 0x7f2d8415d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51282/0 (socket says 172.21.15.2:51282) 2024-09-10T08:47:35.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.406+0000 7f2d79e00640 1 -- 172.21.15.2:0/1696673533 learned_addr learned my addr 172.21.15.2:0/1696673533 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:35.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.406+0000 7f2d83200640 1 --2- 172.21.15.2:0/1696673533 >> v2:172.21.15.155:3300/0 conn(0x7f2d8406df50 0x7f2d840b43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:35.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.407+0000 7f2d79e00640 1 -- 172.21.15.2:0/1696673533 >> v2:172.21.15.155:3300/0 conn(0x7f2d8406df50 msgr2=0x7f2d840b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:35.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.407+0000 7f2d79e00640 1 --2- 172.21.15.2:0/1696673533 >> v2:172.21.15.155:3300/0 conn(0x7f2d8406df50 0x7f2d840b43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:35.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.407+0000 7f2d79e00640 1 -- 172.21.15.2:0/1696673533 >> v1:172.21.15.155:6789/0 conn(0x7f2d8415c460 legacy=0x7f2d840cec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:35.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.407+0000 7f2d79e00640 1 -- 172.21.15.2:0/1696673533 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d84160690 con 0x7f2d840cf310 2024-09-10T08:47:35.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.408+0000 7f2d79e00640 1 --2- 172.21.15.2:0/1696673533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d840cf310 0x7f2d8415d530 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2d840ccaa0 tx=0x7f2d6c02a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba46ea5ca2702226 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:35.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.408+0000 7f2d81e00640 1 -- 172.21.15.2:0/1696673533 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d6c037070 con 0x7f2d840cf310 2024-09-10T08:47:35.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.408+0000 7f2d81e00640 1 -- 172.21.15.2:0/1696673533 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d6c032440 con 0x7f2d840cf310 2024-09-10T08:47:35.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.408+0000 7f2d81e00640 1 -- 172.21.15.2:0/1696673533 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d6c032810 con 0x7f2d840cf310 2024-09-10T08:47:35.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.408+0000 7f2d89400640 1 -- 172.21.15.2:0/1696673533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d840cf310 msgr2=0x7f2d8415d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:35.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.408+0000 7f2d89400640 1 --2- 172.21.15.2:0/1696673533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d840cf310 0x7f2d8415d530 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2d840ccaa0 tx=0x7f2d6c02a2a0 comp rx=0 tx=0).stop 2024-09-10T08:47:35.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.409+0000 7f2d89400640 1 -- 172.21.15.2:0/1696673533 shutdown_connections 2024-09-10T08:47:35.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.409+0000 7f2d89400640 1 --2- 172.21.15.2:0/1696673533 >> v2:172.21.15.155:3300/0 conn(0x7f2d8406df50 0x7f2d840b43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:35.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.409+0000 7f2d89400640 1 --2- 172.21.15.2:0/1696673533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d840cf310 0x7f2d8415d530 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:35.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.409+0000 7f2d89400640 1 -- 172.21.15.2:0/1696673533 >> 172.21.15.2:0/1696673533 conn(0x7f2d840d02c0 msgr2=0x7f2d840d06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:35.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.409+0000 7f2d89400640 1 -- 172.21.15.2:0/1696673533 shutdown_connections 2024-09-10T08:47:35.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.409+0000 7f2d89400640 1 -- 172.21.15.2:0/1696673533 wait complete. 2024-09-10T08:47:35.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.410+0000 7f2d89400640 1 Processor -- start 2024-09-10T08:47:35.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.410+0000 7f2d89400640 1 -- start start 2024-09-10T08:47:35.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.411+0000 7f2d89400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d8406df50 0x7f2d841497f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:35.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.411+0000 7f2d89400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d840cf310 0x7f2d841565d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:35.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.411+0000 7f2d89400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d8415c460 0x7f2d84072be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:35.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.411+0000 7f2d89400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2d84160080 con 0x7f2d8406df50 2024-09-10T08:47:35.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.411+0000 7f2d89400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2d84160c50 con 0x7f2d840cf310 2024-09-10T08:47:35.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.411+0000 7f2d89400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2d8415c840 con 0x7f2d8415c460 2024-09-10T08:47:35.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.412+0000 7f2d82800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d8406df50 0x7f2d841497f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:35.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.412+0000 7f2d82800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d8406df50 0x7f2d841497f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51292/0 (socket says 172.21.15.2:51292) 2024-09-10T08:47:35.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.412+0000 7f2d82800640 1 -- 172.21.15.2:0/1653887772 learned_addr learned my addr 172.21.15.2:0/1653887772 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:35.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.412+0000 7f2d79e00640 1 --2- 172.21.15.2:0/1653887772 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d840cf310 0x7f2d841565d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:35.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.412+0000 7f2d83200640 1 --2- 172.21.15.2:0/1653887772 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d8415c460 0x7f2d84072be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:35.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.412+0000 7f2d82800640 1 -- 172.21.15.2:0/1653887772 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d8415c460 msgr2=0x7f2d84072be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:35.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.412+0000 7f2d82800640 1 --2- 172.21.15.2:0/1653887772 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d8415c460 0x7f2d84072be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:35.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.412+0000 7f2d82800640 1 -- 172.21.15.2:0/1653887772 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d840cf310 msgr2=0x7f2d841565d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:35.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.412+0000 7f2d82800640 1 --2- 172.21.15.2:0/1653887772 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d840cf310 0x7f2d841565d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:35.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.412+0000 7f2d82800640 1 -- 172.21.15.2:0/1653887772 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d8409df30 con 0x7f2d8406df50 2024-09-10T08:47:35.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.412+0000 7f2d79e00640 1 --2- 172.21.15.2:0/1653887772 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d840cf310 0x7f2d841565d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:47:35.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.412+0000 7f2d83200640 1 --2- 172.21.15.2:0/1653887772 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d8415c460 0x7f2d84072be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:47:35.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.412+0000 7f2d82800640 1 --2- 172.21.15.2:0/1653887772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d8406df50 0x7f2d841497f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2d7400c460 tx=0x7f2d7400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:35.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.413+0000 7f2d7b400640 1 -- 172.21.15.2:0/1653887772 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d740052d0 con 0x7f2d8406df50 2024-09-10T08:47:35.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.413+0000 7f2d7b400640 1 -- 172.21.15.2:0/1653887772 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d74012630 con 0x7f2d8406df50 2024-09-10T08:47:35.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.413+0000 7f2d7b400640 1 -- 172.21.15.2:0/1653887772 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d740054b0 con 0x7f2d8406df50 2024-09-10T08:47:35.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.413+0000 7f2d89400640 1 -- 172.21.15.2:0/1653887772 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d8409ae70 con 0x7f2d8406df50 2024-09-10T08:47:35.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.413+0000 7f2d89400640 1 -- 172.21.15.2:0/1653887772 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d8409b4c0 con 0x7f2d8406df50 2024-09-10T08:47:35.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.414+0000 7f2d89400640 1 -- 172.21.15.2:0/1653887772 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d8415f7c0 con 0x7f2d8406df50 2024-09-10T08:47:35.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.415+0000 7f2d7b400640 1 -- 172.21.15.2:0/1653887772 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2d74012a20 con 0x7f2d8406df50 2024-09-10T08:47:35.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.416+0000 7f2d7b400640 1 --2- 172.21.15.2:0/1653887772 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f2d6006be30 0x7f2d6006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:35.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.416+0000 7f2d7b400640 1 -- 172.21.15.2:0/1653887772 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f2d7408ae40 con 0x7f2d8406df50 2024-09-10T08:47:35.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.416+0000 7f2d79e00640 1 --2- 172.21.15.2:0/1653887772 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f2d6006be30 0x7f2d6006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:35.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.417+0000 7f2d79e00640 1 --2- 172.21.15.2:0/1653887772 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f2d6006be30 0x7f2d6006e2f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c034000 tx=0x7f2d6c02e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:35.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.420+0000 7f2d7b400640 1 -- 172.21.15.2:0/1653887772 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2d740593c0 con 0x7f2d8406df50 2024-09-10T08:47:35.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.602+0000 7f2d89400640 1 -- 172.21.15.2:0/1653887772 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f2d8415f4e0 con 0x7f2d8406df50 2024-09-10T08:47:35.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.603+0000 7f2d7b400640 1 -- 172.21.15.2:0/1653887772 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7f2d74058cc0 con 0x7f2d8406df50 2024-09-10T08:47:35.603 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2024-09-10T08:47:35.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.605+0000 7f2d89400640 1 -- 172.21.15.2:0/1653887772 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f2d6006be30 msgr2=0x7f2d6006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:35.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.605+0000 7f2d89400640 1 --2- 172.21.15.2:0/1653887772 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f2d6006be30 0x7f2d6006e2f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c034000 tx=0x7f2d6c02e000 comp rx=0 tx=0).stop 2024-09-10T08:47:35.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.605+0000 7f2d89400640 1 -- 172.21.15.2:0/1653887772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d8406df50 msgr2=0x7f2d841497f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:35.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.605+0000 7f2d89400640 1 --2- 172.21.15.2:0/1653887772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d8406df50 0x7f2d841497f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2d7400c460 tx=0x7f2d7400c920 comp rx=0 tx=0).stop 2024-09-10T08:47:35.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.605+0000 7f2d89400640 1 -- 172.21.15.2:0/1653887772 shutdown_connections 2024-09-10T08:47:35.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.605+0000 7f2d89400640 1 --2- 172.21.15.2:0/1653887772 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f2d6006be30 0x7f2d6006e2f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:35.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.605+0000 7f2d89400640 1 --2- 172.21.15.2:0/1653887772 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d8415c460 0x7f2d84072be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:35.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.605+0000 7f2d89400640 1 --2- 172.21.15.2:0/1653887772 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d840cf310 0x7f2d841565d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:35.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.605+0000 7f2d89400640 1 --2- 172.21.15.2:0/1653887772 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2d8406df50 0x7f2d841497f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:35.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.605+0000 7f2d89400640 1 -- 172.21.15.2:0/1653887772 >> 172.21.15.2:0/1653887772 conn(0x7f2d840d02c0 msgr2=0x7f2d840cd310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:35.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.605+0000 7f2d89400640 1 -- 172.21.15.2:0/1653887772 shutdown_connections 2024-09-10T08:47:35.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.605+0000 7f2d89400640 1 -- 172.21.15.2:0/1653887772 wait complete. 2024-09-10T08:47:35.621 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name' 2024-09-10T08:47:35.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.777+0000 7f7de9a00640 1 Processor -- start 2024-09-10T08:47:35.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.777+0000 7f7de9a00640 1 -- start start 2024-09-10T08:47:35.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.779+0000 7f7de9a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7de4144250 0x7f7de40cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:35.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.779+0000 7f7de9a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7de40cd480 0x7f7de40ce420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:35.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.779+0000 7f7de9a00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7de406f540 con 0x7f7de4144c90 2024-09-10T08:47:35.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.779+0000 7f7de9a00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f7de406f820 con 0x7f7de4144250 2024-09-10T08:47:35.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.779+0000 7f7de9a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7de406fb00 con 0x7f7de40cd480 2024-09-10T08:47:35.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.779+0000 7f7de2a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7de4144250 0x7f7de40cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:35.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.779+0000 7f7de2a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7de4144250 0x7f7de40cf8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51306/0 (socket says 172.21.15.2:51306) 2024-09-10T08:47:35.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.779+0000 7f7de2a00640 1 -- 172.21.15.2:0/3426070320 learned_addr learned my addr 172.21.15.2:0/3426070320 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:35.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.779+0000 7f7de3400640 1 --2- 172.21.15.2:0/3426070320 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7de40cd480 0x7f7de40ce420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:35.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.779+0000 7f7de2a00640 1 -- 172.21.15.2:0/3426070320 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7de40cd480 msgr2=0x7f7de40ce420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:35.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.779+0000 7f7de2a00640 1 --2- 172.21.15.2:0/3426070320 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7de40cd480 0x7f7de40ce420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:35.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.779+0000 7f7de2a00640 1 -- 172.21.15.2:0/3426070320 >> v1:172.21.15.155:6789/0 conn(0x7f7de4144c90 legacy=0x7f7de40ccd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:35.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.779+0000 7f7de2a00640 1 -- 172.21.15.2:0/3426070320 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7de406fde0 con 0x7f7de4144250 2024-09-10T08:47:35.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.780+0000 7f7de2a00640 1 --2- 172.21.15.2:0/3426070320 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7de4144250 0x7f7de40cf8d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7dd4009870 tx=0x7f7dd402a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1100dc085b0d1ab server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:35.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.781+0000 7f7de2000640 1 -- 172.21.15.2:0/3426070320 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd4037070 con 0x7f7de4144250 2024-09-10T08:47:35.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.781+0000 7f7de2000640 1 -- 172.21.15.2:0/3426070320 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dd4032440 con 0x7f7de4144250 2024-09-10T08:47:35.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.781+0000 7f7de2000640 1 -- 172.21.15.2:0/3426070320 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd4032810 con 0x7f7de4144250 2024-09-10T08:47:35.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.781+0000 7f7de9a00640 1 -- 172.21.15.2:0/3426070320 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7de4144250 msgr2=0x7f7de40cf8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:35.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.781+0000 7f7de9a00640 1 --2- 172.21.15.2:0/3426070320 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7de4144250 0x7f7de40cf8d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7dd4009870 tx=0x7f7dd402a250 comp rx=0 tx=0).stop 2024-09-10T08:47:35.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.781+0000 7f7de9a00640 1 -- 172.21.15.2:0/3426070320 shutdown_connections 2024-09-10T08:47:35.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.781+0000 7f7de9a00640 1 --2- 172.21.15.2:0/3426070320 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7de40cd480 0x7f7de40ce420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:35.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.781+0000 7f7de9a00640 1 --2- 172.21.15.2:0/3426070320 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7de4144250 0x7f7de40cf8d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:35.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.781+0000 7f7de9a00640 1 -- 172.21.15.2:0/3426070320 >> 172.21.15.2:0/3426070320 conn(0x7f7de406bc10 msgr2=0x7f7de406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:35.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.781+0000 7f7de9a00640 1 -- 172.21.15.2:0/3426070320 shutdown_connections 2024-09-10T08:47:35.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.781+0000 7f7de9a00640 1 -- 172.21.15.2:0/3426070320 wait complete. 2024-09-10T08:47:35.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.783+0000 7f7de9a00640 1 Processor -- start 2024-09-10T08:47:35.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.783+0000 7f7de9a00640 1 -- start start 2024-09-10T08:47:35.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.784+0000 7f7de9a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7de40cd480 0x7f7de415e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:35.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.784+0000 7f7de9a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7de4144250 0x7f7de415a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:35.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.784+0000 7f7de9a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7de4144c90 0x7f7de413cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:35.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.784+0000 7f7de9a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f7de40b3390 con 0x7f7de40cd480 2024-09-10T08:47:35.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.784+0000 7f7de9a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7de40cfe10 con 0x7f7de4144c90 2024-09-10T08:47:35.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.784+0000 7f7de9a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f7de40ce960 con 0x7f7de4144250 2024-09-10T08:47:35.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.784+0000 7f7de2a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7de40cd480 0x7f7de415e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:35.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.784+0000 7f7de2a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7de40cd480 0x7f7de415e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51322/0 (socket says 172.21.15.2:51322) 2024-09-10T08:47:35.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.784+0000 7f7de2a00640 1 -- 172.21.15.2:0/3735815447 learned_addr learned my addr 172.21.15.2:0/3735815447 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:35.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.784+0000 7f7de3400640 1 --2- 172.21.15.2:0/3735815447 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7de4144c90 0x7f7de413cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:35.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.784+0000 7f7ddbe00640 1 --2- 172.21.15.2:0/3735815447 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7de4144250 0x7f7de415a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:35.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.785+0000 7f7de2a00640 1 -- 172.21.15.2:0/3735815447 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7de4144250 msgr2=0x7f7de415a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:35.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.785+0000 7f7de2a00640 1 --2- 172.21.15.2:0/3735815447 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7de4144250 0x7f7de415a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:35.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.785+0000 7f7de2a00640 1 -- 172.21.15.2:0/3735815447 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7de4144c90 msgr2=0x7f7de413cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:35.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.785+0000 7f7de2a00640 1 --2- 172.21.15.2:0/3735815447 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7de4144c90 0x7f7de413cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:35.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.785+0000 7f7de2a00640 1 -- 172.21.15.2:0/3735815447 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7de413e7e0 con 0x7f7de40cd480 2024-09-10T08:47:35.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.785+0000 7f7de2a00640 1 --2- 172.21.15.2:0/3735815447 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7de40cd480 0x7f7de415e4d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7dd4009870 tx=0x7f7dd40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:35.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.785+0000 7f7ddaa00640 1 -- 172.21.15.2:0/3735815447 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd4041020 con 0x7f7de40cd480 2024-09-10T08:47:35.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.785+0000 7f7ddaa00640 1 -- 172.21.15.2:0/3735815447 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dd40306c0 con 0x7f7de40cd480 2024-09-10T08:47:35.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.785+0000 7f7ddaa00640 1 -- 172.21.15.2:0/3735815447 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd4037040 con 0x7f7de40cd480 2024-09-10T08:47:35.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.785+0000 7f7de9a00640 1 -- 172.21.15.2:0/3735815447 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7de413d740 con 0x7f7de40cd480 2024-09-10T08:47:35.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.785+0000 7f7de9a00640 1 -- 172.21.15.2:0/3735815447 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7de413dd00 con 0x7f7de40cd480 2024-09-10T08:47:35.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.786+0000 7f7de9a00640 1 -- 172.21.15.2:0/3735815447 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7de40ce420 con 0x7f7de40cd480 2024-09-10T08:47:35.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.787+0000 7f7ddaa00640 1 -- 172.21.15.2:0/3735815447 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7dd4044020 con 0x7f7de40cd480 2024-09-10T08:47:35.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.788+0000 7f7ddaa00640 1 --2- 172.21.15.2:0/3735815447 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f7dc006be30 0x7f7dc006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:35.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.788+0000 7f7ddaa00640 1 -- 172.21.15.2:0/3735815447 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f7dd40ab9b0 con 0x7f7de40cd480 2024-09-10T08:47:35.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.789+0000 7f7ddbe00640 1 --2- 172.21.15.2:0/3735815447 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f7dc006be30 0x7f7dc006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:35.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.790+0000 7f7ddbe00640 1 --2- 172.21.15.2:0/3735815447 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f7dc006be30 0x7f7dc006e2f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7de40b3120 tx=0x7f7dcc009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:35.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:35.793+0000 7f7ddaa00640 1 -- 172.21.15.2:0/3735815447 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7dd404b030 con 0x7f7de40cd480 2024-09-10T08:47:36.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.049+0000 7f7de9a00640 1 -- 172.21.15.2:0/3735815447 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]} v 0) -- 0x7f7de415ae60 con 0x7f7de40cd480 2024-09-10T08:47:36.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.538+0000 7f7ddaa00640 1 -- 172.21.15.2:0/3735815447 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]}]=0 v59) ==== 158+0+0 (secure 0 0 0) 0x7f7dd40798e0 con 0x7f7de40cd480 2024-09-10T08:47:36.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.541+0000 7f7de9a00640 1 -- 172.21.15.2:0/3735815447 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f7dc006be30 msgr2=0x7f7dc006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:36.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.541+0000 7f7de9a00640 1 --2- 172.21.15.2:0/3735815447 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f7dc006be30 0x7f7dc006e2f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7de40b3120 tx=0x7f7dcc009040 comp rx=0 tx=0).stop 2024-09-10T08:47:36.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.541+0000 7f7de9a00640 1 -- 172.21.15.2:0/3735815447 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7de40cd480 msgr2=0x7f7de415e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:36.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.541+0000 7f7de9a00640 1 --2- 172.21.15.2:0/3735815447 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7de40cd480 0x7f7de415e4d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7dd4009870 tx=0x7f7dd40046c0 comp rx=0 tx=0).stop 2024-09-10T08:47:36.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.541+0000 7f7de9a00640 1 -- 172.21.15.2:0/3735815447 shutdown_connections 2024-09-10T08:47:36.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.541+0000 7f7de9a00640 1 --2- 172.21.15.2:0/3735815447 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7de4144c90 0x7f7de413cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:36.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.541+0000 7f7de9a00640 1 --2- 172.21.15.2:0/3735815447 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f7dc006be30 0x7f7dc006e2f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:36.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.541+0000 7f7de9a00640 1 --2- 172.21.15.2:0/3735815447 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7de4144250 0x7f7de415a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:36.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.541+0000 7f7de9a00640 1 --2- 172.21.15.2:0/3735815447 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7de40cd480 0x7f7de415e4d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:36.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.541+0000 7f7de9a00640 1 -- 172.21.15.2:0/3735815447 >> 172.21.15.2:0/3735815447 conn(0x7f7de406bc10 msgr2=0x7f7de406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:36.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.541+0000 7f7de9a00640 1 -- 172.21.15.2:0/3735815447 shutdown_connections 2024-09-10T08:47:36.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.541+0000 7f7de9a00640 1 -- 172.21.15.2:0/3735815447 wait complete. 2024-09-10T08:47:36.559 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-10T08:47:36.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.722+0000 7f274cc00640 1 Processor -- start 2024-09-10T08:47:36.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.723+0000 7f274cc00640 1 -- start start 2024-09-10T08:47:36.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.724+0000 7f274cc00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f274806f770 0x7f27480cf6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:36.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.724+0000 7f274cc00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27480ad390 con 0x7f27480af590 2024-09-10T08:47:36.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.724+0000 7f274cc00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27480ad670 con 0x7f274815b4c0 2024-09-10T08:47:36.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.724+0000 7f274cc00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f27480d1130 con 0x7f274806f770 2024-09-10T08:47:36.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.724+0000 7f273fe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f274806f770 0x7f27480cf6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:36.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.724+0000 7f2746800640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f27480af590 0x7f27480ae150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33282/0 (socket says 172.21.15.2:33282) 2024-09-10T08:47:36.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.724+0000 7f2746800640 1 -- 172.21.15.2:0/257754455 learned_addr learned my addr 172.21.15.2:0/257754455 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:47:36.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.725+0000 7f273fe00640 1 -- 172.21.15.2:0/257754455 >> v1:172.21.15.155:6789/0 conn(0x7f274815b4c0 legacy=0x7f274806f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:36.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.725+0000 7f273fe00640 1 -- 172.21.15.2:0/257754455 >> v1:172.21.15.2:6789/0 conn(0x7f27480af590 legacy=0x7f27480ae150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:36.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.725+0000 7f273fe00640 1 -- 172.21.15.2:0/257754455 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27480ad950 con 0x7f274806f770 2024-09-10T08:47:36.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.726+0000 7f273fe00640 1 --2- 172.21.15.2:0/257754455 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f274806f770 0x7f27480cf6d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f27300097a0 tx=0x7f273002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b15633a65f5be4b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:36.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.726+0000 7f2745400640 1 -- 172.21.15.2:0/257754455 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2730037070 con 0x7f274806f770 2024-09-10T08:47:36.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.726+0000 7f2745400640 1 -- 172.21.15.2:0/257754455 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2730032440 con 0x7f274806f770 2024-09-10T08:47:36.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.726+0000 7f2745400640 1 -- 172.21.15.2:0/257754455 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2730032810 con 0x7f274806f770 2024-09-10T08:47:36.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.726+0000 7f274cc00640 1 -- 172.21.15.2:0/257754455 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f274806f770 msgr2=0x7f27480cf6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:36.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.726+0000 7f274cc00640 1 --2- 172.21.15.2:0/257754455 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f274806f770 0x7f27480cf6d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f27300097a0 tx=0x7f273002a1a0 comp rx=0 tx=0).stop 2024-09-10T08:47:36.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.726+0000 7f274cc00640 1 -- 172.21.15.2:0/257754455 shutdown_connections 2024-09-10T08:47:36.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.726+0000 7f274cc00640 1 --2- 172.21.15.2:0/257754455 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f274806f770 0x7f27480cf6d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:36.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.726+0000 7f274cc00640 1 -- 172.21.15.2:0/257754455 >> 172.21.15.2:0/257754455 conn(0x7f27480d02c0 msgr2=0x7f27480d06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:36.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.726+0000 7f274cc00640 1 -- 172.21.15.2:0/257754455 shutdown_connections 2024-09-10T08:47:36.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.726+0000 7f274cc00640 1 -- 172.21.15.2:0/257754455 wait complete. 2024-09-10T08:47:36.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.728+0000 7f274cc00640 1 Processor -- start 2024-09-10T08:47:36.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.728+0000 7f274cc00640 1 -- start start 2024-09-10T08:47:36.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.729+0000 7f274cc00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f274806f770 0x7f27481f4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:36.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.729+0000 7f274cc00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27480af590 0x7f2748157590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:36.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.729+0000 7f274cc00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f274815b4c0 0x7f2748152fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:36.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.729+0000 7f274cc00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f27480af9c0 con 0x7f274806f770 2024-09-10T08:47:36.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.729+0000 7f274cc00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f27480ad140 con 0x7f274815b4c0 2024-09-10T08:47:36.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.729+0000 7f274cc00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2748071ef0 con 0x7f27480af590 2024-09-10T08:47:36.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.729+0000 7f2745e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f274806f770 0x7f27481f4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:36.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.729+0000 7f2745e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f274806f770 0x7f27481f4fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60216/0 (socket says 172.21.15.2:60216) 2024-09-10T08:47:36.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.729+0000 7f2745e00640 1 -- 172.21.15.2:0/3234689226 learned_addr learned my addr 172.21.15.2:0/3234689226 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:36.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.729+0000 7f2746800640 1 --2- 172.21.15.2:0/3234689226 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f274815b4c0 0x7f2748152fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:36.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.729+0000 7f273fe00640 1 --2- 172.21.15.2:0/3234689226 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27480af590 0x7f2748157590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:36.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.730+0000 7f2745e00640 1 -- 172.21.15.2:0/3234689226 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27480af590 msgr2=0x7f2748157590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:36.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.730+0000 7f2745e00640 1 --2- 172.21.15.2:0/3234689226 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27480af590 0x7f2748157590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:36.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.730+0000 7f2745e00640 1 -- 172.21.15.2:0/3234689226 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f274815b4c0 msgr2=0x7f2748152fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:36.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.730+0000 7f2745e00640 1 --2- 172.21.15.2:0/3234689226 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f274815b4c0 0x7f2748152fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:36.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.730+0000 7f2745e00640 1 -- 172.21.15.2:0/3234689226 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2748154040 con 0x7f274806f770 2024-09-10T08:47:36.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.730+0000 7f2745e00640 1 --2- 172.21.15.2:0/3234689226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f274806f770 0x7f27481f4fb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f273800c3f0 tx=0x7f273800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:36.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.730+0000 7f273e000640 1 -- 172.21.15.2:0/3234689226 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27380052d0 con 0x7f274806f770 2024-09-10T08:47:36.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.730+0000 7f273e000640 1 -- 172.21.15.2:0/3234689226 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2738005490 con 0x7f274806f770 2024-09-10T08:47:36.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.730+0000 7f273e000640 1 -- 172.21.15.2:0/3234689226 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2738007260 con 0x7f274806f770 2024-09-10T08:47:36.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.730+0000 7f274cc00640 1 -- 172.21.15.2:0/3234689226 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2748153a80 con 0x7f274806f770 2024-09-10T08:47:36.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.730+0000 7f274cc00640 1 -- 172.21.15.2:0/3234689226 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2748151310 con 0x7f274806f770 2024-09-10T08:47:36.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.732+0000 7f274cc00640 1 -- 172.21.15.2:0/3234689226 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f274815b8a0 con 0x7f274806f770 2024-09-10T08:47:36.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.732+0000 7f273e000640 1 -- 172.21.15.2:0/3234689226 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2738007400 con 0x7f274806f770 2024-09-10T08:47:36.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.733+0000 7f273e000640 1 --2- 172.21.15.2:0/3234689226 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f272406be30 0x7f272406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:36.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.733+0000 7f273e000640 1 -- 172.21.15.2:0/3234689226 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f273808a7f0 con 0x7f274806f770 2024-09-10T08:47:36.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.734+0000 7f273fe00640 1 --2- 172.21.15.2:0/3234689226 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f272406be30 0x7f272406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:36.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.734+0000 7f273fe00640 1 --2- 172.21.15.2:0/3234689226 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f272406be30 0x7f272406e2f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2730034000 tx=0x7f273002e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:36.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.738+0000 7f273e000640 1 -- 172.21.15.2:0/3234689226 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2738058600 con 0x7f274806f770 2024-09-10T08:47:36.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.924+0000 7f274cc00640 1 -- 172.21.15.2:0/3234689226 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f27480b1cb0 con 0x7f274806f770 2024-09-10T08:47:36.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.927+0000 7f273e000640 1 -- 172.21.15.2:0/3234689226 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f273805c900 con 0x7f274806f770 2024-09-10T08:47:36.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.930+0000 7f274cc00640 1 -- 172.21.15.2:0/3234689226 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f272406be30 msgr2=0x7f272406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:36.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.930+0000 7f274cc00640 1 --2- 172.21.15.2:0/3234689226 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f272406be30 0x7f272406e2f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2730034000 tx=0x7f273002e000 comp rx=0 tx=0).stop 2024-09-10T08:47:36.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.930+0000 7f274cc00640 1 -- 172.21.15.2:0/3234689226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f274806f770 msgr2=0x7f27481f4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:36.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.930+0000 7f274cc00640 1 --2- 172.21.15.2:0/3234689226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f274806f770 0x7f27481f4fb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f273800c3f0 tx=0x7f273800c8b0 comp rx=0 tx=0).stop 2024-09-10T08:47:36.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.930+0000 7f274cc00640 1 -- 172.21.15.2:0/3234689226 shutdown_connections 2024-09-10T08:47:36.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.930+0000 7f274cc00640 1 --2- 172.21.15.2:0/3234689226 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f274815b4c0 0x7f2748152fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:36.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.930+0000 7f274cc00640 1 --2- 172.21.15.2:0/3234689226 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f272406be30 0x7f272406e2f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:36.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.930+0000 7f274cc00640 1 --2- 172.21.15.2:0/3234689226 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27480af590 0x7f2748157590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:36.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.930+0000 7f274cc00640 1 --2- 172.21.15.2:0/3234689226 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f274806f770 0x7f27481f4fb0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:36.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.930+0000 7f274cc00640 1 -- 172.21.15.2:0/3234689226 >> 172.21.15.2:0/3234689226 conn(0x7f27480d02c0 msgr2=0x7f27480ae050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:36.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.930+0000 7f274cc00640 1 -- 172.21.15.2:0/3234689226 shutdown_connections 2024-09-10T08:47:36.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:36.930+0000 7f274cc00640 1 -- 172.21.15.2:0/3234689226 wait complete. 2024-09-10T08:47:36.946 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T08:47:36.947 DEBUG:teuthology.orchestra.run.smithi002:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T08:47:37.050 DEBUG:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T08:47:37.149 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T08:47:37.150 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T08:47:37.150 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:47:37.185 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T08:47:37.186 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:47:37.261 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T08:47:37.262 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:47:37.338 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T08:47:37.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:37.536+0000 7fbba1a00640 1 Processor -- start 2024-09-10T08:47:37.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:37.536+0000 7fbba1a00640 1 -- start start 2024-09-10T08:47:37.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:37.537+0000 7fbba1a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb9c0d4d90 0x7fbb9c0cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:37.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:37.537+0000 7fbba1a00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb9c0d0350 con 0x7fbb9c0d0b50 2024-09-10T08:47:37.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:37.537+0000 7fbba1a00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb9c0d2080 con 0x7fbb9c15e500 2024-09-10T08:47:37.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:37.537+0000 7fbba1a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fbb9c15e8e0 con 0x7fbb9c0d4d90 2024-09-10T08:47:37.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:37.537+0000 7fbba1000640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fbb9c0d0b50 0x7fbb9c0b7240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33294/0 (socket says 172.21.15.2:33294) 2024-09-10T08:47:37.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:37.537+0000 7fbba1000640 1 -- 172.21.15.2:0/245595728 learned_addr learned my addr 172.21.15.2:0/245595728 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:47:37.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:37.538+0000 7fbb9b400640 1 --2- 172.21.15.2:0/245595728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb9c0d4d90 0x7fbb9c0cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:37.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:37.538+0000 7fbb9aa00640 1 -- 172.21.15.2:0/245595728 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2081616832 0 0) 0x7fbb9c0d2080 con 0x7fbb9c15e500 2024-09-10T08:47:37.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:37.538+0000 7fbb9aa00640 1 -- 172.21.15.2:0/245595728 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb80003520 con 0x7fbb9c15e500 2024-09-10T08:47:37.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:37.538+0000 7fbb9aa00640 1 -- 172.21.15.2:0/245595728 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1311894318 0 0) 0x7fbb9c0d0350 con 0x7fbb9c0d0b50 2024-09-10T08:47:37.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:37.538+0000 7fbb9b400640 1 -- 172.21.15.2:0/245595728 >> v1:172.21.15.155:6789/0 conn(0x7fbb9c15e500 legacy=0x7fbb9c0d2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:37.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:37.538+0000 7fbb9b400640 1 -- 172.21.15.2:0/245595728 >> v1:172.21.15.2:6789/0 conn(0x7fbb9c0d0b50 legacy=0x7fbb9c0b7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:37.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:37.538+0000 7fbb9b400640 1 -- 172.21.15.2:0/245595728 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb9c0d2360 con 0x7fbb9c0d4d90 2024-09-10T08:47:37.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:37.539+0000 7fbb9b400640 1 --2- 172.21.15.2:0/245595728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb9c0d4d90 0x7fbb9c0cefb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fbb880097d0 tx=0x7fbb8802a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6955d1695cf9394a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:37.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:37.545+0000 7fbb9aa00640 1 -- 172.21.15.2:0/245595728 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb88037070 con 0x7fbb9c0d4d90 2024-09-10T08:47:37.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:37.545+0000 7fbb9aa00640 1 -- 172.21.15.2:0/245595728 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb88032440 con 0x7fbb9c0d4d90 2024-09-10T08:47:37.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:37.545+0000 7fbb9aa00640 1 -- 172.21.15.2:0/245595728 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb88032810 con 0x7fbb9c0d4d90 2024-09-10T08:47:37.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:37.545+0000 7fbba1a00640 1 -- 172.21.15.2:0/245595728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb9c0d4d90 msgr2=0x7fbb9c0cefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:37.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:37.545+0000 7fbba1a00640 1 --2- 172.21.15.2:0/245595728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb9c0d4d90 0x7fbb9c0cefb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fbb880097d0 tx=0x7fbb8802a1c0 comp rx=0 tx=0).stop 2024-09-10T08:47:37.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:37.545+0000 7fbba1a00640 1 -- 172.21.15.2:0/245595728 shutdown_connections 2024-09-10T08:47:37.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:37.545+0000 7fbba1a00640 1 --2- 172.21.15.2:0/245595728 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb9c0d4d90 0x7fbb9c0cefb0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:37.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:37.545+0000 7fbba1a00640 1 -- 172.21.15.2:0/245595728 >> 172.21.15.2:0/245595728 conn(0x7fbb9c09d720 msgr2=0x7fbb9c0d4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:37.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:37.546+0000 7fbba1a00640 1 -- 172.21.15.2:0/245595728 shutdown_connections 2024-09-10T08:47:37.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:37.546+0000 7fbba1a00640 1 -- 172.21.15.2:0/245595728 wait complete. 2024-09-10T08:47:37.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:37.547+0000 7fbba1a00640 1 Processor -- start 2024-09-10T08:47:37.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:37.547+0000 7fbba1a00640 1 -- start start 2024-09-10T08:47:37.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:37.548+0000 7fbba1a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb9c0d0b50 0x7fbb9c15d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:37.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:37.548+0000 7fbba1a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb9c0d4d90 0x7fbb9c0ce0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:37.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:37.548+0000 7fbba1a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb9c15e500 0x7fbb9c161440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:37.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:37.548+0000 7fbba1a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbb9c0cff90 con 0x7fbb9c0d4d90 2024-09-10T08:47:37.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:37.548+0000 7fbba1a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fbb9c0d2920 con 0x7fbb9c15e500 2024-09-10T08:47:37.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:37.548+0000 7fbba1a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fbb9c0d0110 con 0x7fbb9c0d0b50 2024-09-10T08:47:37.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:37.549+0000 7fbb9b400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb9c0d4d90 0x7fbb9c0ce0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:37.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:37.549+0000 7fbb9b400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb9c0d4d90 0x7fbb9c0ce0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60224/0 (socket says 172.21.15.2:60224) 2024-09-10T08:47:37.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:37.549+0000 7fbb9b400640 1 -- 172.21.15.2:0/3594786917 learned_addr learned my addr 172.21.15.2:0/3594786917 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:37.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:37.549+0000 7fbba1000640 1 --2- 172.21.15.2:0/3594786917 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb9c15e500 0x7fbb9c161440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:37.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:37.549+0000 7fbb9be00640 1 --2- 172.21.15.2:0/3594786917 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb9c0d0b50 0x7fbb9c15d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:37.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:37.549+0000 7fbb9b400640 1 -- 172.21.15.2:0/3594786917 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb9c0d0b50 msgr2=0x7fbb9c15d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:37.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:37.549+0000 7fbb9b400640 1 --2- 172.21.15.2:0/3594786917 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb9c0d0b50 0x7fbb9c15d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:37.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:37.549+0000 7fbb9b400640 1 -- 172.21.15.2:0/3594786917 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb9c15e500 msgr2=0x7fbb9c161440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:37.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:37.549+0000 7fbb9b400640 1 --2- 172.21.15.2:0/3594786917 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb9c15e500 0x7fbb9c161440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:37.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:37.549+0000 7fbb9b400640 1 -- 172.21.15.2:0/3594786917 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb9c1600c0 con 0x7fbb9c0d4d90 2024-09-10T08:47:37.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:37.549+0000 7fbb9b400640 1 --2- 172.21.15.2:0/3594786917 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb9c0d4d90 0x7fbb9c0ce0a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fbb88035040 tx=0x7fbb880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:37.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:37.550+0000 7fbb93e00640 1 -- 172.21.15.2:0/3594786917 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb88037040 con 0x7fbb9c0d4d90 2024-09-10T08:47:37.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:37.550+0000 7fbb93e00640 1 -- 172.21.15.2:0/3594786917 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb88004230 con 0x7fbb9c0d4d90 2024-09-10T08:47:37.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:37.550+0000 7fbb93e00640 1 -- 172.21.15.2:0/3594786917 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb88006e10 con 0x7fbb9c0d4d90 2024-09-10T08:47:37.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:37.550+0000 7fbba1a00640 1 -- 172.21.15.2:0/3594786917 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb9c1603a0 con 0x7fbb9c0d4d90 2024-09-10T08:47:37.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:37.550+0000 7fbba1a00640 1 -- 172.21.15.2:0/3594786917 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb9c160960 con 0x7fbb9c0d4d90 2024-09-10T08:47:37.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:37.551+0000 7fbba1a00640 1 -- 172.21.15.2:0/3594786917 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb9c0cefb0 con 0x7fbb9c0d4d90 2024-09-10T08:47:37.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:37.552+0000 7fbb93e00640 1 -- 172.21.15.2:0/3594786917 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbb8803a070 con 0x7fbb9c0d4d90 2024-09-10T08:47:37.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:37.553+0000 7fbb93e00640 1 --2- 172.21.15.2:0/3594786917 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fbb7c06be30 0x7fbb7c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:37.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:37.553+0000 7fbb93e00640 1 -- 172.21.15.2:0/3594786917 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fbb880abbd0 con 0x7fbb9c0d4d90 2024-09-10T08:47:37.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:37.553+0000 7fbb9be00640 1 --2- 172.21.15.2:0/3594786917 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fbb7c06be30 0x7fbb7c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:37.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:37.554+0000 7fbb9be00640 1 --2- 172.21.15.2:0/3594786917 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fbb7c06be30 0x7fbb7c06e2f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c007fd0 tx=0x7fbb8c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:37.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:37.557+0000 7fbb93e00640 1 -- 172.21.15.2:0/3594786917 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbb88041020 con 0x7fbb9c0d4d90 2024-09-10T08:47:37.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:37.753+0000 7fbba1a00640 1 -- 172.21.15.2:0/3594786917 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fbb9c0d1a20 con 0x7fbb9c0d4d90 2024-09-10T08:47:37.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:37.753+0000 7fbb93e00640 1 -- 172.21.15.2:0/3594786917 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7fbb8807a0c0 con 0x7fbb9c0d4d90 2024-09-10T08:47:37.753 INFO:teuthology.orchestra.run.smithi002.stderr:listed 0 entries 2024-09-10T08:47:37.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:37.755+0000 7fbba1a00640 1 -- 172.21.15.2:0/3594786917 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fbb7c06be30 msgr2=0x7fbb7c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:37.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:37.755+0000 7fbba1a00640 1 --2- 172.21.15.2:0/3594786917 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fbb7c06be30 0x7fbb7c06e2f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c007fd0 tx=0x7fbb8c009040 comp rx=0 tx=0).stop 2024-09-10T08:47:37.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:37.755+0000 7fbba1a00640 1 -- 172.21.15.2:0/3594786917 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb9c0d4d90 msgr2=0x7fbb9c0ce0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:37.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:37.755+0000 7fbba1a00640 1 --2- 172.21.15.2:0/3594786917 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb9c0d4d90 0x7fbb9c0ce0a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fbb88035040 tx=0x7fbb880046c0 comp rx=0 tx=0).stop 2024-09-10T08:47:37.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:37.756+0000 7fbba1a00640 1 -- 172.21.15.2:0/3594786917 shutdown_connections 2024-09-10T08:47:37.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:37.756+0000 7fbba1a00640 1 --2- 172.21.15.2:0/3594786917 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb9c15e500 0x7fbb9c161440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:37.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:37.756+0000 7fbba1a00640 1 --2- 172.21.15.2:0/3594786917 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb9c0d4d90 0x7fbb9c0ce0a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:37.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:37.756+0000 7fbba1a00640 1 --2- 172.21.15.2:0/3594786917 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fbb7c06be30 0x7fbb7c06e2f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:37.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:37.756+0000 7fbba1a00640 1 --2- 172.21.15.2:0/3594786917 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbb9c0d0b50 0x7fbb9c15d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:37.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:37.756+0000 7fbba1a00640 1 -- 172.21.15.2:0/3594786917 >> 172.21.15.2:0/3594786917 conn(0x7fbb9c09d720 msgr2=0x7fbb9c0d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:37.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:37.756+0000 7fbba1a00640 1 -- 172.21.15.2:0/3594786917 shutdown_connections 2024-09-10T08:47:37.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:37.756+0000 7fbba1a00640 1 -- 172.21.15.2:0/3594786917 wait complete. 2024-09-10T08:47:37.771 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-10T08:47:37.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:47:37.772 DEBUG:teuthology.orchestra.run.smithi002:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-09-10T08:47:37.832 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi002.front.sepia.ceph.com 2024-09-10T08:47:37.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:47:37.833 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T08:47:37.869 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-10T08:47:37.869 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:47:37.909 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-10T08:47:37.909 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:47:37.989 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-10T08:47:37.989 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:47:38.068 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T08:47:38.093 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:47:38.124 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:47:38.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.230+0000 7ff1e9400640 1 Processor -- start 2024-09-10T08:47:38.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.230+0000 7ff1e9400640 1 -- start start 2024-09-10T08:47:38.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.231+0000 7ff1e9400640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff1e4161ca0 0x7ff1e40d2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:38.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.231+0000 7ff1e9400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1e40cf8c0 0x7ff1e406d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:38.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.231+0000 7ff1e9400640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1e40cfe50 con 0x7ff1e40d2b60 2024-09-10T08:47:38.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.231+0000 7ff1e9400640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7ff1e40d2fd0 con 0x7ff1e4161ca0 2024-09-10T08:47:38.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.231+0000 7ff1e9400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff1e40d34a0 con 0x7ff1e40cf8c0 2024-09-10T08:47:38.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.232+0000 7ff1e1e00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ff1e40d2b60 0x7ff1e40cf1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33310/0 (socket says 172.21.15.2:33310) 2024-09-10T08:47:38.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.232+0000 7ff1e1e00640 1 -- 172.21.15.2:0/341799122 learned_addr learned my addr 172.21.15.2:0/341799122 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:47:38.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.232+0000 7ff1e3200640 1 --2- 172.21.15.2:0/341799122 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1e40cf8c0 0x7ff1e406d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:38.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.232+0000 7ff1e2800640 1 --2- 172.21.15.2:0/341799122 >> v2:172.21.15.155:3300/0 conn(0x7ff1e4161ca0 0x7ff1e40d2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:38.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.232+0000 7ff1e1400640 1 -- 172.21.15.2:0/341799122 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1070500734 0 0) 0x7ff1e40cfe50 con 0x7ff1e40d2b60 2024-09-10T08:47:38.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.232+0000 7ff1e1400640 1 -- 172.21.15.2:0/341799122 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff1c8003520 con 0x7ff1e40d2b60 2024-09-10T08:47:38.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.233+0000 7ff1e2800640 1 -- 172.21.15.2:0/341799122 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1e40cf8c0 msgr2=0x7ff1e406d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:38.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.233+0000 7ff1e2800640 1 --2- 172.21.15.2:0/341799122 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1e40cf8c0 0x7ff1e406d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:38.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.233+0000 7ff1e2800640 1 -- 172.21.15.2:0/341799122 >> v1:172.21.15.2:6789/0 conn(0x7ff1e40d2b60 legacy=0x7ff1e40cf1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:38.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.233+0000 7ff1e1400640 1 -- 172.21.15.2:0/341799122 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2658528299 0 0) 0x7ff1c8003520 con 0x7ff1e40d2b60 2024-09-10T08:47:38.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.233+0000 7ff1e2800640 1 -- 172.21.15.2:0/341799122 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1e40d0130 con 0x7ff1e4161ca0 2024-09-10T08:47:38.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.233+0000 7ff1e3200640 1 --2- 172.21.15.2:0/341799122 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1e40cf8c0 0x7ff1e406d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:47:38.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.234+0000 7ff1e2800640 1 --2- 172.21.15.2:0/341799122 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1e4161ca0 0x7ff1e40d2620 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff1d40097a0 tx=0x7ff1d402a080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0f9e7e6a9eb5290 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:38.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.234+0000 7ff1e1400640 1 -- 172.21.15.2:0/341799122 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d4037070 con 0x7ff1e4161ca0 2024-09-10T08:47:38.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.234+0000 7ff1e1400640 1 -- 172.21.15.2:0/341799122 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1d402ab10 con 0x7ff1e4161ca0 2024-09-10T08:47:38.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.234+0000 7ff1e1400640 1 -- 172.21.15.2:0/341799122 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d0001670 con 0x7ff1e4161ca0 2024-09-10T08:47:38.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.235+0000 7ff1e9400640 1 -- 172.21.15.2:0/341799122 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1e4161ca0 msgr2=0x7ff1e40d2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:38.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.235+0000 7ff1e9400640 1 --2- 172.21.15.2:0/341799122 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1e4161ca0 0x7ff1e40d2620 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff1d40097a0 tx=0x7ff1d402a080 comp rx=0 tx=0).stop 2024-09-10T08:47:38.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.235+0000 7ff1e9400640 1 -- 172.21.15.2:0/341799122 shutdown_connections 2024-09-10T08:47:38.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.235+0000 7ff1e9400640 1 --2- 172.21.15.2:0/341799122 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1e40cf8c0 0x7ff1e406d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:38.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.235+0000 7ff1e9400640 1 --2- 172.21.15.2:0/341799122 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1e4161ca0 0x7ff1e40d2620 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:38.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.235+0000 7ff1e9400640 1 -- 172.21.15.2:0/341799122 >> 172.21.15.2:0/341799122 conn(0x7ff1e408bfd0 msgr2=0x7ff1e40d45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:38.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.235+0000 7ff1e9400640 1 -- 172.21.15.2:0/341799122 shutdown_connections 2024-09-10T08:47:38.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.235+0000 7ff1e9400640 1 -- 172.21.15.2:0/341799122 wait complete. 2024-09-10T08:47:38.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.237+0000 7ff1e9400640 1 Processor -- start 2024-09-10T08:47:38.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.237+0000 7ff1e9400640 1 -- start start 2024-09-10T08:47:38.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.238+0000 7ff1e9400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1e40cf8c0 0x7ff1e4151370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:38.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.238+0000 7ff1e9400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1e40d2b60 0x7ff1e409f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:38.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.238+0000 7ff1e9400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1e4161ca0 0x7ff1e41530f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:38.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.238+0000 7ff1e9400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e406d040 con 0x7ff1e40d2b60 2024-09-10T08:47:38.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.238+0000 7ff1e9400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e406cdf0 con 0x7ff1e4161ca0 2024-09-10T08:47:38.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.238+0000 7ff1e9400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff1e406daa0 con 0x7ff1e40cf8c0 2024-09-10T08:47:38.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.238+0000 7ff1e1e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1e40d2b60 0x7ff1e409f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:38.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.238+0000 7ff1e1e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1e40d2b60 0x7ff1e409f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60226/0 (socket says 172.21.15.2:60226) 2024-09-10T08:47:38.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.238+0000 7ff1e1e00640 1 -- 172.21.15.2:0/1677703500 learned_addr learned my addr 172.21.15.2:0/1677703500 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:38.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.238+0000 7ff1e2800640 1 --2- 172.21.15.2:0/1677703500 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1e40cf8c0 0x7ff1e4151370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:38.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.239+0000 7ff1e3200640 1 --2- 172.21.15.2:0/1677703500 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1e4161ca0 0x7ff1e41530f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:38.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.239+0000 7ff1e1e00640 1 -- 172.21.15.2:0/1677703500 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1e40cf8c0 msgr2=0x7ff1e4151370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:38.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.239+0000 7ff1e1e00640 1 --2- 172.21.15.2:0/1677703500 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1e40cf8c0 0x7ff1e4151370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:38.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.239+0000 7ff1e1e00640 1 -- 172.21.15.2:0/1677703500 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1e4161ca0 msgr2=0x7ff1e41530f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:38.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.239+0000 7ff1e1e00640 1 --2- 172.21.15.2:0/1677703500 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1e4161ca0 0x7ff1e41530f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:38.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.239+0000 7ff1e1e00640 1 -- 172.21.15.2:0/1677703500 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1e4152050 con 0x7ff1e40d2b60 2024-09-10T08:47:38.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.239+0000 7ff1e2800640 1 --2- 172.21.15.2:0/1677703500 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1e40cf8c0 0x7ff1e4151370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:47:38.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.239+0000 7ff1e1e00640 1 --2- 172.21.15.2:0/1677703500 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1e40d2b60 0x7ff1e409f860 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff1d0001380 tx=0x7ff1d000cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:38.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.239+0000 7ff1daa00640 1 -- 172.21.15.2:0/1677703500 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d0017070 con 0x7ff1e40d2b60 2024-09-10T08:47:38.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.239+0000 7ff1daa00640 1 -- 172.21.15.2:0/1677703500 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1d0005ad0 con 0x7ff1e40d2b60 2024-09-10T08:47:38.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.239+0000 7ff1daa00640 1 -- 172.21.15.2:0/1677703500 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d000ce60 con 0x7ff1e40d2b60 2024-09-10T08:47:38.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.239+0000 7ff1e9400640 1 -- 172.21.15.2:0/1677703500 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1e4152330 con 0x7ff1e40d2b60 2024-09-10T08:47:38.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.240+0000 7ff1e9400640 1 -- 172.21.15.2:0/1677703500 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1e41528f0 con 0x7ff1e40d2b60 2024-09-10T08:47:38.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.241+0000 7ff1e9400640 1 -- 172.21.15.2:0/1677703500 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1e406d560 con 0x7ff1e40d2b60 2024-09-10T08:47:38.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.241+0000 7ff1daa00640 1 -- 172.21.15.2:0/1677703500 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff1d001a070 con 0x7ff1e40d2b60 2024-09-10T08:47:38.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.242+0000 7ff1daa00640 1 --2- 172.21.15.2:0/1677703500 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7ff1c406be30 0x7ff1c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:38.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.242+0000 7ff1daa00640 1 -- 172.21.15.2:0/1677703500 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7ff1d008a730 con 0x7ff1e40d2b60 2024-09-10T08:47:38.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.243+0000 7ff1e2800640 1 --2- 172.21.15.2:0/1677703500 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7ff1c406be30 0x7ff1c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:38.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.243+0000 7ff1e2800640 1 --2- 172.21.15.2:0/1677703500 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7ff1c406be30 0x7ff1c406e2f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff1d4034000 tx=0x7ff1d402e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:38.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.246+0000 7ff1daa00640 1 -- 172.21.15.2:0/1677703500 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff1d0058540 con 0x7ff1e40d2b60 2024-09-10T08:47:38.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.442+0000 7ff1e9400640 1 -- 172.21.15.2:0/1677703500 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff1e40b18d0 con 0x7ff1e40d2b60 2024-09-10T08:47:38.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.442+0000 7ff1daa00640 1 -- 172.21.15.2:0/1677703500 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7ff1d005c840 con 0x7ff1e40d2b60 2024-09-10T08:47:38.449 INFO:teuthology.orchestra.run.smithi002.stderr:listed 0 entries 2024-09-10T08:47:38.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.444+0000 7ff1e9400640 1 -- 172.21.15.2:0/1677703500 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7ff1c406be30 msgr2=0x7ff1c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:38.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.444+0000 7ff1e9400640 1 --2- 172.21.15.2:0/1677703500 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7ff1c406be30 0x7ff1c406e2f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff1d4034000 tx=0x7ff1d402e000 comp rx=0 tx=0).stop 2024-09-10T08:47:38.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.444+0000 7ff1e9400640 1 -- 172.21.15.2:0/1677703500 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1e40d2b60 msgr2=0x7ff1e409f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:38.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.444+0000 7ff1e9400640 1 --2- 172.21.15.2:0/1677703500 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1e40d2b60 0x7ff1e409f860 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff1d0001380 tx=0x7ff1d000cb20 comp rx=0 tx=0).stop 2024-09-10T08:47:38.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.444+0000 7ff1e9400640 1 -- 172.21.15.2:0/1677703500 shutdown_connections 2024-09-10T08:47:38.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.445+0000 7ff1e9400640 1 --2- 172.21.15.2:0/1677703500 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1e4161ca0 0x7ff1e41530f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:38.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.445+0000 7ff1e9400640 1 --2- 172.21.15.2:0/1677703500 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff1e40d2b60 0x7ff1e409f860 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:38.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.445+0000 7ff1e9400640 1 --2- 172.21.15.2:0/1677703500 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7ff1c406be30 0x7ff1c406e2f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:38.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.445+0000 7ff1e9400640 1 --2- 172.21.15.2:0/1677703500 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1e40cf8c0 0x7ff1e4151370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:38.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.445+0000 7ff1e9400640 1 -- 172.21.15.2:0/1677703500 >> 172.21.15.2:0/1677703500 conn(0x7ff1e408bfd0 msgr2=0x7ff1e40b50f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:38.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.445+0000 7ff1e9400640 1 -- 172.21.15.2:0/1677703500 shutdown_connections 2024-09-10T08:47:38.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:38.445+0000 7ff1e9400640 1 -- 172.21.15.2:0/1677703500 wait complete. 2024-09-10T08:47:38.462 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-10T08:47:38.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:47:38.462 DEBUG:teuthology.orchestra.run.smithi155:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-09-10T08:47:38.526 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi155.front.sepia.ceph.com 2024-09-10T08:47:38.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:47:38.526 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-10T08:47:38.578 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T08:47:38.578 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:47:38.618 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T08:47:38.618 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:47:38.708 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T08:47:38.708 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:47:38.790 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T08:47:39.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.006+0000 7f072e800640 1 Processor -- start 2024-09-10T08:47:39.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.006+0000 7f072e800640 1 -- start start 2024-09-10T08:47:39.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.007+0000 7f072e800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f07280cf310 0x7f072815d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:39.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.007+0000 7f072e800640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07281603b0 con 0x7f072806df50 2024-09-10T08:47:39.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.007+0000 7f072e800640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0728160690 con 0x7f072815c460 2024-09-10T08:47:39.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.007+0000 7f072e800640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f0728161030 con 0x7f07280cf310 2024-09-10T08:47:39.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.008+0000 7f0726a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f07280cf310 0x7f072815d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:39.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.008+0000 7f0727e00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f072806df50 0x7f07280b43d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33314/0 (socket says 172.21.15.2:33314) 2024-09-10T08:47:39.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.008+0000 7f0727e00640 1 -- 172.21.15.2:0/3440994958 learned_addr learned my addr 172.21.15.2:0/3440994958 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:47:39.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.008+0000 7f0726000640 1 -- 172.21.15.2:0/3440994958 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3550448950 0 0) 0x7f07281603b0 con 0x7f072806df50 2024-09-10T08:47:39.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.008+0000 7f0726000640 1 -- 172.21.15.2:0/3440994958 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f070c003520 con 0x7f072806df50 2024-09-10T08:47:39.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.008+0000 7f0726000640 1 -- 172.21.15.2:0/3440994958 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2503295193 0 0) 0x7f0728160690 con 0x7f072815c460 2024-09-10T08:47:39.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.008+0000 7f0726a00640 1 -- 172.21.15.2:0/3440994958 >> v1:172.21.15.155:6789/0 conn(0x7f072815c460 legacy=0x7f07280cec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:39.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.008+0000 7f0726a00640 1 -- 172.21.15.2:0/3440994958 >> v1:172.21.15.2:6789/0 conn(0x7f072806df50 legacy=0x7f07280b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:39.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.008+0000 7f0726a00640 1 -- 172.21.15.2:0/3440994958 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0728160970 con 0x7f07280cf310 2024-09-10T08:47:39.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.009+0000 7f0726a00640 1 --2- 172.21.15.2:0/3440994958 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f07280cf310 0x7f072815d530 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f07140097a0 tx=0x7f071402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a888162bdab16522 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:39.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.009+0000 7f0726000640 1 -- 172.21.15.2:0/3440994958 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0714037070 con 0x7f07280cf310 2024-09-10T08:47:39.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.009+0000 7f0726000640 1 -- 172.21.15.2:0/3440994958 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0714032440 con 0x7f07280cf310 2024-09-10T08:47:39.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.009+0000 7f0726000640 1 -- 172.21.15.2:0/3440994958 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07140327f0 con 0x7f07280cf310 2024-09-10T08:47:39.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.010+0000 7f072e800640 1 -- 172.21.15.2:0/3440994958 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f07280cf310 msgr2=0x7f072815d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:39.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.010+0000 7f072e800640 1 --2- 172.21.15.2:0/3440994958 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f07280cf310 0x7f072815d530 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f07140097a0 tx=0x7f071402a230 comp rx=0 tx=0).stop 2024-09-10T08:47:39.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.010+0000 7f072e800640 1 -- 172.21.15.2:0/3440994958 shutdown_connections 2024-09-10T08:47:39.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.010+0000 7f072e800640 1 --2- 172.21.15.2:0/3440994958 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f07280cf310 0x7f072815d530 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:39.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.010+0000 7f072e800640 1 -- 172.21.15.2:0/3440994958 >> 172.21.15.2:0/3440994958 conn(0x7f07280d02c0 msgr2=0x7f07280d06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:39.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.010+0000 7f072e800640 1 -- 172.21.15.2:0/3440994958 shutdown_connections 2024-09-10T08:47:39.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.010+0000 7f072e800640 1 -- 172.21.15.2:0/3440994958 wait complete. 2024-09-10T08:47:39.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.012+0000 7f072e800640 1 Processor -- start 2024-09-10T08:47:39.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.012+0000 7f072e800640 1 -- start start 2024-09-10T08:47:39.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.013+0000 7f072e800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f072806df50 0x7f072809b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:39.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.013+0000 7f072e800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f07280cf310 0x7f072809dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:39.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.013+0000 7f072e800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f072815c460 0x7f07280aead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:39.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.013+0000 7f072e800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f0728160080 con 0x7f072806df50 2024-09-10T08:47:39.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.013+0000 7f072e800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f072815da70 con 0x7f072815c460 2024-09-10T08:47:39.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.013+0000 7f072e800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f072815c840 con 0x7f07280cf310 2024-09-10T08:47:39.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.013+0000 7f0727400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f072806df50 0x7f072809b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:39.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.013+0000 7f0727400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f072806df50 0x7f072809b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60248/0 (socket says 172.21.15.2:60248) 2024-09-10T08:47:39.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.013+0000 7f0727400640 1 -- 172.21.15.2:0/2958036097 learned_addr learned my addr 172.21.15.2:0/2958036097 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:39.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.014+0000 7f0727e00640 1 --2- 172.21.15.2:0/2958036097 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f072815c460 0x7f07280aead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:39.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.014+0000 7f0726a00640 1 --2- 172.21.15.2:0/2958036097 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f07280cf310 0x7f072809dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:39.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.014+0000 7f0727400640 1 -- 172.21.15.2:0/2958036097 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f07280cf310 msgr2=0x7f072809dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:39.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.014+0000 7f0727400640 1 --2- 172.21.15.2:0/2958036097 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f07280cf310 0x7f072809dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:39.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.014+0000 7f0727400640 1 -- 172.21.15.2:0/2958036097 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f072815c460 msgr2=0x7f07280aead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:39.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.014+0000 7f0727400640 1 --2- 172.21.15.2:0/2958036097 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f072815c460 0x7f07280aead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:39.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.014+0000 7f0727400640 1 -- 172.21.15.2:0/2958036097 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f072809b980 con 0x7f072806df50 2024-09-10T08:47:39.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.014+0000 7f0727e00640 1 --2- 172.21.15.2:0/2958036097 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f072815c460 0x7f07280aead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:47:39.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.014+0000 7f0727400640 1 --2- 172.21.15.2:0/2958036097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f072806df50 0x7f072809b3a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f071800c4b0 tx=0x7f071800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:39.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.014+0000 7f071f400640 1 -- 172.21.15.2:0/2958036097 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0718017070 con 0x7f072806df50 2024-09-10T08:47:39.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.014+0000 7f071f400640 1 -- 172.21.15.2:0/2958036097 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0718005480 con 0x7f072806df50 2024-09-10T08:47:39.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.014+0000 7f072e800640 1 -- 172.21.15.2:0/2958036097 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f072809bc60 con 0x7f072806df50 2024-09-10T08:47:39.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.014+0000 7f071f400640 1 -- 172.21.15.2:0/2958036097 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0718003830 con 0x7f072806df50 2024-09-10T08:47:39.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.015+0000 7f072e800640 1 -- 172.21.15.2:0/2958036097 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f072809c220 con 0x7f072806df50 2024-09-10T08:47:39.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.016+0000 7f072e800640 1 -- 172.21.15.2:0/2958036097 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07280d1050 con 0x7f072806df50 2024-09-10T08:47:39.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.017+0000 7f071f400640 1 -- 172.21.15.2:0/2958036097 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f071801a070 con 0x7f072806df50 2024-09-10T08:47:39.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.017+0000 7f071f400640 1 --2- 172.21.15.2:0/2958036097 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f070806be30 0x7f070806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:39.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.017+0000 7f071f400640 1 -- 172.21.15.2:0/2958036097 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f071808a5d0 con 0x7f072806df50 2024-09-10T08:47:39.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.018+0000 7f0726a00640 1 --2- 172.21.15.2:0/2958036097 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f070806be30 0x7f070806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:39.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.019+0000 7f0726a00640 1 --2- 172.21.15.2:0/2958036097 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f070806be30 0x7f070806e2f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0714034000 tx=0x7f071402e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:39.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.022+0000 7f071f400640 1 -- 172.21.15.2:0/2958036097 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0718058500 con 0x7f072806df50 2024-09-10T08:47:39.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.224+0000 7f072e800640 1 -- 172.21.15.2:0/2958036097 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f07280cdea0 con 0x7f072806df50 2024-09-10T08:47:39.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.225+0000 7f071f400640 1 -- 172.21.15.2:0/2958036097 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f071805c800 con 0x7f072806df50 2024-09-10T08:47:39.225 INFO:teuthology.orchestra.run.smithi002.stderr:listed 0 entries 2024-09-10T08:47:39.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.227+0000 7f072e800640 1 -- 172.21.15.2:0/2958036097 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f070806be30 msgr2=0x7f070806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:39.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.227+0000 7f072e800640 1 --2- 172.21.15.2:0/2958036097 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f070806be30 0x7f070806e2f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0714034000 tx=0x7f071402e000 comp rx=0 tx=0).stop 2024-09-10T08:47:39.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.227+0000 7f072e800640 1 -- 172.21.15.2:0/2958036097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f072806df50 msgr2=0x7f072809b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:39.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.227+0000 7f072e800640 1 --2- 172.21.15.2:0/2958036097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f072806df50 0x7f072809b3a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f071800c4b0 tx=0x7f071800c970 comp rx=0 tx=0).stop 2024-09-10T08:47:39.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.227+0000 7f072e800640 1 -- 172.21.15.2:0/2958036097 shutdown_connections 2024-09-10T08:47:39.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.227+0000 7f072e800640 1 --2- 172.21.15.2:0/2958036097 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f072815c460 0x7f07280aead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:39.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.227+0000 7f072e800640 1 --2- 172.21.15.2:0/2958036097 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f070806be30 0x7f070806e2f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:39.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.227+0000 7f072e800640 1 --2- 172.21.15.2:0/2958036097 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f07280cf310 0x7f072809dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:39.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.227+0000 7f072e800640 1 --2- 172.21.15.2:0/2958036097 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f072806df50 0x7f072809b3a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:39.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.227+0000 7f072e800640 1 -- 172.21.15.2:0/2958036097 >> 172.21.15.2:0/2958036097 conn(0x7f07280d02c0 msgr2=0x7f072806eb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:39.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.227+0000 7f072e800640 1 -- 172.21.15.2:0/2958036097 shutdown_connections 2024-09-10T08:47:39.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.227+0000 7f072e800640 1 -- 172.21.15.2:0/2958036097 wait complete. 2024-09-10T08:47:39.243 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-09-10T08:47:39.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:47:39.243 DEBUG:teuthology.orchestra.run.smithi002:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-09-10T08:47:39.305 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi002.front.sepia.ceph.com 2024-09-10T08:47:39.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:47:39.306 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-10T08:47:39.344 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-10T08:47:39.344 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:47:39.380 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-10T08:47:39.380 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:47:39.457 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-10T08:47:39.457 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:47:39.534 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T08:47:39.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.696+0000 7fb6c7200640 1 Processor -- start 2024-09-10T08:47:39.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.696+0000 7fb6c7200640 1 -- start start 2024-09-10T08:47:39.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.698+0000 7fb6c7200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb6c815e500 0x7fb6c80cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:39.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.698+0000 7fb6c7200640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb6c80d0b50 0x7fb6c80d0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:39.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.698+0000 7fb6c7200640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6c80d14a0 con 0x7fb6c80d4d90 2024-09-10T08:47:39.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.698+0000 7fb6c7200640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fb6c815e8e0 con 0x7fb6c815e500 2024-09-10T08:47:39.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.698+0000 7fb6c7200640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fb6c80d0350 con 0x7fb6c80d0b50 2024-09-10T08:47:39.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.698+0000 7fb6c5e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb6c815e500 0x7fb6c80cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:39.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.698+0000 7fb6c5e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb6c815e500 0x7fb6c80cefb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60254/0 (socket says 172.21.15.2:60254) 2024-09-10T08:47:39.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.698+0000 7fb6c5e00640 1 -- 172.21.15.2:0/3859097115 learned_addr learned my addr 172.21.15.2:0/3859097115 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:39.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.698+0000 7fb6c6800640 1 --2- 172.21.15.2:0/3859097115 >> v2:172.21.15.155:3300/0 conn(0x7fb6c80d0b50 0x7fb6c80d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:39.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.699+0000 7fb6c4a00640 1 -- 172.21.15.2:0/3859097115 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4231161415 0 0) 0x7fb6b4001110 con 0x7fb6c80d4d90 2024-09-10T08:47:39.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.699+0000 7fb6c5e00640 1 -- 172.21.15.2:0/3859097115 >> v2:172.21.15.155:3300/0 conn(0x7fb6c80d0b50 msgr2=0x7fb6c80d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:39.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.699+0000 7fb6c5e00640 1 --2- 172.21.15.2:0/3859097115 >> v2:172.21.15.155:3300/0 conn(0x7fb6c80d0b50 0x7fb6c80d0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:39.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.699+0000 7fb6c5e00640 1 -- 172.21.15.2:0/3859097115 >> v1:172.21.15.155:6789/0 conn(0x7fb6c80d4d90 legacy=0x7fb6c80d2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:39.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.699+0000 7fb6c5e00640 1 -- 172.21.15.2:0/3859097115 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6c80d2080 con 0x7fb6c815e500 2024-09-10T08:47:39.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.700+0000 7fb6c5e00640 1 --2- 172.21.15.2:0/3859097115 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6c815e500 0x7fb6c80cefb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb6c80c7a70 tx=0x7fb6b802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e6b0c11521f34e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:39.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.700+0000 7fb6c4a00640 1 -- 172.21.15.2:0/3859097115 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b8037070 con 0x7fb6c815e500 2024-09-10T08:47:39.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.700+0000 7fb6c4a00640 1 -- 172.21.15.2:0/3859097115 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6b8032440 con 0x7fb6c815e500 2024-09-10T08:47:39.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.700+0000 7fb6c4a00640 1 -- 172.21.15.2:0/3859097115 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b8032810 con 0x7fb6c815e500 2024-09-10T08:47:39.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.701+0000 7fb6c7200640 1 -- 172.21.15.2:0/3859097115 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6c815e500 msgr2=0x7fb6c80cefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:39.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.701+0000 7fb6c7200640 1 --2- 172.21.15.2:0/3859097115 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6c815e500 0x7fb6c80cefb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb6c80c7a70 tx=0x7fb6b802a270 comp rx=0 tx=0).stop 2024-09-10T08:47:39.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.701+0000 7fb6c7200640 1 -- 172.21.15.2:0/3859097115 shutdown_connections 2024-09-10T08:47:39.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.701+0000 7fb6c7200640 1 --2- 172.21.15.2:0/3859097115 >> v2:172.21.15.155:3300/0 conn(0x7fb6c80d0b50 0x7fb6c80d0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:39.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.701+0000 7fb6c7200640 1 --2- 172.21.15.2:0/3859097115 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6c815e500 0x7fb6c80cefb0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:39.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.701+0000 7fb6c7200640 1 -- 172.21.15.2:0/3859097115 >> 172.21.15.2:0/3859097115 conn(0x7fb6c809d720 msgr2=0x7fb6c80d4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:39.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.701+0000 7fb6c7200640 1 -- 172.21.15.2:0/3859097115 shutdown_connections 2024-09-10T08:47:39.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.701+0000 7fb6c7200640 1 -- 172.21.15.2:0/3859097115 wait complete. 2024-09-10T08:47:39.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.703+0000 7fb6c7200640 1 Processor -- start 2024-09-10T08:47:39.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.704+0000 7fb6c7200640 1 -- start start 2024-09-10T08:47:39.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.705+0000 7fb6c7200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6c80d0b50 0x7fb6c80a1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:39.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.705+0000 7fb6c7200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6c80d4d90 0x7fb6c81e3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:39.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.705+0000 7fb6c7200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb6c815e500 0x7fb6c80cbe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:39.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.705+0000 7fb6c7200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c80d2920 con 0x7fb6c80d0b50 2024-09-10T08:47:39.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.705+0000 7fb6c7200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c80d2640 con 0x7fb6c815e500 2024-09-10T08:47:39.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.705+0000 7fb6c7200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb6c80cff90 con 0x7fb6c80d4d90 2024-09-10T08:47:39.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.706+0000 7fb6c5e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6c80d0b50 0x7fb6c80a1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:39.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.706+0000 7fb6c5e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6c80d0b50 0x7fb6c80a1b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60260/0 (socket says 172.21.15.2:60260) 2024-09-10T08:47:39.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.706+0000 7fb6c5e00640 1 -- 172.21.15.2:0/1443669379 learned_addr learned my addr 172.21.15.2:0/1443669379 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:39.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.706+0000 7fb6c6800640 1 --2- 172.21.15.2:0/1443669379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb6c815e500 0x7fb6c80cbe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:39.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.706+0000 7fb6c5400640 1 --2- 172.21.15.2:0/1443669379 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6c80d4d90 0x7fb6c81e3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:39.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.706+0000 7fb6c5e00640 1 -- 172.21.15.2:0/1443669379 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6c80d4d90 msgr2=0x7fb6c81e3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:39.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.706+0000 7fb6c5e00640 1 --2- 172.21.15.2:0/1443669379 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6c80d4d90 0x7fb6c81e3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:39.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.706+0000 7fb6c5e00640 1 -- 172.21.15.2:0/1443669379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb6c815e500 msgr2=0x7fb6c80cbe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:39.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.706+0000 7fb6c5e00640 1 --2- 172.21.15.2:0/1443669379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb6c815e500 0x7fb6c80cbe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:39.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.706+0000 7fb6c5e00640 1 -- 172.21.15.2:0/1443669379 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6c815b9b0 con 0x7fb6c80d0b50 2024-09-10T08:47:39.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.706+0000 7fb6c6800640 1 --2- 172.21.15.2:0/1443669379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb6c815e500 0x7fb6c80cbe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:47:39.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.706+0000 7fb6c5e00640 1 --2- 172.21.15.2:0/1443669379 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6c80d0b50 0x7fb6c80a1b90 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb6b802a2b0 tx=0x7fb6b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:39.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.707+0000 7fb6be000640 1 -- 172.21.15.2:0/1443669379 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b8037040 con 0x7fb6c80d0b50 2024-09-10T08:47:39.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.707+0000 7fb6be000640 1 -- 172.21.15.2:0/1443669379 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6b8042070 con 0x7fb6c80d0b50 2024-09-10T08:47:39.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.707+0000 7fb6be000640 1 -- 172.21.15.2:0/1443669379 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b8030880 con 0x7fb6c80d0b50 2024-09-10T08:47:39.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.707+0000 7fb6c7200640 1 -- 172.21.15.2:0/1443669379 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6c80a20d0 con 0x7fb6c80d0b50 2024-09-10T08:47:39.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.707+0000 7fb6c7200640 1 -- 172.21.15.2:0/1443669379 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6c815b6d0 con 0x7fb6c80d0b50 2024-09-10T08:47:39.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.708+0000 7fb6c7200640 1 -- 172.21.15.2:0/1443669379 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6c80d0f60 con 0x7fb6c80d0b50 2024-09-10T08:47:39.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.709+0000 7fb6be000640 1 -- 172.21.15.2:0/1443669379 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb6b8030a20 con 0x7fb6c80d0b50 2024-09-10T08:47:39.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.710+0000 7fb6be000640 1 --2- 172.21.15.2:0/1443669379 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fb6a806be30 0x7fb6a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:39.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.710+0000 7fb6be000640 1 -- 172.21.15.2:0/1443669379 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fb6b80aba00 con 0x7fb6c80d0b50 2024-09-10T08:47:39.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.710+0000 7fb6c5400640 1 --2- 172.21.15.2:0/1443669379 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fb6a806be30 0x7fb6a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:39.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.711+0000 7fb6c5400640 1 --2- 172.21.15.2:0/1443669379 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fb6a806be30 0x7fb6a806e2f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb6c81e63e0 tx=0x7fb6b4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:39.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.714+0000 7fb6be000640 1 -- 172.21.15.2:0/1443669379 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb6b8079930 con 0x7fb6c80d0b50 2024-09-10T08:47:39.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.913+0000 7fb6c7200640 1 -- 172.21.15.2:0/1443669379 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb6c80d1a20 con 0x7fb6c80d0b50 2024-09-10T08:47:39.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.914+0000 7fb6be000640 1 -- 172.21.15.2:0/1443669379 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7fb6b807dc30 con 0x7fb6c80d0b50 2024-09-10T08:47:39.914 INFO:teuthology.orchestra.run.smithi002.stderr:listed 0 entries 2024-09-10T08:47:39.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.916+0000 7fb6c7200640 1 -- 172.21.15.2:0/1443669379 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fb6a806be30 msgr2=0x7fb6a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:39.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.916+0000 7fb6c7200640 1 --2- 172.21.15.2:0/1443669379 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fb6a806be30 0x7fb6a806e2f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb6c81e63e0 tx=0x7fb6b4009040 comp rx=0 tx=0).stop 2024-09-10T08:47:39.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.916+0000 7fb6c7200640 1 -- 172.21.15.2:0/1443669379 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6c80d0b50 msgr2=0x7fb6c80a1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:39.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.916+0000 7fb6c7200640 1 --2- 172.21.15.2:0/1443669379 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6c80d0b50 0x7fb6c80a1b90 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb6b802a2b0 tx=0x7fb6b80046c0 comp rx=0 tx=0).stop 2024-09-10T08:47:39.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.916+0000 7fb6c7200640 1 -- 172.21.15.2:0/1443669379 shutdown_connections 2024-09-10T08:47:39.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.916+0000 7fb6c7200640 1 --2- 172.21.15.2:0/1443669379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb6c815e500 0x7fb6c80cbe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:39.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.916+0000 7fb6c7200640 1 --2- 172.21.15.2:0/1443669379 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fb6a806be30 0x7fb6a806e2f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:39.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.916+0000 7fb6c7200640 1 --2- 172.21.15.2:0/1443669379 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb6c80d4d90 0x7fb6c81e3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:39.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.916+0000 7fb6c7200640 1 --2- 172.21.15.2:0/1443669379 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb6c80d0b50 0x7fb6c80a1b90 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:39.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.916+0000 7fb6c7200640 1 -- 172.21.15.2:0/1443669379 >> 172.21.15.2:0/1443669379 conn(0x7fb6c809d720 msgr2=0x7fb6c80cf6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:39.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.916+0000 7fb6c7200640 1 -- 172.21.15.2:0/1443669379 shutdown_connections 2024-09-10T08:47:39.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:39.916+0000 7fb6c7200640 1 -- 172.21.15.2:0/1443669379 wait complete. 2024-09-10T08:47:39.932 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-09-10T08:47:39.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:47:39.932 DEBUG:teuthology.orchestra.run.smithi155:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-09-10T08:47:39.992 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi155.front.sepia.ceph.com 2024-09-10T08:47:39.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:47:39.993 DEBUG:teuthology.orchestra.run.smithi155:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-10T08:47:40.028 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-10T08:47:40.029 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:47:40.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.185+0000 7ff062400640 1 Processor -- start 2024-09-10T08:47:40.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.185+0000 7ff062400640 1 -- start start 2024-09-10T08:47:40.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.187+0000 7ff062400640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff05c06df80 0x7ff05c15c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:40.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.187+0000 7ff062400640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff05c06e4d0 con 0x7ff05c0cd460 2024-09-10T08:47:40.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.187+0000 7ff062400640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff05c06e7b0 con 0x7ff05c145d20 2024-09-10T08:47:40.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.187+0000 7ff062400640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7ff05c146100 con 0x7ff05c06df80 2024-09-10T08:47:40.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.187+0000 7ff053e00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ff05c0cd460 0x7ff05c0ceb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33326/0 (socket says 172.21.15.2:33326) 2024-09-10T08:47:40.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.187+0000 7ff053e00640 1 -- 172.21.15.2:0/1970077827 learned_addr learned my addr 172.21.15.2:0/1970077827 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:47:40.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.187+0000 7ff05be00640 1 --2- 172.21.15.2:0/1970077827 >> v2:172.21.15.155:3300/0 conn(0x7ff05c06df80 0x7ff05c15c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:40.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.187+0000 7ff05aa00640 1 -- 172.21.15.2:0/1970077827 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1941623214 0 0) 0x7ff05c06e4d0 con 0x7ff05c0cd460 2024-09-10T08:47:40.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.187+0000 7ff05aa00640 1 -- 172.21.15.2:0/1970077827 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff040003520 con 0x7ff05c0cd460 2024-09-10T08:47:40.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.188+0000 7ff05aa00640 1 -- 172.21.15.2:0/1970077827 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1175849519 0 0) 0x7ff05c06e7b0 con 0x7ff05c145d20 2024-09-10T08:47:40.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.188+0000 7ff05aa00640 1 -- 172.21.15.2:0/1970077827 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff05c06e4d0 con 0x7ff05c145d20 2024-09-10T08:47:40.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.188+0000 7ff05aa00640 1 -- 172.21.15.2:0/1970077827 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2252531266 0 0) 0x7ff040003520 con 0x7ff05c0cd460 2024-09-10T08:47:40.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.188+0000 7ff05aa00640 1 -- 172.21.15.2:0/1970077827 >> v2:172.21.15.155:3300/0 conn(0x7ff05c06df80 msgr2=0x7ff05c15c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:40.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.188+0000 7ff05aa00640 1 --2- 172.21.15.2:0/1970077827 >> v2:172.21.15.155:3300/0 conn(0x7ff05c06df80 0x7ff05c15c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:40.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.188+0000 7ff05aa00640 1 -- 172.21.15.2:0/1970077827 >> v1:172.21.15.155:6789/0 conn(0x7ff05c145d20 legacy=0x7ff05c0ccd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:40.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.188+0000 7ff05aa00640 1 -- 172.21.15.2:0/1970077827 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff05c06ea90 con 0x7ff05c0cd460 2024-09-10T08:47:40.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.188+0000 7ff05aa00640 1 -- 172.21.15.2:0/1970077827 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2345211856 0 0) 0x7ff044001670 con 0x7ff05c0cd460 2024-09-10T08:47:40.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.188+0000 7ff05aa00640 1 -- 172.21.15.2:0/1970077827 >> v1:172.21.15.2:6789/0 conn(0x7ff05c0cd460 legacy=0x7ff05c0ceb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:40.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.188+0000 7ff05aa00640 1 --2- 172.21.15.2:0/1970077827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff040003b90 0x7ff040003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:40.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.188+0000 7ff05aa00640 1 --2- 172.21.15.2:0/1970077827 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff040004800 0x7ff040004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:40.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.188+0000 7ff05aa00640 1 --2- 172.21.15.2:0/1970077827 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff040005280 0x7ff04000fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:40.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.188+0000 7ff05aa00640 1 -- 172.21.15.2:0/1970077827 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff05c146100 con 0x7ff040003b90 2024-09-10T08:47:40.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.188+0000 7ff05aa00640 1 -- 172.21.15.2:0/1970077827 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff0400105d0 con 0x7ff040004800 2024-09-10T08:47:40.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.188+0000 7ff05aa00640 1 -- 172.21.15.2:0/1970077827 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff0400107d0 con 0x7ff040005280 2024-09-10T08:47:40.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.188+0000 7ff05b400640 1 --2- 172.21.15.2:0/1970077827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff040003b90 0x7ff040003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:40.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.188+0000 7ff053e00640 1 --2- 172.21.15.2:0/1970077827 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff040004800 0x7ff040004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:40.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.188+0000 7ff05be00640 1 --2- 172.21.15.2:0/1970077827 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff040005280 0x7ff04000fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:40.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.188+0000 7ff05b400640 1 -- 172.21.15.2:0/1970077827 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff040005280 msgr2=0x7ff04000fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:40.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.189+0000 7ff05b400640 1 --2- 172.21.15.2:0/1970077827 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff040005280 0x7ff04000fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:40.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.189+0000 7ff05b400640 1 -- 172.21.15.2:0/1970077827 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff040004800 msgr2=0x7ff040004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:40.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.189+0000 7ff05b400640 1 --2- 172.21.15.2:0/1970077827 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff040004800 0x7ff040004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:40.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.189+0000 7ff05b400640 1 -- 172.21.15.2:0/1970077827 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff040003520 con 0x7ff040003b90 2024-09-10T08:47:40.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.189+0000 7ff05be00640 1 -- 172.21.15.2:0/1970077827 reap_dead start 2024-09-10T08:47:40.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.190+0000 7ff05b400640 1 --2- 172.21.15.2:0/1970077827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff040003b90 0x7ff040003f90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff04c0018d0 tx=0x7ff040005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8233136dc5e7b08 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:40.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.190+0000 7ff05aa00640 1 -- 172.21.15.2:0/1970077827 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff04c0014f0 con 0x7ff040003b90 2024-09-10T08:47:40.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.190+0000 7ff05aa00640 1 -- 172.21.15.2:0/1970077827 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff04c0052d0 con 0x7ff040003b90 2024-09-10T08:47:40.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.190+0000 7ff05aa00640 1 -- 172.21.15.2:0/1970077827 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff04c02ac60 con 0x7ff040003b90 2024-09-10T08:47:40.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.190+0000 7ff062400640 1 -- 172.21.15.2:0/1970077827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff040003b90 msgr2=0x7ff040003f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:40.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.190+0000 7ff062400640 1 --2- 172.21.15.2:0/1970077827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff040003b90 0x7ff040003f90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff04c0018d0 tx=0x7ff040005830 comp rx=0 tx=0).stop 2024-09-10T08:47:40.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.190+0000 7ff062400640 1 -- 172.21.15.2:0/1970077827 shutdown_connections 2024-09-10T08:47:40.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.190+0000 7ff062400640 1 --2- 172.21.15.2:0/1970077827 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff040003b90 0x7ff040003f90 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:40.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.190+0000 7ff062400640 1 -- 172.21.15.2:0/1970077827 >> 172.21.15.2:0/1970077827 conn(0x7ff05c06bc10 msgr2=0x7ff05c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:40.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.190+0000 7ff062400640 1 -- 172.21.15.2:0/1970077827 shutdown_connections 2024-09-10T08:47:40.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.191+0000 7ff062400640 1 -- 172.21.15.2:0/1970077827 wait complete. 2024-09-10T08:47:40.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.192+0000 7ff062400640 1 Processor -- start 2024-09-10T08:47:40.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.192+0000 7ff062400640 1 -- start start 2024-09-10T08:47:40.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.193+0000 7ff062400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff040003b90 0x7ff05c15bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:40.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.193+0000 7ff062400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff05c15b7b0 0x7ff05c15b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:40.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.193+0000 7ff062400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff05c139260 0x7ff05c139710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:40.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.193+0000 7ff062400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff05c15c9e0 con 0x7ff05c139260 2024-09-10T08:47:40.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.193+0000 7ff062400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff05c0ce6b0 con 0x7ff05c15b7b0 2024-09-10T08:47:40.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.193+0000 7ff062400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff05c15cb60 con 0x7ff040003b90 2024-09-10T08:47:40.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.193+0000 7ff05be00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff05c139260 0x7ff05c139710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:40.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.193+0000 7ff05be00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff05c139260 0x7ff05c139710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60282/0 (socket says 172.21.15.2:60282) 2024-09-10T08:47:40.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.193+0000 7ff05be00640 1 -- 172.21.15.2:0/1473160893 learned_addr learned my addr 172.21.15.2:0/1473160893 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:40.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.194+0000 7ff05b400640 1 --2- 172.21.15.2:0/1473160893 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff040003b90 0x7ff05c15bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:40.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.194+0000 7ff053e00640 1 --2- 172.21.15.2:0/1473160893 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff05c15b7b0 0x7ff05c15b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:40.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.194+0000 7ff05b400640 1 -- 172.21.15.2:0/1473160893 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff05c15b7b0 msgr2=0x7ff05c15b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:40.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.194+0000 7ff05b400640 1 --2- 172.21.15.2:0/1473160893 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff05c15b7b0 0x7ff05c15b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:40.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.194+0000 7ff05b400640 1 -- 172.21.15.2:0/1473160893 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff05c139260 msgr2=0x7ff05c139710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:40.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.194+0000 7ff05b400640 1 --2- 172.21.15.2:0/1473160893 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff05c139260 0x7ff05c139710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:40.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.194+0000 7ff05b400640 1 -- 172.21.15.2:0/1473160893 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff05c13b5e0 con 0x7ff040003b90 2024-09-10T08:47:40.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.194+0000 7ff05be00640 1 --2- 172.21.15.2:0/1473160893 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff05c139260 0x7ff05c139710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:47:40.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.194+0000 7ff05b400640 1 --2- 172.21.15.2:0/1473160893 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff040003b90 0x7ff05c15bce0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff04c004000 tx=0x7ff04c0012d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:40.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.195+0000 7ff053400640 1 -- 172.21.15.2:0/1473160893 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff04c042070 con 0x7ff040003b90 2024-09-10T08:47:40.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.195+0000 7ff053400640 1 -- 172.21.15.2:0/1473160893 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff04c006e50 con 0x7ff040003b90 2024-09-10T08:47:40.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.195+0000 7ff053400640 1 -- 172.21.15.2:0/1473160893 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff04c037040 con 0x7ff040003b90 2024-09-10T08:47:40.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.195+0000 7ff062400640 1 -- 172.21.15.2:0/1473160893 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff05c13b8c0 con 0x7ff040003b90 2024-09-10T08:47:40.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.195+0000 7ff062400640 1 -- 172.21.15.2:0/1473160893 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff05c13be80 con 0x7ff040003b90 2024-09-10T08:47:40.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.196+0000 7ff062400640 1 -- 172.21.15.2:0/1473160893 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff05c160980 con 0x7ff040003b90 2024-09-10T08:47:40.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.197+0000 7ff053400640 1 -- 172.21.15.2:0/1473160893 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff04c0052d0 con 0x7ff040003b90 2024-09-10T08:47:40.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.197+0000 7ff053400640 1 --2- 172.21.15.2:0/1473160893 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7ff03806be60 0x7ff03806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:40.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.198+0000 7ff053400640 1 -- 172.21.15.2:0/1473160893 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7ff04c0aa9b0 con 0x7ff040003b90 2024-09-10T08:47:40.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.198+0000 7ff053e00640 1 --2- 172.21.15.2:0/1473160893 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7ff03806be60 0x7ff03806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:40.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.198+0000 7ff053e00640 1 --2- 172.21.15.2:0/1473160893 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7ff03806be60 0x7ff03806e320 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff044001200 tx=0x7ff044001d50 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:40.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.203+0000 7ff053400640 1 -- 172.21.15.2:0/1473160893 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff04c078850 con 0x7ff040003b90 2024-09-10T08:47:40.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.425+0000 7ff062400640 1 -- 172.21.15.2:0/1473160893 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff05c0cf5d0 con 0x7ff040003b90 2024-09-10T08:47:40.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.426+0000 7ff053400640 1 -- 172.21.15.2:0/1473160893 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5216 (secure 0 0 0) 0x7ff04c07cb50 con 0x7ff040003b90 2024-09-10T08:47:40.428 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:47:40.428 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":9,"btime":"2024-09-10T08:47:13:450812+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/4081738683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":4081738683},{"type":"v1","addr":"172.21.15.2:6835","nonce":4081738683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1478106484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":1478106484},{"type":"v1","addr":"172.21.15.155:6837","nonce":1478106484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/800933941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":800933941},{"type":"v1","addr":"172.21.15.2:6834","nonce":800933941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:46:51.181258+0000","modified":"2024-09-10T08:47:12.877562+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6836/2996773231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2996773231},{"type":"v1","addr":"172.21.15.155:6836","nonce":2996773231}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":1}]} 2024-09-10T08:47:40.430 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 9 2024-09-10T08:47:40.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.428+0000 7ff062400640 1 -- 172.21.15.2:0/1473160893 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7ff03806be60 msgr2=0x7ff03806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:40.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.428+0000 7ff062400640 1 --2- 172.21.15.2:0/1473160893 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7ff03806be60 0x7ff03806e320 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff044001200 tx=0x7ff044001d50 comp rx=0 tx=0).stop 2024-09-10T08:47:40.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.428+0000 7ff062400640 1 -- 172.21.15.2:0/1473160893 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff040003b90 msgr2=0x7ff05c15bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:40.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.428+0000 7ff062400640 1 --2- 172.21.15.2:0/1473160893 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff040003b90 0x7ff05c15bce0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff04c004000 tx=0x7ff04c0012d0 comp rx=0 tx=0).stop 2024-09-10T08:47:40.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.428+0000 7ff062400640 1 -- 172.21.15.2:0/1473160893 shutdown_connections 2024-09-10T08:47:40.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.428+0000 7ff062400640 1 --2- 172.21.15.2:0/1473160893 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff05c139260 0x7ff05c139710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:40.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.428+0000 7ff062400640 1 --2- 172.21.15.2:0/1473160893 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff05c15b7b0 0x7ff05c15b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:40.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.428+0000 7ff062400640 1 --2- 172.21.15.2:0/1473160893 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7ff03806be60 0x7ff03806e320 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:40.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.428+0000 7ff062400640 1 --2- 172.21.15.2:0/1473160893 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff040003b90 0x7ff05c15bce0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:40.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.428+0000 7ff062400640 1 -- 172.21.15.2:0/1473160893 >> 172.21.15.2:0/1473160893 conn(0x7ff05c06bc10 msgr2=0x7ff05c0cea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:40.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.429+0000 7ff062400640 1 -- 172.21.15.2:0/1473160893 shutdown_connections 2024-09-10T08:47:40.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.429+0000 7ff062400640 1 -- 172.21.15.2:0/1473160893 wait complete. 2024-09-10T08:47:40.444 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:47:40.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.600+0000 7f1aada00640 1 Processor -- start 2024-09-10T08:47:40.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.600+0000 7f1aada00640 1 -- start start 2024-09-10T08:47:40.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.601+0000 7f1aada00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1aa815e580 0x7f1aa80ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:40.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.601+0000 7f1aada00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1aa80cf110 0x7f1aa806ee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:40.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.601+0000 7f1aada00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1aa80cf7b0 con 0x7f1aa80cd250 2024-09-10T08:47:40.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.601+0000 7f1aada00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f1aa80cd690 con 0x7f1aa80cf110 2024-09-10T08:47:40.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.601+0000 7f1aada00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1aa80cfa90 con 0x7f1aa815e580 2024-09-10T08:47:40.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.602+0000 7f1aa7400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1aa80cf110 0x7f1aa806ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:40.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.602+0000 7f1aa7400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1aa80cf110 0x7f1aa806ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60292/0 (socket says 172.21.15.2:60292) 2024-09-10T08:47:40.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.602+0000 7f1aa7400640 1 -- 172.21.15.2:0/4259247233 learned_addr learned my addr 172.21.15.2:0/4259247233 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:40.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.602+0000 7f1aa6a00640 1 --2- 172.21.15.2:0/4259247233 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1aa815e580 0x7f1aa80ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:40.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.602+0000 7f1aa7400640 1 -- 172.21.15.2:0/4259247233 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1aa815e580 msgr2=0x7f1aa80ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:40.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.602+0000 7f1aa7400640 1 --2- 172.21.15.2:0/4259247233 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1aa815e580 0x7f1aa80ccd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:40.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.602+0000 7f1aa7400640 1 -- 172.21.15.2:0/4259247233 >> v1:172.21.15.155:6789/0 conn(0x7f1aa80cd250 legacy=0x7f1aa80cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:40.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.602+0000 7f1aa7400640 1 -- 172.21.15.2:0/4259247233 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1aa806e640 con 0x7f1aa80cf110 2024-09-10T08:47:40.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.602+0000 7f1aa6a00640 1 --2- 172.21.15.2:0/4259247233 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1aa815e580 0x7f1aa80ccd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:47:40.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.603+0000 7f1aa7400640 1 --2- 172.21.15.2:0/4259247233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1aa80cf110 0x7f1aa806ee40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1aa0009e50 tx=0x7f1aa002a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3067eb492b9c280 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:40.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.603+0000 7f1aa5600640 1 -- 172.21.15.2:0/4259247233 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa0036070 con 0x7f1aa80cf110 2024-09-10T08:47:40.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.603+0000 7f1aa5600640 1 -- 172.21.15.2:0/4259247233 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1aa0031600 con 0x7f1aa80cf110 2024-09-10T08:47:40.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.603+0000 7f1aa5600640 1 -- 172.21.15.2:0/4259247233 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa00319d0 con 0x7f1aa80cf110 2024-09-10T08:47:40.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.604+0000 7f1aada00640 1 -- 172.21.15.2:0/4259247233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1aa80cf110 msgr2=0x7f1aa806ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:40.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.604+0000 7f1aada00640 1 --2- 172.21.15.2:0/4259247233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1aa80cf110 0x7f1aa806ee40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1aa0009e50 tx=0x7f1aa002a630 comp rx=0 tx=0).stop 2024-09-10T08:47:40.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.604+0000 7f1aada00640 1 -- 172.21.15.2:0/4259247233 shutdown_connections 2024-09-10T08:47:40.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.604+0000 7f1aada00640 1 --2- 172.21.15.2:0/4259247233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1aa80cf110 0x7f1aa806ee40 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:40.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.604+0000 7f1aada00640 1 --2- 172.21.15.2:0/4259247233 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1aa815e580 0x7f1aa80ccd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:40.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.604+0000 7f1aada00640 1 -- 172.21.15.2:0/4259247233 >> 172.21.15.2:0/4259247233 conn(0x7f1aa806bc10 msgr2=0x7f1aa806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:40.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.604+0000 7f1aada00640 1 -- 172.21.15.2:0/4259247233 shutdown_connections 2024-09-10T08:47:40.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.604+0000 7f1aada00640 1 -- 172.21.15.2:0/4259247233 wait complete. 2024-09-10T08:47:40.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.606+0000 7f1aada00640 1 Processor -- start 2024-09-10T08:47:40.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.606+0000 7f1aada00640 1 -- start start 2024-09-10T08:47:40.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.607+0000 7f1aada00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1aa80cd250 0x7f1aa8158d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:40.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.607+0000 7f1aada00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1aa80cf110 0x7f1aa80c5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:40.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.607+0000 7f1aada00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1aa815e580 0x7f1aa80ae670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:40.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.607+0000 7f1aada00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa806e2a0 con 0x7f1aa80cd250 2024-09-10T08:47:40.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.607+0000 7f1aada00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa815e960 con 0x7f1aa815e580 2024-09-10T08:47:40.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.607+0000 7f1aada00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1aa806e420 con 0x7f1aa80cf110 2024-09-10T08:47:40.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.607+0000 7f1aa6a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1aa80cd250 0x7f1aa8158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:40.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.607+0000 7f1aa6a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1aa80cd250 0x7f1aa8158d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60304/0 (socket says 172.21.15.2:60304) 2024-09-10T08:47:40.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.607+0000 7f1aa6a00640 1 -- 172.21.15.2:0/3146469274 learned_addr learned my addr 172.21.15.2:0/3146469274 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:40.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.607+0000 7f1aa6000640 1 --2- 172.21.15.2:0/3146469274 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1aa80cf110 0x7f1aa80c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:40.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.607+0000 7f1aa7400640 1 --2- 172.21.15.2:0/3146469274 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1aa815e580 0x7f1aa80ae670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:40.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.607+0000 7f1aa6a00640 1 -- 172.21.15.2:0/3146469274 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1aa80cf110 msgr2=0x7f1aa80c5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:40.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.607+0000 7f1aa6a00640 1 --2- 172.21.15.2:0/3146469274 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1aa80cf110 0x7f1aa80c5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:40.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.607+0000 7f1aa6a00640 1 -- 172.21.15.2:0/3146469274 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1aa815e580 msgr2=0x7f1aa80ae670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:40.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.607+0000 7f1aa6a00640 1 --2- 172.21.15.2:0/3146469274 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1aa815e580 0x7f1aa80ae670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:40.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.607+0000 7f1aa6a00640 1 -- 172.21.15.2:0/3146469274 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1aa8159270 con 0x7f1aa80cd250 2024-09-10T08:47:40.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.607+0000 7f1aa6000640 1 --2- 172.21.15.2:0/3146469274 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1aa80cf110 0x7f1aa80c5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:47:40.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.608+0000 7f1aa6a00640 1 --2- 172.21.15.2:0/3146469274 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1aa80cd250 0x7f1aa8158d30 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1a9800c7f0 tx=0x7f1a9800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:40.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.608+0000 7f1a9ea00640 1 -- 172.21.15.2:0/3146469274 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a98015070 con 0x7f1aa80cd250 2024-09-10T08:47:40.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.608+0000 7f1a9ea00640 1 -- 172.21.15.2:0/3146469274 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a98007820 con 0x7f1aa80cd250 2024-09-10T08:47:40.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.608+0000 7f1a9ea00640 1 -- 172.21.15.2:0/3146469274 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a98007bd0 con 0x7f1aa80cd250 2024-09-10T08:47:40.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.608+0000 7f1aada00640 1 -- 172.21.15.2:0/3146469274 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1aa81618d0 con 0x7f1aa80cd250 2024-09-10T08:47:40.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.608+0000 7f1aada00640 1 -- 172.21.15.2:0/3146469274 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1aa80adb90 con 0x7f1aa80cd250 2024-09-10T08:47:40.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.609+0000 7f1aada00640 1 -- 172.21.15.2:0/3146469274 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1aa80ccd10 con 0x7f1aa80cd250 2024-09-10T08:47:40.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.610+0000 7f1a9ea00640 1 -- 172.21.15.2:0/3146469274 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1a98018070 con 0x7f1aa80cd250 2024-09-10T08:47:40.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.611+0000 7f1a9ea00640 1 --2- 172.21.15.2:0/3146469274 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f1a8806be60 0x7f1a8806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:40.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.611+0000 7f1a9ea00640 1 -- 172.21.15.2:0/3146469274 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f1a9808b2e0 con 0x7f1aa80cd250 2024-09-10T08:47:40.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.611+0000 7f1aa6000640 1 --2- 172.21.15.2:0/3146469274 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f1a8806be60 0x7f1a8806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:40.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.612+0000 7f1aa6000640 1 --2- 172.21.15.2:0/3146469274 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f1a8806be60 0x7f1a8806e320 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1aa80b2c80 tx=0x7f1a94009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:40.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.615+0000 7f1a9ea00640 1 -- 172.21.15.2:0/3146469274 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1aa8159270 con 0x7f1aa80cd250 2024-09-10T08:47:40.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.835+0000 7f1aada00640 1 -- 172.21.15.2:0/3146469274 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1aa815ce20 con 0x7f1aa80cd250 2024-09-10T08:47:40.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.836+0000 7f1a9ea00640 1 -- 172.21.15.2:0/3146469274 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5216 (secure 0 0 0) 0x7f1a98059210 con 0x7f1aa80cd250 2024-09-10T08:47:40.836 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:47:40.837 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":9,"btime":"2024-09-10T08:47:13:450812+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/4081738683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":4081738683},{"type":"v1","addr":"172.21.15.2:6835","nonce":4081738683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1478106484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":1478106484},{"type":"v1","addr":"172.21.15.155:6837","nonce":1478106484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/800933941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":800933941},{"type":"v1","addr":"172.21.15.2:6834","nonce":800933941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:46:51.181258+0000","modified":"2024-09-10T08:47:12.877562+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6836/2996773231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2996773231},{"type":"v1","addr":"172.21.15.155:6836","nonce":2996773231}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":1}]} 2024-09-10T08:47:40.837 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 9 2024-09-10T08:47:40.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.838+0000 7f1aada00640 1 -- 172.21.15.2:0/3146469274 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f1a8806be60 msgr2=0x7f1a8806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:40.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.838+0000 7f1aada00640 1 --2- 172.21.15.2:0/3146469274 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f1a8806be60 0x7f1a8806e320 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1aa80b2c80 tx=0x7f1a94009040 comp rx=0 tx=0).stop 2024-09-10T08:47:40.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.838+0000 7f1aada00640 1 -- 172.21.15.2:0/3146469274 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1aa80cd250 msgr2=0x7f1aa8158d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:40.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.838+0000 7f1aada00640 1 --2- 172.21.15.2:0/3146469274 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1aa80cd250 0x7f1aa8158d30 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1a9800c7f0 tx=0x7f1a9800ccb0 comp rx=0 tx=0).stop 2024-09-10T08:47:40.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.838+0000 7f1aada00640 1 -- 172.21.15.2:0/3146469274 shutdown_connections 2024-09-10T08:47:40.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.838+0000 7f1aada00640 1 --2- 172.21.15.2:0/3146469274 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1aa815e580 0x7f1aa80ae670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:40.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.838+0000 7f1aada00640 1 --2- 172.21.15.2:0/3146469274 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f1a8806be60 0x7f1a8806e320 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:40.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.838+0000 7f1aada00640 1 --2- 172.21.15.2:0/3146469274 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1aa80cf110 0x7f1aa80c5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:40.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.838+0000 7f1aada00640 1 --2- 172.21.15.2:0/3146469274 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1aa80cd250 0x7f1aa8158d30 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:40.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.838+0000 7f1aada00640 1 -- 172.21.15.2:0/3146469274 >> 172.21.15.2:0/3146469274 conn(0x7f1aa806bc10 msgr2=0x7f1aa806f900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:40.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.838+0000 7f1aada00640 1 -- 172.21.15.2:0/3146469274 shutdown_connections 2024-09-10T08:47:40.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:40.838+0000 7f1aada00640 1 -- 172.21.15.2:0/3146469274 wait complete. 2024-09-10T08:47:40.853 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:47:41.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.010+0000 7f88ebe00640 1 Processor -- start 2024-09-10T08:47:41.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.010+0000 7f88ebe00640 1 -- start start 2024-09-10T08:47:41.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.011+0000 7f88ebe00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f88ec15e4c0 0x7f88ec0d2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:41.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.011+0000 7f88ebe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f88ec0cebc0 0x7f88ec0b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:41.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.011+0000 7f88ebe00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88ec0d4180 con 0x7f88ec0b6320 2024-09-10T08:47:41.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.011+0000 7f88ebe00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f88ec0b6750 con 0x7f88ec0cebc0 2024-09-10T08:47:41.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.011+0000 7f88ebe00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f88ec0d30e0 con 0x7f88ec15e4c0 2024-09-10T08:47:41.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.011+0000 7f88e3e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f88ec0cebc0 0x7f88ec0b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:41.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.011+0000 7f88eb400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f88ec0b6320 0x7f88ec06ccb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33330/0 (socket says 172.21.15.2:33330) 2024-09-10T08:47:41.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.011+0000 7f88eb400640 1 -- 172.21.15.2:0/2996062794 learned_addr learned my addr 172.21.15.2:0/2996062794 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:47:41.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.012+0000 7f88eaa00640 1 --2- 172.21.15.2:0/2996062794 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f88ec15e4c0 0x7f88ec0d2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:41.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.012+0000 7f88e3e00640 1 -- 172.21.15.2:0/2996062794 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f88ec15e4c0 msgr2=0x7f88ec0d2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:41.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.012+0000 7f88e3e00640 1 --2- 172.21.15.2:0/2996062794 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f88ec15e4c0 0x7f88ec0d2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:41.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.012+0000 7f88e3e00640 1 -- 172.21.15.2:0/2996062794 >> v1:172.21.15.2:6789/0 conn(0x7f88ec0b6320 legacy=0x7f88ec06ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:41.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.012+0000 7f88e3e00640 1 -- 172.21.15.2:0/2996062794 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88ec0d33c0 con 0x7f88ec0cebc0 2024-09-10T08:47:41.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.012+0000 7f88ea000640 1 -- 172.21.15.2:0/2996062794 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1041913148 0 0) 0x7f88e4001490 con 0x7f88ec0b6320 2024-09-10T08:47:41.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.012+0000 7f88eaa00640 1 --2- 172.21.15.2:0/2996062794 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f88ec15e4c0 0x7f88ec0d2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:47:41.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.013+0000 7f88e3e00640 1 --2- 172.21.15.2:0/2996062794 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88ec0cebc0 0x7f88ec0b5de0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f88d40097a0 tx=0x7f88d402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed03a665613a5fa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:41.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.013+0000 7f88ea000640 1 -- 172.21.15.2:0/2996062794 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d4037070 con 0x7f88ec0cebc0 2024-09-10T08:47:41.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.013+0000 7f88ea000640 1 -- 172.21.15.2:0/2996062794 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88d4032440 con 0x7f88ec0cebc0 2024-09-10T08:47:41.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.013+0000 7f88ea000640 1 -- 172.21.15.2:0/2996062794 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d4032810 con 0x7f88ec0cebc0 2024-09-10T08:47:41.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.014+0000 7f88ebe00640 1 -- 172.21.15.2:0/2996062794 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88ec0cebc0 msgr2=0x7f88ec0b5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:41.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.014+0000 7f88ebe00640 1 --2- 172.21.15.2:0/2996062794 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88ec0cebc0 0x7f88ec0b5de0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f88d40097a0 tx=0x7f88d402a180 comp rx=0 tx=0).stop 2024-09-10T08:47:41.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.014+0000 7f88ebe00640 1 -- 172.21.15.2:0/2996062794 shutdown_connections 2024-09-10T08:47:41.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.014+0000 7f88ebe00640 1 --2- 172.21.15.2:0/2996062794 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88ec0cebc0 0x7f88ec0b5de0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:41.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.014+0000 7f88ebe00640 1 --2- 172.21.15.2:0/2996062794 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f88ec15e4c0 0x7f88ec0d2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:41.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.014+0000 7f88ebe00640 1 -- 172.21.15.2:0/2996062794 >> 172.21.15.2:0/2996062794 conn(0x7f88ec0d0de0 msgr2=0x7f88ec0d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:41.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.014+0000 7f88ebe00640 1 -- 172.21.15.2:0/2996062794 shutdown_connections 2024-09-10T08:47:41.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.014+0000 7f88ebe00640 1 -- 172.21.15.2:0/2996062794 wait complete. 2024-09-10T08:47:41.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.015+0000 7f88ebe00640 1 Processor -- start 2024-09-10T08:47:41.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.016+0000 7f88ebe00640 1 -- start start 2024-09-10T08:47:41.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.016+0000 7f88ebe00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f88ec0b6320 0x7f88ec154790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:41.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.016+0000 7f88ebe00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f88ec0cebc0 0x7f88ec15a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:41.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.016+0000 7f88ebe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88ec15e4c0 0x7f88ec15ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:41.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.016+0000 7f88ebe00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f88ec0d3c60 con 0x7f88ec15e4c0 2024-09-10T08:47:41.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.016+0000 7f88ebe00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f88ec0d3980 con 0x7f88ec0cebc0 2024-09-10T08:47:41.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.016+0000 7f88ebe00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f88ec0d2dd0 con 0x7f88ec0b6320 2024-09-10T08:47:41.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.017+0000 7f88eb400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88ec15e4c0 0x7f88ec15ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:41.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.017+0000 7f88eb400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88ec15e4c0 0x7f88ec15ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60312/0 (socket says 172.21.15.2:60312) 2024-09-10T08:47:41.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.017+0000 7f88eb400640 1 -- 172.21.15.2:0/2669943937 learned_addr learned my addr 172.21.15.2:0/2669943937 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:41.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.017+0000 7f88eaa00640 1 --2- 172.21.15.2:0/2669943937 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f88ec0b6320 0x7f88ec154790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:41.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.017+0000 7f88e3e00640 1 --2- 172.21.15.2:0/2669943937 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f88ec0cebc0 0x7f88ec15a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:41.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.017+0000 7f88eb400640 1 -- 172.21.15.2:0/2669943937 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f88ec0b6320 msgr2=0x7f88ec154790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:41.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.017+0000 7f88eb400640 1 --2- 172.21.15.2:0/2669943937 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f88ec0b6320 0x7f88ec154790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:41.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.017+0000 7f88eb400640 1 -- 172.21.15.2:0/2669943937 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f88ec0cebc0 msgr2=0x7f88ec15a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:41.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.017+0000 7f88eb400640 1 --2- 172.21.15.2:0/2669943937 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f88ec0cebc0 0x7f88ec15a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:41.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.017+0000 7f88eb400640 1 -- 172.21.15.2:0/2669943937 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88ec1e6c30 con 0x7f88ec15e4c0 2024-09-10T08:47:41.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.017+0000 7f88eb400640 1 --2- 172.21.15.2:0/2669943937 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88ec15e4c0 0x7f88ec15ac90 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f88e400c6e0 tx=0x7f88e400cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:41.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.018+0000 7f88e2a00640 1 -- 172.21.15.2:0/2669943937 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88e4018070 con 0x7f88ec15e4c0 2024-09-10T08:47:41.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.018+0000 7f88e2a00640 1 -- 172.21.15.2:0/2669943937 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88e4004d80 con 0x7f88ec15e4c0 2024-09-10T08:47:41.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.018+0000 7f88ebe00640 1 -- 172.21.15.2:0/2669943937 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88ec1e6f10 con 0x7f88ec15e4c0 2024-09-10T08:47:41.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.018+0000 7f88e2a00640 1 -- 172.21.15.2:0/2669943937 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88e400a820 con 0x7f88ec15e4c0 2024-09-10T08:47:41.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.018+0000 7f88ebe00640 1 -- 172.21.15.2:0/2669943937 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88ec1e74d0 con 0x7f88ec15e4c0 2024-09-10T08:47:41.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.019+0000 7f88ebe00640 1 -- 172.21.15.2:0/2669943937 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88ec0cbb70 con 0x7f88ec15e4c0 2024-09-10T08:47:41.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.020+0000 7f88e2a00640 1 -- 172.21.15.2:0/2669943937 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f88e401b070 con 0x7f88ec15e4c0 2024-09-10T08:47:41.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.021+0000 7f88e2a00640 1 --2- 172.21.15.2:0/2669943937 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f88c806be30 0x7f88c806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:41.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.021+0000 7f88e2a00640 1 -- 172.21.15.2:0/2669943937 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f88e408a720 con 0x7f88ec15e4c0 2024-09-10T08:47:41.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.022+0000 7f88eaa00640 1 --2- 172.21.15.2:0/2669943937 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f88c806be30 0x7f88c806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:41.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.022+0000 7f88eaa00640 1 --2- 172.21.15.2:0/2669943937 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f88c806be30 0x7f88c806e2f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f88ec15b880 tx=0x7f88dc008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:41.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.026+0000 7f88e2a00640 1 -- 172.21.15.2:0/2669943937 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f88ec0d4180 con 0x7f88ec15e4c0 2024-09-10T08:47:41.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.211+0000 7f88ebe00640 1 -- 172.21.15.2:0/2669943937 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f88ec1e79a0 con 0x7f88ec15e4c0 2024-09-10T08:47:41.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.213+0000 7f88e2a00640 1 -- 172.21.15.2:0/2669943937 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18973 (secure 0 0 0) 0x7f88e4058650 con 0x7f88ec15e4c0 2024-09-10T08:47:41.213 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:47:41.213 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"fsid":"f20a15a7-d363-4d44-98cb-4f4f466b52b8","created":"2024-09-10T08:46:26.481619+0000","modified":"2024-09-10T08:47:32.517513+0000","last_up_change":"2024-09-10T08:46:39.323912+0000","last_in_change":"2024-09-10T08:46:29.499894+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:46:39.426180+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:46:49.214595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T08:46:50.168313+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T08:46:53.833162+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c90be333-506b-46d1-b00a-10d089a84776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6822","nonce":298678486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6823","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6826","nonce":298678486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6831","nonce":298678486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6829","nonce":298678486}]},"public_addr":"172.21.15.2:6822/298678486","cluster_addr":"172.21.15.2:6826/298678486","heartbeat_back_addr":"172.21.15.2:6831/298678486","heartbeat_front_addr":"172.21.15.2:6829/298678486","state":["exists","up"]},{"osd":1,"uuid":"3f8bdde8-6cd3-4112-8939-a876191c7368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6809","nonce":1619566025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6811","nonce":1619566025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6815","nonce":1619566025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6813","nonce":1619566025}]},"public_addr":"172.21.15.2:6809/1619566025","cluster_addr":"172.21.15.2:6811/1619566025","heartbeat_back_addr":"172.21.15.2:6815/1619566025","heartbeat_front_addr":"172.21.15.2:6813/1619566025","state":["exists","up"]},{"osd":2,"uuid":"3835f5ab-ed3a-4f46-ae6c-f0edf21708d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6801","nonce":3992427579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6803","nonce":3992427579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6807","nonce":3992427579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6805","nonce":3992427579}]},"public_addr":"172.21.15.2:6801/3992427579","cluster_addr":"172.21.15.2:6803/3992427579","heartbeat_back_addr":"172.21.15.2:6807/3992427579","heartbeat_front_addr":"172.21.15.2:6805/3992427579","state":["exists","up"]},{"osd":3,"uuid":"add6ad27-b411-4a82-9622-b0c1c1782cf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6817","nonce":1270626884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6819","nonce":1270626884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6827","nonce":1270626884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6824","nonce":1270626884}]},"public_addr":"172.21.15.2:6817/1270626884","cluster_addr":"172.21.15.2:6819/1270626884","heartbeat_back_addr":"172.21.15.2:6827/1270626884","heartbeat_front_addr":"172.21.15.2:6824/1270626884","state":["exists","up"]},{"osd":4,"uuid":"c7b642f4-8bd2-4262-9a82-ee1061cfab7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6803","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6806","nonce":553254873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6813","nonce":553254873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6822","nonce":553254873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6819","nonce":553254873}]},"public_addr":"172.21.15.155:6806/553254873","cluster_addr":"172.21.15.155:6813/553254873","heartbeat_back_addr":"172.21.15.155:6822/553254873","heartbeat_front_addr":"172.21.15.155:6819/553254873","state":["exists","up"]},{"osd":5,"uuid":"fb53289a-419f-46d8-9e3a-384ac529dc57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6805","nonce":2107688472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6811","nonce":2107688472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6823","nonce":2107688472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6817","nonce":2107688472}]},"public_addr":"172.21.15.155:6805/2107688472","cluster_addr":"172.21.15.155:6811/2107688472","heartbeat_back_addr":"172.21.15.155:6823/2107688472","heartbeat_front_addr":"172.21.15.155:6817/2107688472","state":["exists","up"]},{"osd":6,"uuid":"3f9ddd54-ede4-4565-aff6-ae1c07e7c678","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6825","nonce":944542383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6827","nonce":944542383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6831","nonce":944542383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6829","nonce":944542383}]},"public_addr":"172.21.15.155:6825/944542383","cluster_addr":"172.21.15.155:6827/944542383","heartbeat_back_addr":"172.21.15.155:6831/944542383","heartbeat_front_addr":"172.21.15.155:6829/944542383","state":["exists","up"]},{"osd":7,"uuid":"328d0681-eef4-4556-94e1-9745bd4adbe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6801","nonce":2220093913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6807","nonce":2220093913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6818","nonce":2220093913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6812","nonce":2220093913}]},"public_addr":"172.21.15.155:6801/2220093913","cluster_addr":"172.21.15.155:6807/2220093913","heartbeat_back_addr":"172.21.15.155:6818/2220093913","heartbeat_front_addr":"172.21.15.155:6812/2220093913","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.052980+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.104550+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.025661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:35.784354+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:35.863363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.322312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.100890+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:35.763584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:47:41.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.215+0000 7f88ebe00640 1 -- 172.21.15.2:0/2669943937 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f88c806be30 msgr2=0x7f88c806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:41.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.215+0000 7f88ebe00640 1 --2- 172.21.15.2:0/2669943937 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f88c806be30 0x7f88c806e2f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f88ec15b880 tx=0x7f88dc008040 comp rx=0 tx=0).stop 2024-09-10T08:47:41.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.215+0000 7f88ebe00640 1 -- 172.21.15.2:0/2669943937 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88ec15e4c0 msgr2=0x7f88ec15ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:41.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.215+0000 7f88ebe00640 1 --2- 172.21.15.2:0/2669943937 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88ec15e4c0 0x7f88ec15ac90 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f88e400c6e0 tx=0x7f88e400cba0 comp rx=0 tx=0).stop 2024-09-10T08:47:41.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.215+0000 7f88ebe00640 1 -- 172.21.15.2:0/2669943937 shutdown_connections 2024-09-10T08:47:41.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.215+0000 7f88ebe00640 1 --2- 172.21.15.2:0/2669943937 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88ec15e4c0 0x7f88ec15ac90 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:41.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.215+0000 7f88ebe00640 1 --2- 172.21.15.2:0/2669943937 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f88ec0cebc0 0x7f88ec15a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:41.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.215+0000 7f88ebe00640 1 --2- 172.21.15.2:0/2669943937 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f88c806be30 0x7f88c806e2f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:41.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.215+0000 7f88ebe00640 1 --2- 172.21.15.2:0/2669943937 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f88ec0b6320 0x7f88ec154790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:41.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.215+0000 7f88ebe00640 1 -- 172.21.15.2:0/2669943937 >> 172.21.15.2:0/2669943937 conn(0x7f88ec0d0de0 msgr2=0x7f88ec15d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:41.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.215+0000 7f88ebe00640 1 -- 172.21.15.2:0/2669943937 shutdown_connections 2024-09-10T08:47:41.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.215+0000 7f88ebe00640 1 -- 172.21.15.2:0/2669943937 wait complete. 2024-09-10T08:47:41.231 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T08:47:41.231 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:47:41.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.387+0000 7f94d4e00640 1 Processor -- start 2024-09-10T08:47:41.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.387+0000 7f94d4e00640 1 -- start start 2024-09-10T08:47:41.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.388+0000 7f94d4e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94d00d4d00 0x7f94d00d2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:41.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.388+0000 7f94d4e00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f94d00d3110 0x7f94d00b1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:41.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.388+0000 7f94d4e00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94d00d52e0 con 0x7f94d015e890 2024-09-10T08:47:41.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.388+0000 7f94d4e00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f94d00cfc10 con 0x7f94d00d3110 2024-09-10T08:47:41.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.388+0000 7f94d4e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f94d00d04b0 con 0x7f94d00d4d00 2024-09-10T08:47:41.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.389+0000 7f94c7e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94d00d4d00 0x7f94d00d2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:41.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.389+0000 7f94c7e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94d00d4d00 0x7f94d00d2bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.2:55310/0 (socket says 172.21.15.2:55310) 2024-09-10T08:47:41.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.389+0000 7f94c7e00640 1 -- 172.21.15.2:0/597356420 learned_addr learned my addr 172.21.15.2:0/597356420 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:41.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.389+0000 7f94ce800640 1 --2- 172.21.15.2:0/597356420 >> v2:172.21.15.155:3300/0 conn(0x7f94d00d3110 0x7f94d00b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:41.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.389+0000 7f94cd400640 1 -- 172.21.15.2:0/597356420 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1182169135 0 0) 0x7f94d00d52e0 con 0x7f94d015e890 2024-09-10T08:47:41.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.389+0000 7f94cd400640 1 -- 172.21.15.2:0/597356420 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f94b4003520 con 0x7f94d015e890 2024-09-10T08:47:41.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.389+0000 7f94c7e00640 1 -- 172.21.15.2:0/597356420 >> v2:172.21.15.155:3300/0 conn(0x7f94d00d3110 msgr2=0x7f94d00b1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:41.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.389+0000 7f94c7e00640 1 --2- 172.21.15.2:0/597356420 >> v2:172.21.15.155:3300/0 conn(0x7f94d00d3110 0x7f94d00b1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:41.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.389+0000 7f94c7e00640 1 -- 172.21.15.2:0/597356420 >> v1:172.21.15.155:6789/0 conn(0x7f94d015e890 legacy=0x7f94d00d22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:41.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.389+0000 7f94c7e00640 1 -- 172.21.15.2:0/597356420 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94d00cfe60 con 0x7f94d00d4d00 2024-09-10T08:47:41.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.389+0000 7f94ce800640 1 --2- 172.21.15.2:0/597356420 >> v2:172.21.15.155:3300/0 conn(0x7f94d00d3110 0x7f94d00b1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:47:41.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.390+0000 7f94c7e00640 1 --2- 172.21.15.2:0/597356420 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94d00d4d00 0x7f94d00d2bd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f94b8009870 tx=0x7f94b802a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=185f5f19d93c262b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:41.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.391+0000 7f94cd400640 1 -- 172.21.15.2:0/597356420 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b8037070 con 0x7f94d00d4d00 2024-09-10T08:47:41.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.391+0000 7f94cd400640 1 -- 172.21.15.2:0/597356420 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94b8032440 con 0x7f94d00d4d00 2024-09-10T08:47:41.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.391+0000 7f94cd400640 1 -- 172.21.15.2:0/597356420 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94b8032810 con 0x7f94d00d4d00 2024-09-10T08:47:41.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.391+0000 7f94d4e00640 1 -- 172.21.15.2:0/597356420 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94d00d4d00 msgr2=0x7f94d00d2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:41.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.391+0000 7f94d4e00640 1 --2- 172.21.15.2:0/597356420 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94d00d4d00 0x7f94d00d2bd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f94b8009870 tx=0x7f94b802a1c0 comp rx=0 tx=0).stop 2024-09-10T08:47:41.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.391+0000 7f94d4e00640 1 -- 172.21.15.2:0/597356420 shutdown_connections 2024-09-10T08:47:41.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.391+0000 7f94d4e00640 1 --2- 172.21.15.2:0/597356420 >> v2:172.21.15.155:3300/0 conn(0x7f94d00d3110 0x7f94d00b1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:41.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.391+0000 7f94d4e00640 1 --2- 172.21.15.2:0/597356420 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94d00d4d00 0x7f94d00d2bd0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:41.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.391+0000 7f94d4e00640 1 -- 172.21.15.2:0/597356420 >> 172.21.15.2:0/597356420 conn(0x7f94d008bfd0 msgr2=0x7f94d00d45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:41.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.391+0000 7f94d4e00640 1 -- 172.21.15.2:0/597356420 shutdown_connections 2024-09-10T08:47:41.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.391+0000 7f94d4e00640 1 -- 172.21.15.2:0/597356420 wait complete. 2024-09-10T08:47:41.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.393+0000 7f94d4e00640 1 Processor -- start 2024-09-10T08:47:41.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.393+0000 7f94d4e00640 1 -- start start 2024-09-10T08:47:41.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.394+0000 7f94d4e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94d00d3110 0x7f94d0160ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:41.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.394+0000 7f94d4e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94d00d4d00 0x7f94d0150a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:41.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.394+0000 7f94d4e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94d015e890 0x7f94d00c9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:41.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.394+0000 7f94d4e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f94d00b1bd0 con 0x7f94d015e890 2024-09-10T08:47:41.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.394+0000 7f94d4e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f94d00b1a50 con 0x7f94d00d3110 2024-09-10T08:47:41.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.394+0000 7f94d4e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f94d00b1d50 con 0x7f94d00d4d00 2024-09-10T08:47:41.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.394+0000 7f94ce800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94d015e890 0x7f94d00c9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:41.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.394+0000 7f94ce800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94d015e890 0x7f94d00c9bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60324/0 (socket says 172.21.15.2:60324) 2024-09-10T08:47:41.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.394+0000 7f94ce800640 1 -- 172.21.15.2:0/3052315114 learned_addr learned my addr 172.21.15.2:0/3052315114 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:41.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.394+0000 7f94c7e00640 1 --2- 172.21.15.2:0/3052315114 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94d00d4d00 0x7f94d0150a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:41.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.394+0000 7f94cde00640 1 --2- 172.21.15.2:0/3052315114 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94d00d3110 0x7f94d0160ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:41.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.395+0000 7f94ce800640 1 -- 172.21.15.2:0/3052315114 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94d00d4d00 msgr2=0x7f94d0150a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:41.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.395+0000 7f94ce800640 1 --2- 172.21.15.2:0/3052315114 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94d00d4d00 0x7f94d0150a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:41.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.395+0000 7f94ce800640 1 -- 172.21.15.2:0/3052315114 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94d00d3110 msgr2=0x7f94d0160ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:41.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.395+0000 7f94ce800640 1 --2- 172.21.15.2:0/3052315114 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94d00d3110 0x7f94d0160ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:41.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.395+0000 7f94ce800640 1 -- 172.21.15.2:0/3052315114 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94d0150f70 con 0x7f94d015e890 2024-09-10T08:47:41.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.395+0000 7f94c7e00640 1 --2- 172.21.15.2:0/3052315114 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94d00d4d00 0x7f94d0150a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:47:41.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.395+0000 7f94ce800640 1 --2- 172.21.15.2:0/3052315114 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94d015e890 0x7f94d00c9bb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f94c800efc0 tx=0x7f94c8009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:41.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.395+0000 7f94c6000640 1 -- 172.21.15.2:0/3052315114 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94c8018030 con 0x7f94d015e890 2024-09-10T08:47:41.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.395+0000 7f94c6000640 1 -- 172.21.15.2:0/3052315114 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94c800cde0 con 0x7f94d015e890 2024-09-10T08:47:41.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.395+0000 7f94c6000640 1 -- 172.21.15.2:0/3052315114 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94c8003bb0 con 0x7f94d015e890 2024-09-10T08:47:41.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.395+0000 7f94d4e00640 1 -- 172.21.15.2:0/3052315114 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94d015f820 con 0x7f94d015e890 2024-09-10T08:47:41.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.396+0000 7f94d4e00640 1 -- 172.21.15.2:0/3052315114 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94d015fde0 con 0x7f94d015e890 2024-09-10T08:47:41.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.397+0000 7f94d4e00640 1 -- 172.21.15.2:0/3052315114 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94d00b1510 con 0x7f94d015e890 2024-09-10T08:47:41.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.397+0000 7f94c6000640 1 -- 172.21.15.2:0/3052315114 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f94c8005d10 con 0x7f94d015e890 2024-09-10T08:47:41.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.398+0000 7f94c6000640 1 --2- 172.21.15.2:0/3052315114 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f94ac06be60 0x7f94ac06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:41.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.399+0000 7f94c6000640 1 -- 172.21.15.2:0/3052315114 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f94c808bc60 con 0x7f94d015e890 2024-09-10T08:47:41.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.399+0000 7f94cde00640 1 --2- 172.21.15.2:0/3052315114 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f94ac06be60 0x7f94ac06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:41.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.400+0000 7f94cde00640 1 --2- 172.21.15.2:0/3052315114 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f94ac06be60 0x7f94ac06e320 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f94c0007fd0 tx=0x7f94c0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:41.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.403+0000 7f94c6000640 1 -- 172.21.15.2:0/3052315114 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f94c8022070 con 0x7f94d015e890 2024-09-10T08:47:41.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.624+0000 7f94d4e00640 1 -- 172.21.15.2:0/3052315114 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f94d00d1b60 con 0x7f94d015e890 2024-09-10T08:47:41.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.625+0000 7f94c6000640 1 -- 172.21.15.2:0/3052315114 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5216 (secure 0 0 0) 0x7f94c8010040 con 0x7f94d015e890 2024-09-10T08:47:41.626 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:47:41.626 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":9,"btime":"2024-09-10T08:47:13:450812+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/4081738683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":4081738683},{"type":"v1","addr":"172.21.15.2:6835","nonce":4081738683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1478106484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":1478106484},{"type":"v1","addr":"172.21.15.155:6837","nonce":1478106484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/800933941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":800933941},{"type":"v1","addr":"172.21.15.2:6834","nonce":800933941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:46:51.181258+0000","modified":"2024-09-10T08:47:12.877562+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6836/2996773231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2996773231},{"type":"v1","addr":"172.21.15.155:6836","nonce":2996773231}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":1}]} 2024-09-10T08:47:41.627 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 9 2024-09-10T08:47:41.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.627+0000 7f94d4e00640 1 -- 172.21.15.2:0/3052315114 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f94ac06be60 msgr2=0x7f94ac06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:41.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.627+0000 7f94d4e00640 1 --2- 172.21.15.2:0/3052315114 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f94ac06be60 0x7f94ac06e320 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f94c0007fd0 tx=0x7f94c0009040 comp rx=0 tx=0).stop 2024-09-10T08:47:41.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.627+0000 7f94d4e00640 1 -- 172.21.15.2:0/3052315114 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94d015e890 msgr2=0x7f94d00c9bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:41.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.627+0000 7f94d4e00640 1 --2- 172.21.15.2:0/3052315114 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94d015e890 0x7f94d00c9bb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f94c800efc0 tx=0x7f94c8009f90 comp rx=0 tx=0).stop 2024-09-10T08:47:41.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.627+0000 7f94d4e00640 1 -- 172.21.15.2:0/3052315114 shutdown_connections 2024-09-10T08:47:41.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.627+0000 7f94d4e00640 1 --2- 172.21.15.2:0/3052315114 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f94d015e890 0x7f94d00c9bb0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:41.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.627+0000 7f94d4e00640 1 --2- 172.21.15.2:0/3052315114 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f94ac06be60 0x7f94ac06e320 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:41.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.627+0000 7f94d4e00640 1 --2- 172.21.15.2:0/3052315114 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f94d00d4d00 0x7f94d0150a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:41.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.627+0000 7f94d4e00640 1 --2- 172.21.15.2:0/3052315114 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94d00d3110 0x7f94d0160ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:41.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.627+0000 7f94d4e00640 1 -- 172.21.15.2:0/3052315114 >> 172.21.15.2:0/3052315114 conn(0x7f94d008bfd0 msgr2=0x7f94d00d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:41.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.627+0000 7f94d4e00640 1 -- 172.21.15.2:0/3052315114 shutdown_connections 2024-09-10T08:47:41.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.627+0000 7f94d4e00640 1 -- 172.21.15.2:0/3052315114 wait complete. 2024-09-10T08:47:41.644 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:47:41.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.801+0000 7fb838200640 1 Processor -- start 2024-09-10T08:47:41.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.801+0000 7fb838200640 1 -- start start 2024-09-10T08:47:41.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.802+0000 7fb838200640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb830145d20 0x7fb83015c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:41.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.802+0000 7fb838200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb8300cd460 0x7fb830160980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:41.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.802+0000 7fb838200640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb83006e4d0 con 0x7fb83006df80 2024-09-10T08:47:41.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.802+0000 7fb838200640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fb830146100 con 0x7fb8300cd460 2024-09-10T08:47:41.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.802+0000 7fb838200640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fb830160ec0 con 0x7fb830145d20 2024-09-10T08:47:41.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.803+0000 7fb836200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb8300cd460 0x7fb830160980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:41.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.803+0000 7fb836200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb8300cd460 0x7fb830160980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60334/0 (socket says 172.21.15.2:60334) 2024-09-10T08:47:41.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.803+0000 7fb836200640 1 -- 172.21.15.2:0/3213090882 learned_addr learned my addr 172.21.15.2:0/3213090882 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:41.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.803+0000 7fb835800640 1 --2- 172.21.15.2:0/3213090882 >> v2:172.21.15.155:3300/0 conn(0x7fb830145d20 0x7fb83015c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:41.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.803+0000 7fb836200640 1 -- 172.21.15.2:0/3213090882 >> v2:172.21.15.155:3300/0 conn(0x7fb830145d20 msgr2=0x7fb83015c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:41.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.803+0000 7fb836200640 1 --2- 172.21.15.2:0/3213090882 >> v2:172.21.15.155:3300/0 conn(0x7fb830145d20 0x7fb83015c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:41.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.803+0000 7fb836200640 1 -- 172.21.15.2:0/3213090882 >> v1:172.21.15.155:6789/0 conn(0x7fb83006df80 legacy=0x7fb8300ccd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:41.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.803+0000 7fb836200640 1 -- 172.21.15.2:0/3213090882 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb83006e7b0 con 0x7fb8300cd460 2024-09-10T08:47:41.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.804+0000 7fb836200640 1 --2- 172.21.15.2:0/3213090882 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb8300cd460 0x7fb830160980 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb828009e50 tx=0x7fb82802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1651140970b0ffca server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:41.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.804+0000 7fb82fe00640 1 -- 172.21.15.2:0/3213090882 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb828036070 con 0x7fb8300cd460 2024-09-10T08:47:41.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.805+0000 7fb82fe00640 1 -- 172.21.15.2:0/3213090882 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb828031600 con 0x7fb8300cd460 2024-09-10T08:47:41.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.805+0000 7fb82fe00640 1 -- 172.21.15.2:0/3213090882 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8280319d0 con 0x7fb8300cd460 2024-09-10T08:47:41.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.805+0000 7fb838200640 1 -- 172.21.15.2:0/3213090882 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb8300cd460 msgr2=0x7fb830160980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:41.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.805+0000 7fb838200640 1 --2- 172.21.15.2:0/3213090882 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb8300cd460 0x7fb830160980 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb828009e50 tx=0x7fb82802a660 comp rx=0 tx=0).stop 2024-09-10T08:47:41.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.805+0000 7fb838200640 1 -- 172.21.15.2:0/3213090882 shutdown_connections 2024-09-10T08:47:41.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.805+0000 7fb838200640 1 --2- 172.21.15.2:0/3213090882 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb8300cd460 0x7fb830160980 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:41.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.805+0000 7fb838200640 1 --2- 172.21.15.2:0/3213090882 >> v2:172.21.15.155:3300/0 conn(0x7fb830145d20 0x7fb83015c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:41.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.805+0000 7fb838200640 1 -- 172.21.15.2:0/3213090882 >> 172.21.15.2:0/3213090882 conn(0x7fb83006bc10 msgr2=0x7fb83006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:41.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.805+0000 7fb838200640 1 -- 172.21.15.2:0/3213090882 shutdown_connections 2024-09-10T08:47:41.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.805+0000 7fb838200640 1 -- 172.21.15.2:0/3213090882 wait complete. 2024-09-10T08:47:41.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.807+0000 7fb838200640 1 Processor -- start 2024-09-10T08:47:41.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.807+0000 7fb838200640 1 -- start start 2024-09-10T08:47:41.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.808+0000 7fb838200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb83006df80 0x7fb83013aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:41.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.808+0000 7fb838200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8300cd460 0x7fb8301f3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:41.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.808+0000 7fb838200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb830145d20 0x7fb8300b4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:41.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.808+0000 7fb838200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb83006ed70 con 0x7fb83006df80 2024-09-10T08:47:41.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.808+0000 7fb838200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb8300ce6b0 con 0x7fb8300cd460 2024-09-10T08:47:41.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.808+0000 7fb838200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb8300ceb40 con 0x7fb830145d20 2024-09-10T08:47:41.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.808+0000 7fb835800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb83006df80 0x7fb83013aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:41.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.808+0000 7fb835800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb83006df80 0x7fb83013aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60350/0 (socket says 172.21.15.2:60350) 2024-09-10T08:47:41.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.808+0000 7fb835800640 1 -- 172.21.15.2:0/2294091558 learned_addr learned my addr 172.21.15.2:0/2294091558 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:41.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.808+0000 7fb834e00640 1 --2- 172.21.15.2:0/2294091558 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8300cd460 0x7fb8301f3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:41.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.808+0000 7fb836200640 1 --2- 172.21.15.2:0/2294091558 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb830145d20 0x7fb8300b4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:41.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.808+0000 7fb835800640 1 -- 172.21.15.2:0/2294091558 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb830145d20 msgr2=0x7fb8300b4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:41.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.808+0000 7fb835800640 1 --2- 172.21.15.2:0/2294091558 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb830145d20 0x7fb8300b4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:41.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.808+0000 7fb835800640 1 -- 172.21.15.2:0/2294091558 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8300cd460 msgr2=0x7fb8301f3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:41.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.808+0000 7fb835800640 1 --2- 172.21.15.2:0/2294091558 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8300cd460 0x7fb8301f3550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:41.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.809+0000 7fb835800640 1 -- 172.21.15.2:0/2294091558 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8300ae350 con 0x7fb83006df80 2024-09-10T08:47:41.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.809+0000 7fb835800640 1 --2- 172.21.15.2:0/2294091558 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb83006df80 0x7fb83013aae0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb82400e870 tx=0x7fb82400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:41.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.809+0000 7fb82d600640 1 -- 172.21.15.2:0/2294091558 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb824017070 con 0x7fb83006df80 2024-09-10T08:47:41.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.809+0000 7fb82d600640 1 -- 172.21.15.2:0/2294091558 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb82400c940 con 0x7fb83006df80 2024-09-10T08:47:41.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.809+0000 7fb82d600640 1 -- 172.21.15.2:0/2294091558 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb82400cd30 con 0x7fb83006df80 2024-09-10T08:47:41.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.809+0000 7fb838200640 1 -- 172.21.15.2:0/2294091558 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8300ae630 con 0x7fb83006df80 2024-09-10T08:47:41.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.809+0000 7fb838200640 1 -- 172.21.15.2:0/2294091558 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8300aebf0 con 0x7fb83006df80 2024-09-10T08:47:41.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.810+0000 7fb838200640 1 -- 172.21.15.2:0/2294091558 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb830160980 con 0x7fb83006df80 2024-09-10T08:47:41.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.811+0000 7fb82d600640 1 -- 172.21.15.2:0/2294091558 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb82401a070 con 0x7fb83006df80 2024-09-10T08:47:41.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.812+0000 7fb82d600640 1 --2- 172.21.15.2:0/2294091558 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fb81006be30 0x7fb81006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:41.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.812+0000 7fb82d600640 1 -- 172.21.15.2:0/2294091558 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fb82408b520 con 0x7fb83006df80 2024-09-10T08:47:41.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.812+0000 7fb834e00640 1 --2- 172.21.15.2:0/2294091558 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fb81006be30 0x7fb81006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:41.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.813+0000 7fb834e00640 1 --2- 172.21.15.2:0/2294091558 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fb81006be30 0x7fb81006e2f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb8300af790 tx=0x7fb81c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:41.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:41.816+0000 7fb82d600640 1 -- 172.21.15.2:0/2294091558 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb824059330 con 0x7fb83006df80 2024-09-10T08:47:42.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.036+0000 7fb838200640 1 -- 172.21.15.2:0/2294091558 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb83006cf40 con 0x7fb83006df80 2024-09-10T08:47:42.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.037+0000 7fb82d600640 1 -- 172.21.15.2:0/2294091558 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5216 (secure 0 0 0) 0x7fb82405d630 con 0x7fb83006df80 2024-09-10T08:47:42.037 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:47:42.037 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":9,"btime":"2024-09-10T08:47:13:450812+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/4081738683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":4081738683},{"type":"v1","addr":"172.21.15.2:6835","nonce":4081738683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1478106484","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":1478106484},{"type":"v1","addr":"172.21.15.155:6837","nonce":1478106484}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/800933941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":800933941},{"type":"v1","addr":"172.21.15.2:6834","nonce":800933941}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:46:51.181258+0000","modified":"2024-09-10T08:47:12.877562+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.155:6836/2996773231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2996773231},{"type":"v1","addr":"172.21.15.155:6836","nonce":2996773231}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":1}]} 2024-09-10T08:47:42.037 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 9 2024-09-10T08:47:42.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.039+0000 7fb838200640 1 -- 172.21.15.2:0/2294091558 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fb81006be30 msgr2=0x7fb81006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:42.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.039+0000 7fb838200640 1 --2- 172.21.15.2:0/2294091558 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fb81006be30 0x7fb81006e2f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb8300af790 tx=0x7fb81c009040 comp rx=0 tx=0).stop 2024-09-10T08:47:42.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.039+0000 7fb838200640 1 -- 172.21.15.2:0/2294091558 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb83006df80 msgr2=0x7fb83013aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:42.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.039+0000 7fb838200640 1 --2- 172.21.15.2:0/2294091558 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb83006df80 0x7fb83013aae0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb82400e870 tx=0x7fb82400ed30 comp rx=0 tx=0).stop 2024-09-10T08:47:42.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.039+0000 7fb838200640 1 -- 172.21.15.2:0/2294091558 shutdown_connections 2024-09-10T08:47:42.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.039+0000 7fb838200640 1 --2- 172.21.15.2:0/2294091558 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fb81006be30 0x7fb81006e2f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:42.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.039+0000 7fb838200640 1 --2- 172.21.15.2:0/2294091558 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb830145d20 0x7fb8300b4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:42.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.039+0000 7fb838200640 1 --2- 172.21.15.2:0/2294091558 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8300cd460 0x7fb8301f3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:42.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.039+0000 7fb838200640 1 --2- 172.21.15.2:0/2294091558 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb83006df80 0x7fb83013aae0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:42.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.039+0000 7fb838200640 1 -- 172.21.15.2:0/2294091558 >> 172.21.15.2:0/2294091558 conn(0x7fb83006bc10 msgr2=0x7fb83015e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:42.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.039+0000 7fb838200640 1 -- 172.21.15.2:0/2294091558 shutdown_connections 2024-09-10T08:47:42.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.039+0000 7fb838200640 1 -- 172.21.15.2:0/2294091558 wait complete. 2024-09-10T08:47:42.056 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:47:42.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.212+0000 7f4bd8c00640 1 Processor -- start 2024-09-10T08:47:42.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.212+0000 7f4bd8c00640 1 -- start start 2024-09-10T08:47:42.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.214+0000 7f4bd8c00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4bd4067d30 0x7f4bd40b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:42.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.214+0000 7f4bd8c00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bd406ea10 con 0x7f4bd40b41e0 2024-09-10T08:47:42.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.214+0000 7f4bd8c00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bd406ecf0 con 0x7f4bd4067950 2024-09-10T08:47:42.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.214+0000 7f4bd8c00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f4bd406f620 con 0x7f4bd4067d30 2024-09-10T08:47:42.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.214+0000 7f4bd2800640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f4bd40b41e0 0x7f4bd40b4610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33332/0 (socket says 172.21.15.2:33332) 2024-09-10T08:47:42.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.214+0000 7f4bd2800640 1 -- 172.21.15.2:0/60154913 learned_addr learned my addr 172.21.15.2:0/60154913 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:47:42.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.214+0000 7f4bcbe00640 1 --2- 172.21.15.2:0/60154913 >> v2:172.21.15.155:3300/0 conn(0x7f4bd4067d30 0x7f4bd40b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:42.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.214+0000 7f4bd1400640 1 -- 172.21.15.2:0/60154913 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1790976784 0 0) 0x7f4bd406ea10 con 0x7f4bd40b41e0 2024-09-10T08:47:42.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.214+0000 7f4bd1400640 1 -- 172.21.15.2:0/60154913 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4bb8003520 con 0x7f4bd40b41e0 2024-09-10T08:47:42.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.215+0000 7f4bd1400640 1 -- 172.21.15.2:0/60154913 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2839437120 0 0) 0x7f4bb8003520 con 0x7f4bd40b41e0 2024-09-10T08:47:42.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.215+0000 7f4bd1400640 1 -- 172.21.15.2:0/60154913 >> v2:172.21.15.155:3300/0 conn(0x7f4bd4067d30 msgr2=0x7f4bd40b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:42.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.215+0000 7f4bd1400640 1 --2- 172.21.15.2:0/60154913 >> v2:172.21.15.155:3300/0 conn(0x7f4bd4067d30 0x7f4bd40b3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:42.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.215+0000 7f4bd1400640 1 -- 172.21.15.2:0/60154913 >> v1:172.21.15.155:6789/0 conn(0x7f4bd4067950 legacy=0x7f4bd415f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:42.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.215+0000 7f4bd1400640 1 -- 172.21.15.2:0/60154913 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bd406efd0 con 0x7f4bd40b41e0 2024-09-10T08:47:42.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.215+0000 7f4bd1400640 1 -- 172.21.15.2:0/60154913 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2345211856 0 0) 0x7f4bcc0019f0 con 0x7f4bd40b41e0 2024-09-10T08:47:42.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.215+0000 7f4bd1400640 1 -- 172.21.15.2:0/60154913 >> v1:172.21.15.2:6789/0 conn(0x7f4bd40b41e0 legacy=0x7f4bd40b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:42.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.215+0000 7f4bd1400640 1 --2- 172.21.15.2:0/60154913 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4bb8003a00 0x7f4bb8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:42.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.215+0000 7f4bd1400640 1 --2- 172.21.15.2:0/60154913 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bb8004800 0x7f4bb8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:42.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.215+0000 7f4bd1400640 1 --2- 172.21.15.2:0/60154913 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4bb8005210 0x7f4bb800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:42.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.215+0000 7f4bd1400640 1 -- 172.21.15.2:0/60154913 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd406f620 con 0x7f4bb8004800 2024-09-10T08:47:42.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.215+0000 7f4bd1400640 1 -- 172.21.15.2:0/60154913 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb800c160 con 0x7f4bb8005210 2024-09-10T08:47:42.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.215+0000 7f4bd1400640 1 -- 172.21.15.2:0/60154913 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4bb800c360 con 0x7f4bb8003a00 2024-09-10T08:47:42.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.215+0000 7f4bcbe00640 1 --2- 172.21.15.2:0/60154913 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bb8004800 0x7f4bb8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:42.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.215+0000 7f4bd1e00640 1 --2- 172.21.15.2:0/60154913 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4bb8003a00 0x7f4bb8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:42.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.215+0000 7f4bd2800640 1 --2- 172.21.15.2:0/60154913 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4bb8005210 0x7f4bb800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:42.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.216+0000 7f4bcbe00640 1 -- 172.21.15.2:0/60154913 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4bb8003a00 msgr2=0x7f4bb8003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:42.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.216+0000 7f4bcbe00640 1 --2- 172.21.15.2:0/60154913 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4bb8003a00 0x7f4bb8003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:42.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.216+0000 7f4bcbe00640 1 -- 172.21.15.2:0/60154913 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4bb8005210 msgr2=0x7f4bb800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:42.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.216+0000 7f4bcbe00640 1 --2- 172.21.15.2:0/60154913 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4bb8005210 0x7f4bb800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:42.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.216+0000 7f4bcbe00640 1 -- 172.21.15.2:0/60154913 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bb8003520 con 0x7f4bb8004800 2024-09-10T08:47:42.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.216+0000 7f4bd2800640 1 -- 172.21.15.2:0/60154913 reap_dead start 2024-09-10T08:47:42.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.217+0000 7f4bcbe00640 1 --2- 172.21.15.2:0/60154913 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bb8004800 0x7f4bb8004c80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc009a90 tx=0x7f4bb8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d83eef7e36c2645f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:42.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.217+0000 7f4bd1400640 1 -- 172.21.15.2:0/60154913 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bbc036070 con 0x7f4bb8004800 2024-09-10T08:47:42.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.217+0000 7f4bd1400640 1 -- 172.21.15.2:0/60154913 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bbc031400 con 0x7f4bb8004800 2024-09-10T08:47:42.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.217+0000 7f4bd1400640 1 -- 172.21.15.2:0/60154913 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bbc009690 con 0x7f4bb8004800 2024-09-10T08:47:42.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.217+0000 7f4bd8c00640 1 -- 172.21.15.2:0/60154913 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bb8004800 msgr2=0x7f4bb8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:42.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.217+0000 7f4bd8c00640 1 --2- 172.21.15.2:0/60154913 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bb8004800 0x7f4bb8004c80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc009a90 tx=0x7f4bb8005830 comp rx=0 tx=0).stop 2024-09-10T08:47:42.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.217+0000 7f4bd8c00640 1 -- 172.21.15.2:0/60154913 shutdown_connections 2024-09-10T08:47:42.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.217+0000 7f4bd8c00640 1 --2- 172.21.15.2:0/60154913 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bb8004800 0x7f4bb8004c80 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:42.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.217+0000 7f4bd8c00640 1 -- 172.21.15.2:0/60154913 >> 172.21.15.2:0/60154913 conn(0x7f4bd40735e0 msgr2=0x7f4bd406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:42.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.218+0000 7f4bd8c00640 1 -- 172.21.15.2:0/60154913 shutdown_connections 2024-09-10T08:47:42.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.218+0000 7f4bd8c00640 1 -- 172.21.15.2:0/60154913 wait complete. 2024-09-10T08:47:42.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.219+0000 7f4bd8c00640 1 Processor -- start 2024-09-10T08:47:42.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.219+0000 7f4bd8c00640 1 -- start start 2024-09-10T08:47:42.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.220+0000 7f4bd8c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4bb8004800 0x7f4bd414ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:42.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.220+0000 7f4bd8c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bd4156aa0 0x7f4bd4156f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:42.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.220+0000 7f4bd8c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4bd414ffe0 0x7f4bd4150460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:42.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.220+0000 7f4bd8c00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd4068170 con 0x7f4bd4156aa0 2024-09-10T08:47:42.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.220+0000 7f4bd8c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd406e700 con 0x7f4bd414ffe0 2024-09-10T08:47:42.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.220+0000 7f4bd8c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4bd4157440 con 0x7f4bb8004800 2024-09-10T08:47:42.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.220+0000 7f4bcbe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bd4156aa0 0x7f4bd4156f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:42.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.221+0000 7f4bcbe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bd4156aa0 0x7f4bd4156f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60364/0 (socket says 172.21.15.2:60364) 2024-09-10T08:47:42.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.221+0000 7f4bcbe00640 1 -- 172.21.15.2:0/3952453723 learned_addr learned my addr 172.21.15.2:0/3952453723 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:42.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.221+0000 7f4bd1e00640 1 --2- 172.21.15.2:0/3952453723 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4bb8004800 0x7f4bd414ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:42.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.221+0000 7f4bd2800640 1 --2- 172.21.15.2:0/3952453723 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4bd414ffe0 0x7f4bd4150460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:42.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.221+0000 7f4bcbe00640 1 -- 172.21.15.2:0/3952453723 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4bb8004800 msgr2=0x7f4bd414ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:42.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.221+0000 7f4bcbe00640 1 --2- 172.21.15.2:0/3952453723 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4bb8004800 0x7f4bd414ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:42.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.221+0000 7f4bcbe00640 1 -- 172.21.15.2:0/3952453723 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4bd414ffe0 msgr2=0x7f4bd4150460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:42.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.221+0000 7f4bcbe00640 1 --2- 172.21.15.2:0/3952453723 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4bd414ffe0 0x7f4bd4150460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:42.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.221+0000 7f4bcbe00640 1 -- 172.21.15.2:0/3952453723 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bd4150cf0 con 0x7f4bd4156aa0 2024-09-10T08:47:42.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.221+0000 7f4bcbe00640 1 --2- 172.21.15.2:0/3952453723 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bd4156aa0 0x7f4bd4156f00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc034040 tx=0x7f4bbc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:42.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.221+0000 7f4bca000640 1 -- 172.21.15.2:0/3952453723 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bbc03f030 con 0x7f4bd4156aa0 2024-09-10T08:47:42.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.221+0000 7f4bca000640 1 -- 172.21.15.2:0/3952453723 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bbc037040 con 0x7f4bd4156aa0 2024-09-10T08:47:42.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.221+0000 7f4bca000640 1 -- 172.21.15.2:0/3952453723 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bbc036070 con 0x7f4bd4156aa0 2024-09-10T08:47:42.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.221+0000 7f4bd8c00640 1 -- 172.21.15.2:0/3952453723 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bd4150fd0 con 0x7f4bd4156aa0 2024-09-10T08:47:42.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.222+0000 7f4bd8c00640 1 -- 172.21.15.2:0/3952453723 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bd4151590 con 0x7f4bd4156aa0 2024-09-10T08:47:42.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.223+0000 7f4bd8c00640 1 -- 172.21.15.2:0/3952453723 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bd40b5690 con 0x7f4bd4156aa0 2024-09-10T08:47:42.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.223+0000 7f4bca000640 1 -- 172.21.15.2:0/3952453723 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4bbc042070 con 0x7f4bd4156aa0 2024-09-10T08:47:42.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.225+0000 7f4bca000640 1 --2- 172.21.15.2:0/3952453723 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f4bb006be30 0x7f4bb006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:42.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.225+0000 7f4bca000640 1 -- 172.21.15.2:0/3952453723 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f4bbc0ab1b0 con 0x7f4bd4156aa0 2024-09-10T08:47:42.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.225+0000 7f4bd1e00640 1 --2- 172.21.15.2:0/3952453723 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f4bb006be30 0x7f4bb006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:42.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.226+0000 7f4bd1e00640 1 --2- 172.21.15.2:0/3952453723 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f4bb006be30 0x7f4bb006e2f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4bd4076e00 tx=0x7f4bc4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:42.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.229+0000 7f4bca000640 1 -- 172.21.15.2:0/3952453723 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4bd40b5690 con 0x7f4bd4156aa0 2024-09-10T08:47:42.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.414+0000 7f4bd8c00640 1 -- 172.21.15.2:0/3952453723 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4bd4162ff0 con 0x7f4bd4156aa0 2024-09-10T08:47:42.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.415+0000 7f4bca000640 1 -- 172.21.15.2:0/3952453723 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18973 (secure 0 0 0) 0x7f4bbc0797d0 con 0x7f4bd4156aa0 2024-09-10T08:47:42.416 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:47:42.416 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":26,"fsid":"f20a15a7-d363-4d44-98cb-4f4f466b52b8","created":"2024-09-10T08:46:26.481619+0000","modified":"2024-09-10T08:47:32.517513+0000","last_up_change":"2024-09-10T08:46:39.323912+0000","last_in_change":"2024-09-10T08:46:29.499894+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:46:39.426180+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:46:49.214595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-10T08:46:50.168313+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-10T08:46:53.833162+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c90be333-506b-46d1-b00a-10d089a84776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6822","nonce":298678486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6823","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6826","nonce":298678486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6831","nonce":298678486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6829","nonce":298678486}]},"public_addr":"172.21.15.2:6822/298678486","cluster_addr":"172.21.15.2:6826/298678486","heartbeat_back_addr":"172.21.15.2:6831/298678486","heartbeat_front_addr":"172.21.15.2:6829/298678486","state":["exists","up"]},{"osd":1,"uuid":"3f8bdde8-6cd3-4112-8939-a876191c7368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6809","nonce":1619566025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6811","nonce":1619566025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6815","nonce":1619566025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6813","nonce":1619566025}]},"public_addr":"172.21.15.2:6809/1619566025","cluster_addr":"172.21.15.2:6811/1619566025","heartbeat_back_addr":"172.21.15.2:6815/1619566025","heartbeat_front_addr":"172.21.15.2:6813/1619566025","state":["exists","up"]},{"osd":2,"uuid":"3835f5ab-ed3a-4f46-ae6c-f0edf21708d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6801","nonce":3992427579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6803","nonce":3992427579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6807","nonce":3992427579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6805","nonce":3992427579}]},"public_addr":"172.21.15.2:6801/3992427579","cluster_addr":"172.21.15.2:6803/3992427579","heartbeat_back_addr":"172.21.15.2:6807/3992427579","heartbeat_front_addr":"172.21.15.2:6805/3992427579","state":["exists","up"]},{"osd":3,"uuid":"add6ad27-b411-4a82-9622-b0c1c1782cf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6817","nonce":1270626884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6819","nonce":1270626884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6827","nonce":1270626884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6824","nonce":1270626884}]},"public_addr":"172.21.15.2:6817/1270626884","cluster_addr":"172.21.15.2:6819/1270626884","heartbeat_back_addr":"172.21.15.2:6827/1270626884","heartbeat_front_addr":"172.21.15.2:6824/1270626884","state":["exists","up"]},{"osd":4,"uuid":"c7b642f4-8bd2-4262-9a82-ee1061cfab7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6803","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6806","nonce":553254873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6813","nonce":553254873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6822","nonce":553254873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6819","nonce":553254873}]},"public_addr":"172.21.15.155:6806/553254873","cluster_addr":"172.21.15.155:6813/553254873","heartbeat_back_addr":"172.21.15.155:6822/553254873","heartbeat_front_addr":"172.21.15.155:6819/553254873","state":["exists","up"]},{"osd":5,"uuid":"fb53289a-419f-46d8-9e3a-384ac529dc57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6805","nonce":2107688472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6811","nonce":2107688472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6823","nonce":2107688472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6817","nonce":2107688472}]},"public_addr":"172.21.15.155:6805/2107688472","cluster_addr":"172.21.15.155:6811/2107688472","heartbeat_back_addr":"172.21.15.155:6823/2107688472","heartbeat_front_addr":"172.21.15.155:6817/2107688472","state":["exists","up"]},{"osd":6,"uuid":"3f9ddd54-ede4-4565-aff6-ae1c07e7c678","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6825","nonce":944542383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6827","nonce":944542383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6831","nonce":944542383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6829","nonce":944542383}]},"public_addr":"172.21.15.155:6825/944542383","cluster_addr":"172.21.15.155:6827/944542383","heartbeat_back_addr":"172.21.15.155:6831/944542383","heartbeat_front_addr":"172.21.15.155:6829/944542383","state":["exists","up"]},{"osd":7,"uuid":"328d0681-eef4-4556-94e1-9745bd4adbe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6801","nonce":2220093913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6807","nonce":2220093913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6818","nonce":2220093913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6812","nonce":2220093913}]},"public_addr":"172.21.15.155:6801/2220093913","cluster_addr":"172.21.15.155:6807/2220093913","heartbeat_back_addr":"172.21.15.155:6818/2220093913","heartbeat_front_addr":"172.21.15.155:6812/2220093913","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.052980+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.104550+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.025661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:35.784354+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:35.863363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.322312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.100890+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:35.763584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":3,"to":1}]},{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:47:42.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.417+0000 7f4bd8c00640 1 -- 172.21.15.2:0/3952453723 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f4bb006be30 msgr2=0x7f4bb006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:42.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.417+0000 7f4bd8c00640 1 --2- 172.21.15.2:0/3952453723 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f4bb006be30 0x7f4bb006e2f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4bd4076e00 tx=0x7f4bc4009040 comp rx=0 tx=0).stop 2024-09-10T08:47:42.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.417+0000 7f4bd8c00640 1 -- 172.21.15.2:0/3952453723 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bd4156aa0 msgr2=0x7f4bd4156f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:42.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.417+0000 7f4bd8c00640 1 --2- 172.21.15.2:0/3952453723 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bd4156aa0 0x7f4bd4156f00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc034040 tx=0x7f4bbc004730 comp rx=0 tx=0).stop 2024-09-10T08:47:42.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.418+0000 7f4bd8c00640 1 -- 172.21.15.2:0/3952453723 shutdown_connections 2024-09-10T08:47:42.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.418+0000 7f4bd8c00640 1 --2- 172.21.15.2:0/3952453723 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4bd414ffe0 0x7f4bd4150460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:42.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.418+0000 7f4bd8c00640 1 --2- 172.21.15.2:0/3952453723 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4bd4156aa0 0x7f4bd4156f00 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:42.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.418+0000 7f4bd8c00640 1 --2- 172.21.15.2:0/3952453723 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f4bb006be30 0x7f4bb006e2f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:42.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.418+0000 7f4bd8c00640 1 --2- 172.21.15.2:0/3952453723 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4bb8004800 0x7f4bd414ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:42.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.418+0000 7f4bd8c00640 1 -- 172.21.15.2:0/3952453723 >> 172.21.15.2:0/3952453723 conn(0x7f4bd40735e0 msgr2=0x7f4bd406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:42.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.418+0000 7f4bd8c00640 1 -- 172.21.15.2:0/3952453723 shutdown_connections 2024-09-10T08:47:42.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.418+0000 7f4bd8c00640 1 -- 172.21.15.2:0/3952453723 wait complete. 2024-09-10T08:47:42.435 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-10T08:47:42.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.596+0000 7f9b37200640 1 Processor -- start 2024-09-10T08:47:42.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.596+0000 7f9b37200640 1 -- start start 2024-09-10T08:47:42.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.597+0000 7f9b37200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b3815e500 0x7f9b380cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:42.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.597+0000 7f9b37200640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b380d0350 con 0x7f9b380d4d90 2024-09-10T08:47:42.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.597+0000 7f9b37200640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b380d2080 con 0x7f9b380d0b50 2024-09-10T08:47:42.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.597+0000 7f9b37200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9b3815e8e0 con 0x7f9b3815e500 2024-09-10T08:47:42.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.597+0000 7f9b35400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f9b380d4d90 0x7f9b380d2e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33342/0 (socket says 172.21.15.2:33342) 2024-09-10T08:47:42.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.597+0000 7f9b35400640 1 -- 172.21.15.2:0/2591356499 learned_addr learned my addr 172.21.15.2:0/2591356499 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:47:42.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.598+0000 7f9b35e00640 1 --2- 172.21.15.2:0/2591356499 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b3815e500 0x7f9b380cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:42.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.598+0000 7f9b34a00640 1 -- 172.21.15.2:0/2591356499 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3037510059 0 0) 0x7f9b380d0350 con 0x7f9b380d4d90 2024-09-10T08:47:42.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.598+0000 7f9b34a00640 1 -- 172.21.15.2:0/2591356499 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b1c003520 con 0x7f9b380d4d90 2024-09-10T08:47:42.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.598+0000 7f9b34a00640 1 -- 172.21.15.2:0/2591356499 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4041677137 0 0) 0x7f9b380d2080 con 0x7f9b380d0b50 2024-09-10T08:47:42.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.598+0000 7f9b34a00640 1 -- 172.21.15.2:0/2591356499 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b380d0350 con 0x7f9b380d0b50 2024-09-10T08:47:42.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.598+0000 7f9b34a00640 1 -- 172.21.15.2:0/2591356499 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3031859773 0 0) 0x7f9b1c003520 con 0x7f9b380d4d90 2024-09-10T08:47:42.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.598+0000 7f9b35e00640 1 -- 172.21.15.2:0/2591356499 >> v1:172.21.15.155:6789/0 conn(0x7f9b380d0b50 legacy=0x7f9b380b7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:42.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.598+0000 7f9b35e00640 1 -- 172.21.15.2:0/2591356499 >> v1:172.21.15.2:6789/0 conn(0x7f9b380d4d90 legacy=0x7f9b380d2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:42.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.598+0000 7f9b35e00640 1 -- 172.21.15.2:0/2591356499 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b380d2360 con 0x7f9b3815e500 2024-09-10T08:47:42.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.600+0000 7f9b35e00640 1 --2- 172.21.15.2:0/2591356499 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b3815e500 0x7f9b380cefb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9b280097d0 tx=0x7f9b2802a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89984134af630f5b server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:42.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.600+0000 7f9b34a00640 1 -- 172.21.15.2:0/2591356499 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b28037070 con 0x7f9b3815e500 2024-09-10T08:47:42.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.600+0000 7f9b34a00640 1 -- 172.21.15.2:0/2591356499 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b2802ac30 con 0x7f9b3815e500 2024-09-10T08:47:42.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.600+0000 7f9b34a00640 1 -- 172.21.15.2:0/2591356499 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b240015f0 con 0x7f9b3815e500 2024-09-10T08:47:42.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.600+0000 7f9b37200640 1 -- 172.21.15.2:0/2591356499 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b3815e500 msgr2=0x7f9b380cefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:42.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.600+0000 7f9b37200640 1 --2- 172.21.15.2:0/2591356499 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b3815e500 0x7f9b380cefb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9b280097d0 tx=0x7f9b2802a1a0 comp rx=0 tx=0).stop 2024-09-10T08:47:42.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.600+0000 7f9b37200640 1 -- 172.21.15.2:0/2591356499 shutdown_connections 2024-09-10T08:47:42.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.600+0000 7f9b37200640 1 --2- 172.21.15.2:0/2591356499 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b3815e500 0x7f9b380cefb0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:42.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.600+0000 7f9b37200640 1 -- 172.21.15.2:0/2591356499 >> 172.21.15.2:0/2591356499 conn(0x7f9b3809d720 msgr2=0x7f9b380d4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:42.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.600+0000 7f9b37200640 1 -- 172.21.15.2:0/2591356499 shutdown_connections 2024-09-10T08:47:42.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.601+0000 7f9b37200640 1 -- 172.21.15.2:0/2591356499 wait complete. 2024-09-10T08:47:42.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.602+0000 7f9b37200640 1 Processor -- start 2024-09-10T08:47:42.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.602+0000 7f9b37200640 1 -- start start 2024-09-10T08:47:42.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.603+0000 7f9b37200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b380d0b50 0x7f9b380cc910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:42.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.603+0000 7f9b37200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b380d4d90 0x7f9b380ce150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:42.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.603+0000 7f9b37200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b3815e500 0x7f9b3815d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:42.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.603+0000 7f9b37200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9b380cff90 con 0x7f9b380d4d90 2024-09-10T08:47:42.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.603+0000 7f9b37200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9b380d2920 con 0x7f9b380d0b50 2024-09-10T08:47:42.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.603+0000 7f9b37200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9b380d0110 con 0x7f9b3815e500 2024-09-10T08:47:42.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.603+0000 7f9b35400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b380d4d90 0x7f9b380ce150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:42.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.603+0000 7f9b35400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b380d4d90 0x7f9b380ce150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60366/0 (socket says 172.21.15.2:60366) 2024-09-10T08:47:42.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.603+0000 7f9b35400640 1 -- 172.21.15.2:0/2227863447 learned_addr learned my addr 172.21.15.2:0/2227863447 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:42.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.604+0000 7f9b36800640 1 --2- 172.21.15.2:0/2227863447 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b3815e500 0x7f9b3815d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:42.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.604+0000 7f9b35e00640 1 --2- 172.21.15.2:0/2227863447 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b380d0b50 0x7f9b380cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:42.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.604+0000 7f9b35400640 1 -- 172.21.15.2:0/2227863447 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b3815e500 msgr2=0x7f9b3815d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:42.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.604+0000 7f9b35400640 1 --2- 172.21.15.2:0/2227863447 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b3815e500 0x7f9b3815d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:42.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.604+0000 7f9b35400640 1 -- 172.21.15.2:0/2227863447 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b380d0b50 msgr2=0x7f9b380cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:42.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.604+0000 7f9b35400640 1 --2- 172.21.15.2:0/2227863447 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b380d0b50 0x7f9b380cc910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:42.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.604+0000 7f9b35400640 1 -- 172.21.15.2:0/2227863447 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b380ce690 con 0x7f9b380d4d90 2024-09-10T08:47:42.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.604+0000 7f9b36800640 1 --2- 172.21.15.2:0/2227863447 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b3815e500 0x7f9b3815d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:47:42.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.604+0000 7f9b35e00640 1 --2- 172.21.15.2:0/2227863447 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b380d0b50 0x7f9b380cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:47:42.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.604+0000 7f9b35400640 1 --2- 172.21.15.2:0/2227863447 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b380d4d90 0x7f9b380ce150 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9b2400c730 tx=0x7f9b2400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:42.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.604+0000 7f9b2e000640 1 -- 172.21.15.2:0/2227863447 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b24017070 con 0x7f9b380d4d90 2024-09-10T08:47:42.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.604+0000 7f9b2e000640 1 -- 172.21.15.2:0/2227863447 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b24005ad0 con 0x7f9b380d4d90 2024-09-10T08:47:42.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.604+0000 7f9b2e000640 1 -- 172.21.15.2:0/2227863447 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b24007070 con 0x7f9b380d4d90 2024-09-10T08:47:42.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.604+0000 7f9b37200640 1 -- 172.21.15.2:0/2227863447 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b381603e0 con 0x7f9b380d4d90 2024-09-10T08:47:42.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.605+0000 7f9b37200640 1 -- 172.21.15.2:0/2227863447 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b381609a0 con 0x7f9b380d4d90 2024-09-10T08:47:42.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.606+0000 7f9b37200640 1 -- 172.21.15.2:0/2227863447 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b380cefb0 con 0x7f9b380d4d90 2024-09-10T08:47:42.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.606+0000 7f9b2e000640 1 -- 172.21.15.2:0/2227863447 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9b2401a070 con 0x7f9b380d4d90 2024-09-10T08:47:42.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.607+0000 7f9b2e000640 1 --2- 172.21.15.2:0/2227863447 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f9b1806be30 0x7f9b1806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:42.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.607+0000 7f9b2e000640 1 -- 172.21.15.2:0/2227863447 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f9b2408a650 con 0x7f9b380d4d90 2024-09-10T08:47:42.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.608+0000 7f9b35e00640 1 --2- 172.21.15.2:0/2227863447 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f9b1806be30 0x7f9b1806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:42.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.609+0000 7f9b35e00640 1 --2- 172.21.15.2:0/2227863447 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f9b1806be30 0x7f9b1806e2f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9b28034000 tx=0x7f9b2802e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:42.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.612+0000 7f9b2e000640 1 -- 172.21.15.2:0/2227863447 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9b380ce690 con 0x7f9b380d4d90 2024-09-10T08:47:42.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.829+0000 7f9b37200640 1 -- 172.21.15.2:0/2227863447 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f9b380d1a20 con 0x7f9b380d4d90 2024-09-10T08:47:42.830 INFO:tasks.ceph.mon.a.smithi002.stderr:2024-09-10T08:47:42.830+0000 7f03c9600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T08:47:42.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.832+0000 7f9b2e000640 1 -- 172.21.15.2:0/2227863447 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) ==== 161+0+0 (secure 0 0 0) 0x7f9b24058580 con 0x7f9b380d4d90 2024-09-10T08:47:42.832 INFO:teuthology.orchestra.run.smithi002.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T08:47:42.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.835+0000 7f9b37200640 1 -- 172.21.15.2:0/2227863447 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f9b1806be30 msgr2=0x7f9b1806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:42.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.835+0000 7f9b37200640 1 --2- 172.21.15.2:0/2227863447 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f9b1806be30 0x7f9b1806e2f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9b28034000 tx=0x7f9b2802e000 comp rx=0 tx=0).stop 2024-09-10T08:47:42.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.835+0000 7f9b37200640 1 -- 172.21.15.2:0/2227863447 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b380d4d90 msgr2=0x7f9b380ce150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:42.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.835+0000 7f9b37200640 1 --2- 172.21.15.2:0/2227863447 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b380d4d90 0x7f9b380ce150 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9b2400c730 tx=0x7f9b2400cbf0 comp rx=0 tx=0).stop 2024-09-10T08:47:42.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.835+0000 7f9b37200640 1 -- 172.21.15.2:0/2227863447 shutdown_connections 2024-09-10T08:47:42.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.835+0000 7f9b37200640 1 --2- 172.21.15.2:0/2227863447 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f9b1806be30 0x7f9b1806e2f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:42.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.835+0000 7f9b37200640 1 --2- 172.21.15.2:0/2227863447 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b3815e500 0x7f9b3815d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:42.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.835+0000 7f9b37200640 1 --2- 172.21.15.2:0/2227863447 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b380d4d90 0x7f9b380ce150 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:42.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.835+0000 7f9b37200640 1 --2- 172.21.15.2:0/2227863447 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b380d0b50 0x7f9b380cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:42.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.835+0000 7f9b37200640 1 -- 172.21.15.2:0/2227863447 >> 172.21.15.2:0/2227863447 conn(0x7f9b3809d720 msgr2=0x7f9b380b7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:42.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.835+0000 7f9b37200640 1 -- 172.21.15.2:0/2227863447 shutdown_connections 2024-09-10T08:47:42.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:42.835+0000 7f9b37200640 1 -- 172.21.15.2:0/2227863447 wait complete. 2024-09-10T08:47:42.847 INFO:tasks.ceph.mds.b.smithi155.stderr: -4658> 2024-09-10T08:46:56.726+0000 7f1257c00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T08:47:42.853 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T08:47:42.900 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2024-09-10T08:47:43.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.014+0000 7f794e400640 1 Processor -- start 2024-09-10T08:47:43.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.014+0000 7f794e400640 1 -- start start 2024-09-10T08:47:43.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.015+0000 7f794e400640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7948161cb0 0x7f79480d0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:43.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.015+0000 7f794e400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79480b59e0 0x7f79480d1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:43.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.015+0000 7f794e400640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79480d0550 con 0x7f7948162090 2024-09-10T08:47:43.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.015+0000 7f794e400640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f79480d3090 con 0x7f7948161cb0 2024-09-10T08:47:43.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.015+0000 7f794e400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f79480d2760 con 0x7f79480b59e0 2024-09-10T08:47:43.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.016+0000 7f794d000640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7948161cb0 0x7f79480d0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:43.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.016+0000 7f7947e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79480b59e0 0x7f79480d1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:43.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.016+0000 7f794d000640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7948161cb0 0x7f79480d0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.2:46012/0 (socket says 172.21.15.2:46012) 2024-09-10T08:47:43.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.016+0000 7f794d000640 1 -- 172.21.15.2:0/1710824206 learned_addr learned my addr 172.21.15.2:0/1710824206 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:43.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.016+0000 7f7947e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79480b59e0 0x7f79480d1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.2:55360/0 (socket says 172.21.15.2:55360) 2024-09-10T08:47:43.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.016+0000 7f794d000640 1 -- 172.21.15.2:0/1710824206 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79480b59e0 msgr2=0x7f79480d1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:43.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.016+0000 7f794d000640 1 --2- 172.21.15.2:0/1710824206 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79480b59e0 0x7f79480d1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:43.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.016+0000 7f794d000640 1 -- 172.21.15.2:0/1710824206 >> v1:172.21.15.155:6789/0 conn(0x7f7948162090 legacy=0x7f79480b3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:43.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.016+0000 7f794d000640 1 -- 172.21.15.2:0/1710824206 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79480d2a40 con 0x7f7948161cb0 2024-09-10T08:47:43.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.017+0000 7f794d000640 1 --2- 172.21.15.2:0/1710824206 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7948161cb0 0x7f79480d0e00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f793c009870 tx=0x7f793c02a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db31f0faeac38ae2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:43.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.017+0000 7f7947400640 1 -- 172.21.15.2:0/1710824206 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f793c037070 con 0x7f7948161cb0 2024-09-10T08:47:43.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.018+0000 7f7947400640 1 -- 172.21.15.2:0/1710824206 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f793c032440 con 0x7f7948161cb0 2024-09-10T08:47:43.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.018+0000 7f7947400640 1 -- 172.21.15.2:0/1710824206 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f793c032810 con 0x7f7948161cb0 2024-09-10T08:47:43.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.018+0000 7f794e400640 1 -- 172.21.15.2:0/1710824206 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7948161cb0 msgr2=0x7f79480d0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:43.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.018+0000 7f794e400640 1 --2- 172.21.15.2:0/1710824206 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7948161cb0 0x7f79480d0e00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f793c009870 tx=0x7f793c02a270 comp rx=0 tx=0).stop 2024-09-10T08:47:43.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.018+0000 7f794e400640 1 -- 172.21.15.2:0/1710824206 shutdown_connections 2024-09-10T08:47:43.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.018+0000 7f794e400640 1 --2- 172.21.15.2:0/1710824206 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f79480b59e0 0x7f79480d1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:43.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.018+0000 7f794e400640 1 --2- 172.21.15.2:0/1710824206 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7948161cb0 0x7f79480d0e00 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:43.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.018+0000 7f794e400640 1 -- 172.21.15.2:0/1710824206 >> 172.21.15.2:0/1710824206 conn(0x7f794809d700 msgr2=0x7f79480d4430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:43.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.018+0000 7f794e400640 1 -- 172.21.15.2:0/1710824206 shutdown_connections 2024-09-10T08:47:43.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.018+0000 7f794e400640 1 -- 172.21.15.2:0/1710824206 wait complete. 2024-09-10T08:47:43.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.020+0000 7f794e400640 1 Processor -- start 2024-09-10T08:47:43.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.020+0000 7f794e400640 1 -- start start 2024-09-10T08:47:43.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.021+0000 7f794e400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79480b59e0 0x7f794815a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:43.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.021+0000 7f794e400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7948161cb0 0x7f79480cd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:43.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.021+0000 7f794e400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7948162090 0x7f79480cd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:43.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.021+0000 7f794e400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f79480d01d0 con 0x7f79480b59e0 2024-09-10T08:47:43.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.021+0000 7f794e400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f79480d0050 con 0x7f7948162090 2024-09-10T08:47:43.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.021+0000 7f794e400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f79480b3080 con 0x7f7948161cb0 2024-09-10T08:47:43.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.021+0000 7f794d000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79480b59e0 0x7f794815a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:43.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.021+0000 7f794d000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79480b59e0 0x7f794815a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60372/0 (socket says 172.21.15.2:60372) 2024-09-10T08:47:43.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.021+0000 7f794d000640 1 -- 172.21.15.2:0/3946299010 learned_addr learned my addr 172.21.15.2:0/3946299010 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:43.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.021+0000 7f7947e00640 1 --2- 172.21.15.2:0/3946299010 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7948161cb0 0x7f79480cd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:43.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.021+0000 7f794da00640 1 --2- 172.21.15.2:0/3946299010 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7948162090 0x7f79480cd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:43.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.021+0000 7f794d000640 1 -- 172.21.15.2:0/3946299010 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7948161cb0 msgr2=0x7f79480cd0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:43.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.021+0000 7f794d000640 1 --2- 172.21.15.2:0/3946299010 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7948161cb0 0x7f79480cd0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:43.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.021+0000 7f794d000640 1 -- 172.21.15.2:0/3946299010 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7948162090 msgr2=0x7f79480cd5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:43.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.021+0000 7f794d000640 1 --2- 172.21.15.2:0/3946299010 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7948162090 0x7f79480cd5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:43.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.021+0000 7f794d000640 1 -- 172.21.15.2:0/3946299010 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f794815e660 con 0x7f79480b59e0 2024-09-10T08:47:43.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.021+0000 7f794da00640 1 --2- 172.21.15.2:0/3946299010 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7948162090 0x7f79480cd5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:47:43.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.022+0000 7f794d000640 1 --2- 172.21.15.2:0/3946299010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79480b59e0 0x7f794815a300 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f793c000c00 tx=0x7f793c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:43.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.022+0000 7f7944c00640 1 -- 172.21.15.2:0/3946299010 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f793c037040 con 0x7f79480b59e0 2024-09-10T08:47:43.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.022+0000 7f7944c00640 1 -- 172.21.15.2:0/3946299010 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f793c042070 con 0x7f79480b59e0 2024-09-10T08:47:43.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.022+0000 7f794e400640 1 -- 172.21.15.2:0/3946299010 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f794815ba60 con 0x7f79480b59e0 2024-09-10T08:47:43.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.022+0000 7f7944c00640 1 -- 172.21.15.2:0/3946299010 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f793c030880 con 0x7f79480b59e0 2024-09-10T08:47:43.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.022+0000 7f794e400640 1 -- 172.21.15.2:0/3946299010 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f794815db80 con 0x7f79480b59e0 2024-09-10T08:47:43.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.023+0000 7f794e400640 1 -- 172.21.15.2:0/3946299010 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79480d0e00 con 0x7f79480b59e0 2024-09-10T08:47:43.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.024+0000 7f7944c00640 1 -- 172.21.15.2:0/3946299010 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f793c030a20 con 0x7f79480b59e0 2024-09-10T08:47:43.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.025+0000 7f7944c00640 1 --2- 172.21.15.2:0/3946299010 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f792806be30 0x7f792806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:43.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.025+0000 7f7944c00640 1 -- 172.21.15.2:0/3946299010 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6850+0+0 (secure 0 0 0) 0x7f793c0abb30 con 0x7f79480b59e0 2024-09-10T08:47:43.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.025+0000 7f7947e00640 1 --2- 172.21.15.2:0/3946299010 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f792806be30 0x7f792806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:43.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.026+0000 7f7947e00640 1 --2- 172.21.15.2:0/3946299010 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f792806be30 0x7f792806e2f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f79480b1180 tx=0x7f7934008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:43.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.030+0000 7f7944c00640 1 -- 172.21.15.2:0/3946299010 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f793c07a050 con 0x7f79480b59e0 2024-09-10T08:47:43.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.249+0000 7f794e400640 1 -- 172.21.15.2:0/3946299010 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f79480b4dc0 con 0x7f79480b59e0 2024-09-10T08:47:43.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.841+0000 7f7944c00640 1 -- 172.21.15.2:0/3946299010 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f793c079950 con 0x7f79480b59e0 2024-09-10T08:47:43.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.844+0000 7f794e400640 1 -- 172.21.15.2:0/3946299010 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f792806be30 msgr2=0x7f792806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:43.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.844+0000 7f794e400640 1 --2- 172.21.15.2:0/3946299010 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f792806be30 0x7f792806e2f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f79480b1180 tx=0x7f7934008040 comp rx=0 tx=0).stop 2024-09-10T08:47:43.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.844+0000 7f794e400640 1 -- 172.21.15.2:0/3946299010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79480b59e0 msgr2=0x7f794815a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:43.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.844+0000 7f794e400640 1 --2- 172.21.15.2:0/3946299010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79480b59e0 0x7f794815a300 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f793c000c00 tx=0x7f793c0046c0 comp rx=0 tx=0).stop 2024-09-10T08:47:43.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.844+0000 7f794e400640 1 -- 172.21.15.2:0/3946299010 shutdown_connections 2024-09-10T08:47:43.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.844+0000 7f794e400640 1 --2- 172.21.15.2:0/3946299010 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7948162090 0x7f79480cd5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:43.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.844+0000 7f794e400640 1 --2- 172.21.15.2:0/3946299010 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f792806be30 0x7f792806e2f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:43.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.844+0000 7f794e400640 1 --2- 172.21.15.2:0/3946299010 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7948161cb0 0x7f79480cd0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:43.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.844+0000 7f794e400640 1 --2- 172.21.15.2:0/3946299010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79480b59e0 0x7f794815a300 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:43.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.844+0000 7f794e400640 1 -- 172.21.15.2:0/3946299010 >> 172.21.15.2:0/3946299010 conn(0x7f794809d700 msgr2=0x7f794806d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:43.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.844+0000 7f794e400640 1 -- 172.21.15.2:0/3946299010 shutdown_connections 2024-09-10T08:47:43.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:43.844+0000 7f794e400640 1 -- 172.21.15.2:0/3946299010 wait complete. 2024-09-10T08:47:43.863 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T08:47:44.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.028+0000 7ff51e200640 1 Processor -- start 2024-09-10T08:47:44.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.028+0000 7ff51e200640 1 -- start start 2024-09-10T08:47:44.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.029+0000 7ff51e200640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff5180af790 0x7ff51806ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:44.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.029+0000 7ff51e200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff5180d0d40 0x7ff51806e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:44.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.029+0000 7ff51e200640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff51806f3e0 con 0x7ff51815fa60 2024-09-10T08:47:44.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.029+0000 7ff51e200640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7ff51806f180 con 0x7ff5180d0d40 2024-09-10T08:47:44.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.029+0000 7ff51e200640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7ff5180d0260 con 0x7ff5180af790 2024-09-10T08:47:44.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.029+0000 7ff517e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff5180d0d40 0x7ff51806e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:44.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.029+0000 7ff517e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff5180d0d40 0x7ff51806e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60376/0 (socket says 172.21.15.2:60376) 2024-09-10T08:47:44.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.029+0000 7ff517e00640 1 -- 172.21.15.2:0/1437911570 learned_addr learned my addr 172.21.15.2:0/1437911570 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:44.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.029+0000 7ff50ea00640 1 --2- 172.21.15.2:0/1437911570 >> v2:172.21.15.155:3300/0 conn(0x7ff5180af790 0x7ff51806ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:44.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.029+0000 7ff517e00640 1 -- 172.21.15.2:0/1437911570 >> v2:172.21.15.155:3300/0 conn(0x7ff5180af790 msgr2=0x7ff51806ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:44.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.029+0000 7ff517e00640 1 --2- 172.21.15.2:0/1437911570 >> v2:172.21.15.155:3300/0 conn(0x7ff5180af790 0x7ff51806ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:44.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.029+0000 7ff517e00640 1 -- 172.21.15.2:0/1437911570 >> v1:172.21.15.155:6789/0 conn(0x7ff51815fa60 legacy=0x7ff51806ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:44.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.029+0000 7ff517e00640 1 -- 172.21.15.2:0/1437911570 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5180d0540 con 0x7ff5180d0d40 2024-09-10T08:47:44.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.030+0000 7ff50ea00640 1 --2- 172.21.15.2:0/1437911570 >> v2:172.21.15.155:3300/0 conn(0x7ff5180af790 0x7ff51806ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:47:44.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.030+0000 7ff517e00640 1 --2- 172.21.15.2:0/1437911570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5180d0d40 0x7ff51806e300 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff5180cfdc0 tx=0x7ff51002a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba9fd55e3c65d570 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:44.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.031+0000 7ff516a00640 1 -- 172.21.15.2:0/1437911570 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff510036070 con 0x7ff5180d0d40 2024-09-10T08:47:44.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.031+0000 7ff516a00640 1 -- 172.21.15.2:0/1437911570 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff510031600 con 0x7ff5180d0d40 2024-09-10T08:47:44.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.031+0000 7ff516a00640 1 -- 172.21.15.2:0/1437911570 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5100319d0 con 0x7ff5180d0d40 2024-09-10T08:47:44.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.031+0000 7ff51e200640 1 -- 172.21.15.2:0/1437911570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5180d0d40 msgr2=0x7ff51806e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:44.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.031+0000 7ff51e200640 1 --2- 172.21.15.2:0/1437911570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5180d0d40 0x7ff51806e300 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff5180cfdc0 tx=0x7ff51002a640 comp rx=0 tx=0).stop 2024-09-10T08:47:44.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.031+0000 7ff51e200640 1 -- 172.21.15.2:0/1437911570 shutdown_connections 2024-09-10T08:47:44.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.031+0000 7ff51e200640 1 --2- 172.21.15.2:0/1437911570 >> v2:172.21.15.155:3300/0 conn(0x7ff5180af790 0x7ff51806ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:44.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.031+0000 7ff51e200640 1 --2- 172.21.15.2:0/1437911570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5180d0d40 0x7ff51806e300 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:44.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.031+0000 7ff51e200640 1 -- 172.21.15.2:0/1437911570 >> 172.21.15.2:0/1437911570 conn(0x7ff51806bdf0 msgr2=0x7ff51806c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:44.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.031+0000 7ff51e200640 1 -- 172.21.15.2:0/1437911570 shutdown_connections 2024-09-10T08:47:44.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.031+0000 7ff51e200640 1 -- 172.21.15.2:0/1437911570 wait complete. 2024-09-10T08:47:44.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.033+0000 7ff51e200640 1 Processor -- start 2024-09-10T08:47:44.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.033+0000 7ff51e200640 1 -- start start 2024-09-10T08:47:44.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.034+0000 7ff51e200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5180af790 0x7ff518073310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:44.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.034+0000 7ff51e200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5180d0d40 0x7ff5180c6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:44.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.034+0000 7ff51e200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff51815fa60 0x7ff5181f4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:44.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.034+0000 7ff51e200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff5180cedb0 con 0x7ff5180d0d40 2024-09-10T08:47:44.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.034+0000 7ff51e200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff51806f6c0 con 0x7ff51815fa60 2024-09-10T08:47:44.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.034+0000 7ff51e200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff5180cef30 con 0x7ff5180af790 2024-09-10T08:47:44.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.034+0000 7ff50ea00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5180d0d40 0x7ff5180c6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:44.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.034+0000 7ff50ea00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5180d0d40 0x7ff5180c6970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60392/0 (socket says 172.21.15.2:60392) 2024-09-10T08:47:44.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.034+0000 7ff50ea00640 1 -- 172.21.15.2:0/1249326220 learned_addr learned my addr 172.21.15.2:0/1249326220 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:44.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.034+0000 7ff517400640 1 --2- 172.21.15.2:0/1249326220 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5180af790 0x7ff518073310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:44.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.034+0000 7ff517e00640 1 --2- 172.21.15.2:0/1249326220 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff51815fa60 0x7ff5181f4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:44.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.035+0000 7ff50ea00640 1 -- 172.21.15.2:0/1249326220 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5180af790 msgr2=0x7ff518073310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:44.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.035+0000 7ff50ea00640 1 --2- 172.21.15.2:0/1249326220 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5180af790 0x7ff518073310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:44.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.035+0000 7ff50ea00640 1 -- 172.21.15.2:0/1249326220 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff51815fa60 msgr2=0x7ff5181f4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:44.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.035+0000 7ff50ea00640 1 --2- 172.21.15.2:0/1249326220 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff51815fa60 0x7ff5181f4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:44.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.035+0000 7ff50ea00640 1 -- 172.21.15.2:0/1249326220 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff51815a660 con 0x7ff5180d0d40 2024-09-10T08:47:44.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.035+0000 7ff517e00640 1 --2- 172.21.15.2:0/1249326220 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff51815fa60 0x7ff5181f4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:47:44.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.035+0000 7ff50ea00640 1 --2- 172.21.15.2:0/1249326220 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5180d0d40 0x7ff5180c6970 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff50000c7f0 tx=0x7ff50000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:44.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.035+0000 7ff50fe00640 1 -- 172.21.15.2:0/1249326220 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff500015070 con 0x7ff5180d0d40 2024-09-10T08:47:44.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.035+0000 7ff50fe00640 1 -- 172.21.15.2:0/1249326220 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff500007a30 con 0x7ff5180d0d40 2024-09-10T08:47:44.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.035+0000 7ff50fe00640 1 -- 172.21.15.2:0/1249326220 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff500007e00 con 0x7ff5180d0d40 2024-09-10T08:47:44.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.035+0000 7ff51e200640 1 -- 172.21.15.2:0/1249326220 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff51815a940 con 0x7ff5180d0d40 2024-09-10T08:47:44.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.035+0000 7ff51e200640 1 -- 172.21.15.2:0/1249326220 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff51815af00 con 0x7ff5180d0d40 2024-09-10T08:47:44.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.037+0000 7ff51e200640 1 -- 172.21.15.2:0/1249326220 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff51815b100 con 0x7ff5180d0d40 2024-09-10T08:47:44.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.037+0000 7ff50fe00640 1 -- 172.21.15.2:0/1249326220 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff500018070 con 0x7ff5180d0d40 2024-09-10T08:47:44.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.038+0000 7ff50fe00640 1 --2- 172.21.15.2:0/1249326220 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7ff4f406be60 0x7ff4f406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:44.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.038+0000 7ff50fe00640 1 -- 172.21.15.2:0/1249326220 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6850+0+0 (secure 0 0 0) 0x7ff50008b2e0 con 0x7ff5180d0d40 2024-09-10T08:47:44.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.039+0000 7ff517400640 1 --2- 172.21.15.2:0/1249326220 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7ff4f406be60 0x7ff4f406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:44.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.040+0000 7ff517400640 1 --2- 172.21.15.2:0/1249326220 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7ff4f406be60 0x7ff4f406e320 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff508006fd0 tx=0x7ff508008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:44.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.043+0000 7ff50fe00640 1 -- 172.21.15.2:0/1249326220 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff51815b100 con 0x7ff5180d0d40 2024-09-10T08:47:44.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.225+0000 7ff51e200640 1 -- 172.21.15.2:0/1249326220 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff51815d8f0 con 0x7ff5180d0d40 2024-09-10T08:47:44.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.844+0000 7ff50fe00640 1 -- 172.21.15.2:0/1249326220 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v28) ==== 181+0+0 (secure 0 0 0) 0x7ff500059800 con 0x7ff5180d0d40 2024-09-10T08:47:44.844 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' removed 2024-09-10T08:47:44.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.847+0000 7ff51e200640 1 -- 172.21.15.2:0/1249326220 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7ff4f406be60 msgr2=0x7ff4f406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:44.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.848+0000 7ff51e200640 1 --2- 172.21.15.2:0/1249326220 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7ff4f406be60 0x7ff4f406e320 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff508006fd0 tx=0x7ff508008040 comp rx=0 tx=0).stop 2024-09-10T08:47:44.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.848+0000 7ff51e200640 1 -- 172.21.15.2:0/1249326220 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5180d0d40 msgr2=0x7ff5180c6970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:44.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.848+0000 7ff51e200640 1 --2- 172.21.15.2:0/1249326220 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5180d0d40 0x7ff5180c6970 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff50000c7f0 tx=0x7ff50000cbf0 comp rx=0 tx=0).stop 2024-09-10T08:47:44.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.848+0000 7ff51e200640 1 -- 172.21.15.2:0/1249326220 shutdown_connections 2024-09-10T08:47:44.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.848+0000 7ff51e200640 1 --2- 172.21.15.2:0/1249326220 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff51815fa60 0x7ff5181f4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:44.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.848+0000 7ff51e200640 1 --2- 172.21.15.2:0/1249326220 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5180d0d40 0x7ff5180c6970 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:44.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.848+0000 7ff51e200640 1 --2- 172.21.15.2:0/1249326220 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7ff4f406be60 0x7ff4f406e320 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:44.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.848+0000 7ff51e200640 1 --2- 172.21.15.2:0/1249326220 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff5180af790 0x7ff518073310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:44.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.848+0000 7ff51e200640 1 -- 172.21.15.2:0/1249326220 >> 172.21.15.2:0/1249326220 conn(0x7ff51806bdf0 msgr2=0x7ff51806ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:44.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.848+0000 7ff51e200640 1 -- 172.21.15.2:0/1249326220 shutdown_connections 2024-09-10T08:47:44.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:44.848+0000 7ff51e200640 1 -- 172.21.15.2:0/1249326220 wait complete. 2024-09-10T08:47:44.869 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T08:47:45.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.031+0000 7f2ccb200640 1 Processor -- start 2024-09-10T08:47:45.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.031+0000 7f2ccb200640 1 -- start start 2024-09-10T08:47:45.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.033+0000 7f2ccb200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2cc41554f0 0x7f2cc415c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:45.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.033+0000 7f2ccb200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2cc40ae7a0 0x7f2cc4072cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:45.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.033+0000 7f2ccb200640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cc40aebe0 con 0x7f2cc4073230 2024-09-10T08:47:45.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.033+0000 7f2ccb200640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f2cc4073690 con 0x7f2cc41554f0 2024-09-10T08:47:45.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.033+0000 7f2ccb200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2cc40b3110 con 0x7f2cc40ae7a0 2024-09-10T08:47:45.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.033+0000 7f2cc9e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2cc41554f0 0x7f2cc415c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:45.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.033+0000 7f2cc9e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2cc41554f0 0x7f2cc415c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60400/0 (socket says 172.21.15.2:60400) 2024-09-10T08:47:45.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.033+0000 7f2cc9e00640 1 -- 172.21.15.2:0/670752136 learned_addr learned my addr 172.21.15.2:0/670752136 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:45.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.033+0000 7f2cc9400640 1 --2- 172.21.15.2:0/670752136 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2cc40ae7a0 0x7f2cc4072cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:45.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.033+0000 7f2cc9e00640 1 -- 172.21.15.2:0/670752136 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2cc40ae7a0 msgr2=0x7f2cc4072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:45.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.033+0000 7f2cc9e00640 1 --2- 172.21.15.2:0/670752136 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2cc40ae7a0 0x7f2cc4072cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:45.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.033+0000 7f2cc9e00640 1 -- 172.21.15.2:0/670752136 >> v1:172.21.15.155:6789/0 conn(0x7f2cc4073230 legacy=0x7f2cc415eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:45.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.033+0000 7f2cc9e00640 1 -- 172.21.15.2:0/670752136 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cc40aeea0 con 0x7f2cc41554f0 2024-09-10T08:47:45.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.034+0000 7f2cc9e00640 1 --2- 172.21.15.2:0/670752136 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cc41554f0 0x7f2cc415c110 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2cc40b3290 tx=0x7f2cb802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd7f93a18f6f6266 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:45.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.035+0000 7f2cc8a00640 1 -- 172.21.15.2:0/670752136 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cb8037070 con 0x7f2cc41554f0 2024-09-10T08:47:45.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.035+0000 7f2cc8a00640 1 -- 172.21.15.2:0/670752136 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cb8032440 con 0x7f2cc41554f0 2024-09-10T08:47:45.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.035+0000 7f2cc8a00640 1 -- 172.21.15.2:0/670752136 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cb8032810 con 0x7f2cc41554f0 2024-09-10T08:47:45.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.035+0000 7f2ccb200640 1 -- 172.21.15.2:0/670752136 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cc41554f0 msgr2=0x7f2cc415c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:45.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.035+0000 7f2ccb200640 1 --2- 172.21.15.2:0/670752136 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cc41554f0 0x7f2cc415c110 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2cc40b3290 tx=0x7f2cb802a1c0 comp rx=0 tx=0).stop 2024-09-10T08:47:45.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.035+0000 7f2ccb200640 1 -- 172.21.15.2:0/670752136 shutdown_connections 2024-09-10T08:47:45.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.035+0000 7f2ccb200640 1 --2- 172.21.15.2:0/670752136 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2cc40ae7a0 0x7f2cc4072cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:45.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.035+0000 7f2ccb200640 1 --2- 172.21.15.2:0/670752136 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cc41554f0 0x7f2cc415c110 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:45.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.035+0000 7f2ccb200640 1 -- 172.21.15.2:0/670752136 >> 172.21.15.2:0/670752136 conn(0x7f2cc406c240 msgr2=0x7f2cc40b1c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:45.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.035+0000 7f2ccb200640 1 -- 172.21.15.2:0/670752136 shutdown_connections 2024-09-10T08:47:45.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.035+0000 7f2ccb200640 1 -- 172.21.15.2:0/670752136 wait complete. 2024-09-10T08:47:45.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.037+0000 7f2ccb200640 1 Processor -- start 2024-09-10T08:47:45.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.037+0000 7f2ccb200640 1 -- start start 2024-09-10T08:47:45.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.038+0000 7f2ccb200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cc4073230 0x7f2cc4155c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:45.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.038+0000 7f2ccb200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2cc40ae7a0 0x7f2cc415ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:45.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.038+0000 7f2ccb200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2cc41554f0 0x7f2cc41547a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:45.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.038+0000 7f2ccb200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2cc41558d0 con 0x7f2cc4073230 2024-09-10T08:47:45.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.038+0000 7f2ccb200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2cc40af460 con 0x7f2cc41554f0 2024-09-10T08:47:45.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.038+0000 7f2ccb200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2cc4155a50 con 0x7f2cc40ae7a0 2024-09-10T08:47:45.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.038+0000 7f2cc9e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cc4073230 0x7f2cc4155c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:45.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.038+0000 7f2cc9e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cc4073230 0x7f2cc4155c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:60402/0 (socket says 172.21.15.2:60402) 2024-09-10T08:47:45.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.038+0000 7f2cc9e00640 1 -- 172.21.15.2:0/26666514 learned_addr learned my addr 172.21.15.2:0/26666514 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:45.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.038+0000 7f2cca800640 1 --2- 172.21.15.2:0/26666514 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2cc41554f0 0x7f2cc41547a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:45.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.038+0000 7f2cc9400640 1 --2- 172.21.15.2:0/26666514 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2cc40ae7a0 0x7f2cc415ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:45.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.039+0000 7f2cc9e00640 1 -- 172.21.15.2:0/26666514 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2cc40ae7a0 msgr2=0x7f2cc415ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:45.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.039+0000 7f2cc9e00640 1 --2- 172.21.15.2:0/26666514 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2cc40ae7a0 0x7f2cc415ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:45.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.039+0000 7f2cc9e00640 1 -- 172.21.15.2:0/26666514 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2cc41554f0 msgr2=0x7f2cc41547a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:45.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.039+0000 7f2cc9e00640 1 --2- 172.21.15.2:0/26666514 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2cc41554f0 0x7f2cc41547a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:45.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.039+0000 7f2cc9e00640 1 -- 172.21.15.2:0/26666514 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cc415b160 con 0x7f2cc4073230 2024-09-10T08:47:45.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.039+0000 7f2cca800640 1 --2- 172.21.15.2:0/26666514 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2cc41554f0 0x7f2cc41547a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:47:45.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.039+0000 7f2cc9e00640 1 --2- 172.21.15.2:0/26666514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cc4073230 0x7f2cc4155c30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2cb802a200 tx=0x7f2cb80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:45.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.039+0000 7f2cbe000640 1 -- 172.21.15.2:0/26666514 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cb8041020 con 0x7f2cc4073230 2024-09-10T08:47:45.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.039+0000 7f2cbe000640 1 -- 172.21.15.2:0/26666514 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cb80306c0 con 0x7f2cc4073230 2024-09-10T08:47:45.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.039+0000 7f2cbe000640 1 -- 172.21.15.2:0/26666514 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cb8037040 con 0x7f2cc4073230 2024-09-10T08:47:45.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.039+0000 7f2ccb200640 1 -- 172.21.15.2:0/26666514 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cc41562c0 con 0x7f2cc4073230 2024-09-10T08:47:45.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.040+0000 7f2ccb200640 1 -- 172.21.15.2:0/26666514 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cc4156880 con 0x7f2cc4073230 2024-09-10T08:47:45.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.041+0000 7f2ccb200640 1 -- 172.21.15.2:0/26666514 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cc40b5450 con 0x7f2cc4073230 2024-09-10T08:47:45.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.042+0000 7f2cbe000640 1 -- 172.21.15.2:0/26666514 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2cb8044020 con 0x7f2cc4073230 2024-09-10T08:47:45.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.042+0000 7f2cbe000640 1 --2- 172.21.15.2:0/26666514 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f2ca806be30 0x7f2ca806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:45.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.042+0000 7f2cbe000640 1 -- 172.21.15.2:0/26666514 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6412+0+0 (secure 0 0 0) 0x7f2cb80ab880 con 0x7f2cc4073230 2024-09-10T08:47:45.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.043+0000 7f2cc9400640 1 --2- 172.21.15.2:0/26666514 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f2ca806be30 0x7f2ca806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:45.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.044+0000 7f2cc9400640 1 --2- 172.21.15.2:0/26666514 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f2ca806be30 0x7f2ca806e2f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2cc40b1d00 tx=0x7f2cb4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:45.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.047+0000 7f2cbe000640 1 -- 172.21.15.2:0/26666514 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2cb804b030 con 0x7f2cc4073230 2024-09-10T08:47:45.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.235+0000 7f2ccb200640 1 -- 172.21.15.2:0/26666514 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f2cc40b3dc0 con 0x7f2cc4073230 2024-09-10T08:47:45.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.853+0000 7f2cbe000640 1 -- 172.21.15.2:0/26666514 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v29) ==== 169+0+0 (secure 0 0 0) 0x7f2cb807a000 con 0x7f2cc4073230 2024-09-10T08:47:45.854 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' removed 2024-09-10T08:47:45.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.857+0000 7f2ccb200640 1 -- 172.21.15.2:0/26666514 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f2ca806be30 msgr2=0x7f2ca806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:45.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.857+0000 7f2ccb200640 1 --2- 172.21.15.2:0/26666514 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f2ca806be30 0x7f2ca806e2f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2cc40b1d00 tx=0x7f2cb4008040 comp rx=0 tx=0).stop 2024-09-10T08:47:45.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.857+0000 7f2ccb200640 1 -- 172.21.15.2:0/26666514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cc4073230 msgr2=0x7f2cc4155c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:45.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.857+0000 7f2ccb200640 1 --2- 172.21.15.2:0/26666514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cc4073230 0x7f2cc4155c30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2cb802a200 tx=0x7f2cb80046c0 comp rx=0 tx=0).stop 2024-09-10T08:47:45.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.857+0000 7f2ccb200640 1 -- 172.21.15.2:0/26666514 shutdown_connections 2024-09-10T08:47:45.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.857+0000 7f2ccb200640 1 --2- 172.21.15.2:0/26666514 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2cc41554f0 0x7f2cc41547a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:45.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.857+0000 7f2ccb200640 1 --2- 172.21.15.2:0/26666514 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f2ca806be30 0x7f2ca806e2f0 secure :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2cc40b1d00 tx=0x7f2cb4008040 comp rx=0 tx=0).stop 2024-09-10T08:47:45.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.857+0000 7f2ccb200640 1 --2- 172.21.15.2:0/26666514 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2cc40ae7a0 0x7f2cc415ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:45.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.857+0000 7f2ccb200640 1 --2- 172.21.15.2:0/26666514 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2cc4073230 0x7f2cc4155c30 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:45.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.857+0000 7f2ccb200640 1 -- 172.21.15.2:0/26666514 >> 172.21.15.2:0/26666514 conn(0x7f2cc406c240 msgr2=0x7f2cc415e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:45.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.858+0000 7f2ccb200640 1 -- 172.21.15.2:0/26666514 shutdown_connections 2024-09-10T08:47:45.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:45.858+0000 7f2ccb200640 1 -- 172.21.15.2:0/26666514 wait complete. 2024-09-10T08:47:45.879 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-10T08:47:46.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.042+0000 7fac37c00640 1 Processor -- start 2024-09-10T08:47:46.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.042+0000 7fac37c00640 1 -- start start 2024-09-10T08:47:46.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.044+0000 7fac37c00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fac300b3c00 0x7fac3015eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:46.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.044+0000 7fac37c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac300aeaf0 0x7fac300aef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:46.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.044+0000 7fac37c00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac300b4170 con 0x7fac300b5610 2024-09-10T08:47:46.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.044+0000 7fac37c00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fac300b4d80 con 0x7fac300b3c00 2024-09-10T08:47:46.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.044+0000 7fac37c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fac300b4450 con 0x7fac300aeaf0 2024-09-10T08:47:46.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.044+0000 7fac35200640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fac300b5610 0x7fac300b59f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:51942/0 (socket says 172.21.15.2:51942) 2024-09-10T08:47:46.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.044+0000 7fac35200640 1 -- 172.21.15.2:0/399798933 learned_addr learned my addr 172.21.15.2:0/399798933 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:47:46.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.044+0000 7fac2f400640 1 -- 172.21.15.2:0/399798933 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2325722614 0 0) 0x7fac300b4170 con 0x7fac300b5610 2024-09-10T08:47:46.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.044+0000 7fac2f400640 1 -- 172.21.15.2:0/399798933 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac18003520 con 0x7fac300b5610 2024-09-10T08:47:46.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.044+0000 7fac2fe00640 1 --2- 172.21.15.2:0/399798933 >> v2:172.21.15.155:3300/0 conn(0x7fac300b3c00 0x7fac3015eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:46.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.044+0000 7fac35c00640 1 --2- 172.21.15.2:0/399798933 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac300aeaf0 0x7fac300aef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:46.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.045+0000 7fac2f400640 1 -- 172.21.15.2:0/399798933 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2633307533 0 0) 0x7fac18003520 con 0x7fac300b5610 2024-09-10T08:47:46.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.045+0000 7fac2f400640 1 -- 172.21.15.2:0/399798933 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac300aeaf0 msgr2=0x7fac300aef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:46.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.045+0000 7fac2f400640 1 --2- 172.21.15.2:0/399798933 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac300aeaf0 0x7fac300aef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:46.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.045+0000 7fac2f400640 1 -- 172.21.15.2:0/399798933 >> v2:172.21.15.155:3300/0 conn(0x7fac300b3c00 msgr2=0x7fac3015eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:46.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.045+0000 7fac2f400640 1 --2- 172.21.15.2:0/399798933 >> v2:172.21.15.155:3300/0 conn(0x7fac300b3c00 0x7fac3015eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:46.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.045+0000 7fac2f400640 1 -- 172.21.15.2:0/399798933 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac300b4730 con 0x7fac300b5610 2024-09-10T08:47:46.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.045+0000 7fac2f400640 1 -- 172.21.15.2:0/399798933 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2345211856 0 0) 0x7fac24001670 con 0x7fac300b5610 2024-09-10T08:47:46.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.045+0000 7fac2f400640 1 -- 172.21.15.2:0/399798933 >> v1:172.21.15.2:6789/0 conn(0x7fac300b5610 legacy=0x7fac300b59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:46.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.045+0000 7fac2f400640 1 --2- 172.21.15.2:0/399798933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac180039b0 0x7fac18003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:46.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.045+0000 7fac2f400640 1 --2- 172.21.15.2:0/399798933 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac18004800 0x7fac18004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:46.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.045+0000 7fac2f400640 1 --2- 172.21.15.2:0/399798933 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac300aeaf0 0x7fac180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:46.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.045+0000 7fac2f400640 1 -- 172.21.15.2:0/399798933 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fac300b4d80 con 0x7fac180039b0 2024-09-10T08:47:46.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.045+0000 7fac2f400640 1 -- 172.21.15.2:0/399798933 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fac300b4450 con 0x7fac18004800 2024-09-10T08:47:46.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.045+0000 7fac2f400640 1 -- 172.21.15.2:0/399798933 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fac1800b9c0 con 0x7fac300aeaf0 2024-09-10T08:47:46.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.045+0000 7fac35200640 1 --2- 172.21.15.2:0/399798933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac180039b0 0x7fac18003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:46.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.045+0000 7fac35c00640 1 --2- 172.21.15.2:0/399798933 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac300aeaf0 0x7fac180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:46.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.045+0000 7fac2fe00640 1 --2- 172.21.15.2:0/399798933 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac18004800 0x7fac18004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:46.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.046+0000 7fac35200640 1 -- 172.21.15.2:0/399798933 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac300aeaf0 msgr2=0x7fac180051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:46.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.046+0000 7fac35200640 1 --2- 172.21.15.2:0/399798933 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac300aeaf0 0x7fac180051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:46.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.046+0000 7fac35200640 1 -- 172.21.15.2:0/399798933 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac18004800 msgr2=0x7fac18004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:46.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.046+0000 7fac35200640 1 --2- 172.21.15.2:0/399798933 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac18004800 0x7fac18004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:46.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.046+0000 7fac35200640 1 -- 172.21.15.2:0/399798933 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac18003520 con 0x7fac180039b0 2024-09-10T08:47:46.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.046+0000 7fac35200640 1 --2- 172.21.15.2:0/399798933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac180039b0 0x7fac18003dd0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fac2400c190 tx=0x7fac18005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db26c45e2fb4901a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:46.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.047+0000 7fac2f400640 1 -- 172.21.15.2:0/399798933 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac24007c80 con 0x7fac180039b0 2024-09-10T08:47:46.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.047+0000 7fac2f400640 1 -- 172.21.15.2:0/399798933 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac24005ad0 con 0x7fac180039b0 2024-09-10T08:47:46.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.047+0000 7fac2f400640 1 -- 172.21.15.2:0/399798933 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac24007070 con 0x7fac180039b0 2024-09-10T08:47:46.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.047+0000 7fac37c00640 1 -- 172.21.15.2:0/399798933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac180039b0 msgr2=0x7fac18003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:46.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.047+0000 7fac37c00640 1 --2- 172.21.15.2:0/399798933 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac180039b0 0x7fac18003dd0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fac2400c190 tx=0x7fac18005830 comp rx=0 tx=0).stop 2024-09-10T08:47:46.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.047+0000 7fac35c00640 1 -- 172.21.15.2:0/399798933 reap_dead start 2024-09-10T08:47:46.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.047+0000 7fac37c00640 1 -- 172.21.15.2:0/399798933 shutdown_connections 2024-09-10T08:47:46.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.047+0000 7fac37c00640 1 -- 172.21.15.2:0/399798933 >> 172.21.15.2:0/399798933 conn(0x7fac30073610 msgr2=0x7fac3006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:46.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.047+0000 7fac37c00640 1 -- 172.21.15.2:0/399798933 shutdown_connections 2024-09-10T08:47:46.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.047+0000 7fac37c00640 1 -- 172.21.15.2:0/399798933 wait complete. 2024-09-10T08:47:46.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.049+0000 7fac37c00640 1 Processor -- start 2024-09-10T08:47:46.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.049+0000 7fac37c00640 1 -- start start 2024-09-10T08:47:46.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.050+0000 7fac37c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac180039b0 0x7fac30152750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:46.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.050+0000 7fac37c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac30159200 0x7fac3015d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:46.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.050+0000 7fac37c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac300afd20 0x7fac300b1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:46.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.050+0000 7fac37c00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fac300cd3c0 con 0x7fac30159200 2024-09-10T08:47:46.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.050+0000 7fac37c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fac300cd240 con 0x7fac180039b0 2024-09-10T08:47:46.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.050+0000 7fac37c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fac300aef80 con 0x7fac300afd20 2024-09-10T08:47:46.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.050+0000 7fac2fe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac30159200 0x7fac3015d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:46.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.050+0000 7fac2fe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac30159200 0x7fac3015d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35586/0 (socket says 172.21.15.2:35586) 2024-09-10T08:47:46.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.050+0000 7fac2fe00640 1 -- 172.21.15.2:0/2705481081 learned_addr learned my addr 172.21.15.2:0/2705481081 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:46.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.051+0000 7fac2fe00640 1 -- 172.21.15.2:0/2705481081 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac300afd20 msgr2=0x7fac300b1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:46.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.051+0000 7fac35c00640 1 --2- 172.21.15.2:0/2705481081 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac300afd20 0x7fac300b1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:46.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.051+0000 7fac35200640 1 --2- 172.21.15.2:0/2705481081 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac180039b0 0x7fac30152750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:46.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.051+0000 7fac2fe00640 1 --2- 172.21.15.2:0/2705481081 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac300afd20 0x7fac300b1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:46.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.051+0000 7fac2fe00640 1 -- 172.21.15.2:0/2705481081 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac180039b0 msgr2=0x7fac30152750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:46.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.051+0000 7fac2fe00640 1 --2- 172.21.15.2:0/2705481081 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac180039b0 0x7fac30152750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:46.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.051+0000 7fac2fe00640 1 -- 172.21.15.2:0/2705481081 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac300b0690 con 0x7fac30159200 2024-09-10T08:47:46.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.051+0000 7fac35200640 1 --2- 172.21.15.2:0/2705481081 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac180039b0 0x7fac30152750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:47:46.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.051+0000 7fac35c00640 1 --2- 172.21.15.2:0/2705481081 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac300afd20 0x7fac300b1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:47:46.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.051+0000 7fac2fe00640 1 --2- 172.21.15.2:0/2705481081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac30159200 0x7fac3015d3e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fac1c011990 tx=0x7fac1c011e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:46.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.051+0000 7fac2cc00640 1 -- 172.21.15.2:0/2705481081 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac1c00fad0 con 0x7fac30159200 2024-09-10T08:47:46.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.051+0000 7fac2cc00640 1 -- 172.21.15.2:0/2705481081 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac1c00fc70 con 0x7fac30159200 2024-09-10T08:47:46.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.051+0000 7fac2cc00640 1 -- 172.21.15.2:0/2705481081 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac1c014440 con 0x7fac30159200 2024-09-10T08:47:46.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.052+0000 7fac37c00640 1 -- 172.21.15.2:0/2705481081 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac30156830 con 0x7fac30159200 2024-09-10T08:47:46.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.052+0000 7fac37c00640 1 -- 172.21.15.2:0/2705481081 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac30156df0 con 0x7fac30159200 2024-09-10T08:47:46.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.053+0000 7fac37c00640 1 -- 172.21.15.2:0/2705481081 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac300b4170 con 0x7fac30159200 2024-09-10T08:47:46.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.053+0000 7fac2cc00640 1 -- 172.21.15.2:0/2705481081 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fac1c012040 con 0x7fac30159200 2024-09-10T08:47:46.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.055+0000 7fac2cc00640 1 --2- 172.21.15.2:0/2705481081 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fac1006be60 0x7fac1006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:46.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.055+0000 7fac2cc00640 1 -- 172.21.15.2:0/2705481081 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5853+0+0 (secure 0 0 0) 0x7fac1c08b4f0 con 0x7fac30159200 2024-09-10T08:47:46.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.055+0000 7fac35200640 1 --2- 172.21.15.2:0/2705481081 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fac1006be60 0x7fac1006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:46.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.056+0000 7fac35200640 1 --2- 172.21.15.2:0/2705481081 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fac1006be60 0x7fac1006e320 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fac24032000 tx=0x7fac24009030 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:46.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.059+0000 7fac2cc00640 1 -- 172.21.15.2:0/2705481081 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fac1c019030 con 0x7fac30159200 2024-09-10T08:47:46.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.243+0000 7fac37c00640 1 -- 172.21.15.2:0/2705481081 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7fac300d08c0 con 0x7fac30159200 2024-09-10T08:47:46.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.854+0000 7fac2cc00640 1 -- 172.21.15.2:0/2705481081 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v30) ==== 178+0+0 (secure 0 0 0) 0x7fac1c059e00 con 0x7fac30159200 2024-09-10T08:47:46.855 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data_ec' removed 2024-09-10T08:47:46.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.858+0000 7fac37c00640 1 -- 172.21.15.2:0/2705481081 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fac1006be60 msgr2=0x7fac1006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:46.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.858+0000 7fac37c00640 1 --2- 172.21.15.2:0/2705481081 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fac1006be60 0x7fac1006e320 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fac24032000 tx=0x7fac24009030 comp rx=0 tx=0).stop 2024-09-10T08:47:46.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.858+0000 7fac37c00640 1 -- 172.21.15.2:0/2705481081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac30159200 msgr2=0x7fac3015d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:46.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.858+0000 7fac37c00640 1 --2- 172.21.15.2:0/2705481081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac30159200 0x7fac3015d3e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fac1c011990 tx=0x7fac1c011e50 comp rx=0 tx=0).stop 2024-09-10T08:47:46.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.859+0000 7fac37c00640 1 -- 172.21.15.2:0/2705481081 shutdown_connections 2024-09-10T08:47:46.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.859+0000 7fac37c00640 1 --2- 172.21.15.2:0/2705481081 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fac1006be60 0x7fac1006e320 secure :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fac24032000 tx=0x7fac24009030 comp rx=0 tx=0).stop 2024-09-10T08:47:46.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.859+0000 7fac37c00640 1 --2- 172.21.15.2:0/2705481081 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fac300afd20 0x7fac300b1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:46.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.859+0000 7fac37c00640 1 --2- 172.21.15.2:0/2705481081 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fac30159200 0x7fac3015d3e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:46.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.859+0000 7fac37c00640 1 --2- 172.21.15.2:0/2705481081 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac180039b0 0x7fac30152750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:46.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.859+0000 7fac37c00640 1 -- 172.21.15.2:0/2705481081 >> 172.21.15.2:0/2705481081 conn(0x7fac30073610 msgr2=0x7fac3015fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:46.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.859+0000 7fac37c00640 1 -- 172.21.15.2:0/2705481081 shutdown_connections 2024-09-10T08:47:46.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:46.859+0000 7fac37c00640 1 -- 172.21.15.2:0/2705481081 wait complete. 2024-09-10T08:47:46.879 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-10T08:47:46.879 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-10T08:47:46.880 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T08:47:46.880 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:47:46.880 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-10T08:47:46.880 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-10T08:47:46.880 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T08:47:46.880 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:47:46.881 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-10T08:47:46.881 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-10T08:47:46.881 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T08:47:46.881 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:47:46.881 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-10T08:47:46.881 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-10T08:47:46.882 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T08:47:46.882 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:47:46.895 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T08:47:46.895 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-10T08:47:46.897 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T08:47:46.897 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-10T08:47:46.902 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T08:47:46.902 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-10T08:47:46.903 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T08:47:46.903 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-10T08:47:46.941 INFO:tasks.ceph.mds.c:Started 2024-09-10T08:47:46.942 DEBUG:teuthology.parallel:result is None 2024-09-10T08:47:46.944 INFO:tasks.ceph.mds.a:Started 2024-09-10T08:47:46.945 DEBUG:teuthology.parallel:result is None 2024-09-10T08:47:46.947 INFO:tasks.ceph.mds.d:Started 2024-09-10T08:47:46.947 DEBUG:teuthology.parallel:result is None 2024-09-10T08:47:46.949 INFO:tasks.ceph.mds.b:Started 2024-09-10T08:47:46.949 DEBUG:teuthology.parallel:result is None 2024-09-10T08:47:46.950 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-10T08:47:47.074 INFO:tasks.ceph.mds.a.smithi002.stdout:starting mds.a at 2024-09-10T08:47:47.075 INFO:tasks.ceph.mds.c.smithi002.stdout:starting mds.c at 2024-09-10T08:47:47.080 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2024-09-10T08:47:47.080 INFO:tasks.ceph.mds.d.smithi155.stdout:starting mds.d at 2024-09-10T08:47:47.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.114+0000 7f9d60c00640 1 Processor -- start 2024-09-10T08:47:47.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.114+0000 7f9d60c00640 1 -- start start 2024-09-10T08:47:47.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.115+0000 7f9d60c00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9d5c15b4c0 0x7f9d5c0cf6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:47.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.115+0000 7f9d60c00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9d5c0af590 0x7f9d5c06f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:47.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.115+0000 7f9d60c00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d5c0af160 con 0x7f9d5c06f5a0 2024-09-10T08:47:47.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.115+0000 7f9d60c00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f9d5c0afa00 con 0x7f9d5c15b4c0 2024-09-10T08:47:47.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.115+0000 7f9d60c00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f9d5c0d1130 con 0x7f9d5c0af590 2024-09-10T08:47:47.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.116+0000 7f9d59e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9d5c15b4c0 0x7f9d5c0cf6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:47.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.116+0000 7f9d59e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9d5c15b4c0 0x7f9d5c0cf6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35616/0 (socket says 172.21.15.2:35616) 2024-09-10T08:47:47.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.116+0000 7f9d59e00640 1 -- 172.21.15.2:0/41155094 learned_addr learned my addr 172.21.15.2:0/41155094 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:47.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.116+0000 7f9d53e00640 1 --2- 172.21.15.2:0/41155094 >> v2:172.21.15.155:3300/0 conn(0x7f9d5c0af590 0x7f9d5c06f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:47.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.116+0000 7f9d59e00640 1 -- 172.21.15.2:0/41155094 >> v2:172.21.15.155:3300/0 conn(0x7f9d5c0af590 msgr2=0x7f9d5c06f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:47.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.116+0000 7f9d59e00640 1 --2- 172.21.15.2:0/41155094 >> v2:172.21.15.155:3300/0 conn(0x7f9d5c0af590 0x7f9d5c06f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:47.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.116+0000 7f9d59e00640 1 -- 172.21.15.2:0/41155094 >> v1:172.21.15.155:6789/0 conn(0x7f9d5c06f5a0 legacy=0x7f9d5c0ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:47.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.116+0000 7f9d59e00640 1 -- 172.21.15.2:0/41155094 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d5c0ad390 con 0x7f9d5c15b4c0 2024-09-10T08:47:47.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.117+0000 7f9d59e00640 1 --2- 172.21.15.2:0/41155094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d5c15b4c0 0x7f9d5c0cf6d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c0743b0 tx=0x7f9d4c02a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ad2aa4f8e0c46a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:47.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.117+0000 7f9d59400640 1 -- 172.21.15.2:0/41155094 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c037070 con 0x7f9d5c15b4c0 2024-09-10T08:47:47.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.118+0000 7f9d59400640 1 -- 172.21.15.2:0/41155094 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d4c032440 con 0x7f9d5c15b4c0 2024-09-10T08:47:47.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.118+0000 7f9d59400640 1 -- 172.21.15.2:0/41155094 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c032810 con 0x7f9d5c15b4c0 2024-09-10T08:47:47.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.118+0000 7f9d60c00640 1 -- 172.21.15.2:0/41155094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d5c15b4c0 msgr2=0x7f9d5c0cf6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:47.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.118+0000 7f9d60c00640 1 --2- 172.21.15.2:0/41155094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d5c15b4c0 0x7f9d5c0cf6d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c0743b0 tx=0x7f9d4c02a200 comp rx=0 tx=0).stop 2024-09-10T08:47:47.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.118+0000 7f9d60c00640 1 -- 172.21.15.2:0/41155094 shutdown_connections 2024-09-10T08:47:47.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.118+0000 7f9d60c00640 1 --2- 172.21.15.2:0/41155094 >> v2:172.21.15.155:3300/0 conn(0x7f9d5c0af590 0x7f9d5c06f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:47.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.118+0000 7f9d60c00640 1 --2- 172.21.15.2:0/41155094 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d5c15b4c0 0x7f9d5c0cf6d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:47.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.118+0000 7f9d60c00640 1 -- 172.21.15.2:0/41155094 >> 172.21.15.2:0/41155094 conn(0x7f9d5c0d02c0 msgr2=0x7f9d5c0d06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:47.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.118+0000 7f9d60c00640 1 -- 172.21.15.2:0/41155094 shutdown_connections 2024-09-10T08:47:47.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.118+0000 7f9d60c00640 1 -- 172.21.15.2:0/41155094 wait complete. 2024-09-10T08:47:47.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.120+0000 7f9d60c00640 1 Processor -- start 2024-09-10T08:47:47.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.120+0000 7f9d60c00640 1 -- start start 2024-09-10T08:47:47.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.121+0000 7f9d60c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d5c06f5a0 0x7f9d5c15a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:47.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.121+0000 7f9d60c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d5c0af590 0x7f9d5c14b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:47.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.121+0000 7f9d60c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d5c15b4c0 0x7f9d5c14bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:47.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.121+0000 7f9d60c00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9d5c06f9d0 con 0x7f9d5c06f5a0 2024-09-10T08:47:47.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.121+0000 7f9d60c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9d5c0ad140 con 0x7f9d5c15b4c0 2024-09-10T08:47:47.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.121+0000 7f9d60c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9d5c0ad950 con 0x7f9d5c0af590 2024-09-10T08:47:47.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.121+0000 7f9d59e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d5c06f5a0 0x7f9d5c15a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:47.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.121+0000 7f9d59e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d5c06f5a0 0x7f9d5c15a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35630/0 (socket says 172.21.15.2:35630) 2024-09-10T08:47:47.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.121+0000 7f9d59e00640 1 -- 172.21.15.2:0/1182460837 learned_addr learned my addr 172.21.15.2:0/1182460837 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:47.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.121+0000 7f9d53e00640 1 --2- 172.21.15.2:0/1182460837 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d5c0af590 0x7f9d5c14b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:47.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.121+0000 7f9d5a800640 1 --2- 172.21.15.2:0/1182460837 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d5c15b4c0 0x7f9d5c14bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:47.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.121+0000 7f9d59e00640 1 -- 172.21.15.2:0/1182460837 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d5c0af590 msgr2=0x7f9d5c14b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:47.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.121+0000 7f9d59e00640 1 --2- 172.21.15.2:0/1182460837 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d5c0af590 0x7f9d5c14b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:47.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.121+0000 7f9d59e00640 1 -- 172.21.15.2:0/1182460837 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d5c15b4c0 msgr2=0x7f9d5c14bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:47.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.121+0000 7f9d59e00640 1 --2- 172.21.15.2:0/1182460837 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d5c15b4c0 0x7f9d5c14bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:47.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.121+0000 7f9d59e00640 1 -- 172.21.15.2:0/1182460837 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d5c151bc0 con 0x7f9d5c06f5a0 2024-09-10T08:47:47.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.121+0000 7f9d5a800640 1 --2- 172.21.15.2:0/1182460837 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d5c15b4c0 0x7f9d5c14bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:47:47.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.122+0000 7f9d59e00640 1 --2- 172.21.15.2:0/1182460837 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d5c06f5a0 0x7f9d5c15a6f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c02a240 tx=0x7f9d4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:47.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.122+0000 7f9d52000640 1 -- 172.21.15.2:0/1182460837 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c037040 con 0x7f9d5c06f5a0 2024-09-10T08:47:47.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.122+0000 7f9d52000640 1 -- 172.21.15.2:0/1182460837 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d4c042070 con 0x7f9d5c06f5a0 2024-09-10T08:47:47.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.122+0000 7f9d60c00640 1 -- 172.21.15.2:0/1182460837 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d5c151ea0 con 0x7f9d5c06f5a0 2024-09-10T08:47:47.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.122+0000 7f9d52000640 1 -- 172.21.15.2:0/1182460837 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d4c030880 con 0x7f9d5c06f5a0 2024-09-10T08:47:47.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.122+0000 7f9d60c00640 1 -- 172.21.15.2:0/1182460837 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d5c152460 con 0x7f9d5c06f5a0 2024-09-10T08:47:47.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.123+0000 7f9d60c00640 1 -- 172.21.15.2:0/1182460837 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d5c0726b0 con 0x7f9d5c06f5a0 2024-09-10T08:47:47.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.124+0000 7f9d52000640 1 -- 172.21.15.2:0/1182460837 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9d4c030a20 con 0x7f9d5c06f5a0 2024-09-10T08:47:47.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.125+0000 7f9d52000640 1 --2- 172.21.15.2:0/1182460837 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f9d3806be30 0x7f9d3806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:47.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.125+0000 7f9d52000640 1 -- 172.21.15.2:0/1182460837 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5335+0+0 (secure 0 0 0) 0x7f9d4c0ab5b0 con 0x7f9d5c06f5a0 2024-09-10T08:47:47.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.125+0000 7f9d53e00640 1 --2- 172.21.15.2:0/1182460837 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f9d3806be30 0x7f9d3806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:47.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.126+0000 7f9d53e00640 1 --2- 172.21.15.2:0/1182460837 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f9d3806be30 0x7f9d3806e2f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c151af0 tx=0x7f9d44009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:47.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.130+0000 7f9d52000640 1 -- 172.21.15.2:0/1182460837 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9d4c07a030 con 0x7f9d5c06f5a0 2024-09-10T08:47:47.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.335+0000 7f9d60c00640 1 -- 172.21.15.2:0/1182460837 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f9d5c0afe00 con 0x7f9d5c06f5a0 2024-09-10T08:47:47.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.872+0000 7f9d52000640 1 -- 172.21.15.2:0/1182460837 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v32) ==== 97+0+0 (secure 0 0 0) 0x7f9d4c079930 con 0x7f9d5c06f5a0 2024-09-10T08:47:47.873 INFO:teuthology.orchestra.run.smithi002.stderr: removed all blocklist entries 2024-09-10T08:47:47.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.876+0000 7f9d60c00640 1 -- 172.21.15.2:0/1182460837 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f9d3806be30 msgr2=0x7f9d3806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:47.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.876+0000 7f9d60c00640 1 --2- 172.21.15.2:0/1182460837 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f9d3806be30 0x7f9d3806e2f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c151af0 tx=0x7f9d44009190 comp rx=0 tx=0).stop 2024-09-10T08:47:47.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.876+0000 7f9d60c00640 1 -- 172.21.15.2:0/1182460837 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d5c06f5a0 msgr2=0x7f9d5c15a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:47.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.876+0000 7f9d60c00640 1 --2- 172.21.15.2:0/1182460837 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d5c06f5a0 0x7f9d5c15a6f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c02a240 tx=0x7f9d4c0046c0 comp rx=0 tx=0).stop 2024-09-10T08:47:47.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.876+0000 7f9d60c00640 1 -- 172.21.15.2:0/1182460837 shutdown_connections 2024-09-10T08:47:47.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.876+0000 7f9d60c00640 1 --2- 172.21.15.2:0/1182460837 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d5c15b4c0 0x7f9d5c14bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:47.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.876+0000 7f9d60c00640 1 --2- 172.21.15.2:0/1182460837 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f9d3806be30 0x7f9d3806e2f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:47.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.876+0000 7f9d60c00640 1 --2- 172.21.15.2:0/1182460837 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9d5c0af590 0x7f9d5c14b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:47.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.876+0000 7f9d60c00640 1 --2- 172.21.15.2:0/1182460837 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9d5c06f5a0 0x7f9d5c15a6f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:47.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.876+0000 7f9d60c00640 1 -- 172.21.15.2:0/1182460837 >> 172.21.15.2:0/1182460837 conn(0x7f9d5c0d02c0 msgr2=0x7f9d5c14ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:47.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.876+0000 7f9d60c00640 1 -- 172.21.15.2:0/1182460837 shutdown_connections 2024-09-10T08:47:47.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:47.876+0000 7f9d60c00640 1 -- 172.21.15.2:0/1182460837 wait complete. 2024-09-10T08:47:47.894 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-10T08:47:48.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.051+0000 7fc2e0a00640 1 Processor -- start 2024-09-10T08:47:48.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.051+0000 7fc2e0a00640 1 -- start start 2024-09-10T08:47:48.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.052+0000 7fc2e0a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2dc06cc20 0x7fc2dc06e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:48.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.052+0000 7fc2e0a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc2dc15e530 0x7fc2dc06d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:48.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.052+0000 7fc2e0a00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc2dc0ccc00 0x7fc2dc0b4a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:48.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.052+0000 7fc2e0a00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fc2dc06d540 con 0x7fc2dc15e530 2024-09-10T08:47:48.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.052+0000 7fc2e0a00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fc2dc0b3990 con 0x7fc2dc0ccc00 2024-09-10T08:47:48.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.052+0000 7fc2e0a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc2dc0b3c70 con 0x7fc2dc06cc20 2024-09-10T08:47:48.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.052+0000 7fc2d9e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc2dc15e530 0x7fc2dc06d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:48.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.053+0000 7fc2d9e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc2dc15e530 0x7fc2dc06d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35634/0 (socket says 172.21.15.2:35634) 2024-09-10T08:47:48.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.053+0000 7fc2d9e00640 1 -- 172.21.15.2:0/3391182213 learned_addr learned my addr 172.21.15.2:0/3391182213 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:48.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.053+0000 7fc2da800640 1 --2- 172.21.15.2:0/3391182213 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2dc06cc20 0x7fc2dc06e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:48.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.053+0000 7fc2db200640 1 --2- 172.21.15.2:0/3391182213 >> v2:172.21.15.155:3300/0 conn(0x7fc2dc0ccc00 0x7fc2dc0b4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:48.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.053+0000 7fc2d9e00640 1 -- 172.21.15.2:0/3391182213 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2dc06cc20 msgr2=0x7fc2dc06e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:48.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.053+0000 7fc2d9e00640 1 --2- 172.21.15.2:0/3391182213 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2dc06cc20 0x7fc2dc06e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:48.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.053+0000 7fc2d9e00640 1 -- 172.21.15.2:0/3391182213 >> v2:172.21.15.155:3300/0 conn(0x7fc2dc0ccc00 msgr2=0x7fc2dc0b4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:48.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.053+0000 7fc2d9e00640 1 --2- 172.21.15.2:0/3391182213 >> v2:172.21.15.155:3300/0 conn(0x7fc2dc0ccc00 0x7fc2dc0b4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:48.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.053+0000 7fc2d9e00640 1 -- 172.21.15.2:0/3391182213 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2dc0b3f50 con 0x7fc2dc15e530 2024-09-10T08:47:48.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.054+0000 7fc2d9e00640 1 --2- 172.21.15.2:0/3391182213 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2dc15e530 0x7fc2dc06d000 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc06e330 tx=0x7fc2c802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcf1c9da9832dd6e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:48.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.054+0000 7fc2d9400640 1 -- 172.21.15.2:0/3391182213 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2c8037070 con 0x7fc2dc15e530 2024-09-10T08:47:48.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.054+0000 7fc2d9400640 1 -- 172.21.15.2:0/3391182213 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2c8032440 con 0x7fc2dc15e530 2024-09-10T08:47:48.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.054+0000 7fc2d9400640 1 -- 172.21.15.2:0/3391182213 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2c8032810 con 0x7fc2dc15e530 2024-09-10T08:47:48.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.055+0000 7fc2e0a00640 1 -- 172.21.15.2:0/3391182213 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2dc15e530 msgr2=0x7fc2dc06d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:48.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.055+0000 7fc2e0a00640 1 --2- 172.21.15.2:0/3391182213 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2dc15e530 0x7fc2dc06d000 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc06e330 tx=0x7fc2c802a140 comp rx=0 tx=0).stop 2024-09-10T08:47:48.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.055+0000 7fc2e0a00640 1 -- 172.21.15.2:0/3391182213 shutdown_connections 2024-09-10T08:47:48.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.055+0000 7fc2e0a00640 1 --2- 172.21.15.2:0/3391182213 >> v2:172.21.15.155:3300/0 conn(0x7fc2dc0ccc00 0x7fc2dc0b4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:48.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.055+0000 7fc2e0a00640 1 --2- 172.21.15.2:0/3391182213 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2dc15e530 0x7fc2dc06d000 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:48.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.055+0000 7fc2e0a00640 1 --2- 172.21.15.2:0/3391182213 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2dc06cc20 0x7fc2dc06e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:48.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.055+0000 7fc2e0a00640 1 -- 172.21.15.2:0/3391182213 >> 172.21.15.2:0/3391182213 conn(0x7fc2dc072480 msgr2=0x7fc2dc072890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:48.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.055+0000 7fc2e0a00640 1 -- 172.21.15.2:0/3391182213 shutdown_connections 2024-09-10T08:47:48.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.055+0000 7fc2e0a00640 1 -- 172.21.15.2:0/3391182213 wait complete. 2024-09-10T08:47:48.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.056+0000 7fc2e0a00640 1 Processor -- start 2024-09-10T08:47:48.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.057+0000 7fc2e0a00640 1 -- start start 2024-09-10T08:47:48.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.057+0000 7fc2e0a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2dc06cc20 0x7fc2dc14b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:48.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.057+0000 7fc2e0a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2dc0ccc00 0x7fc2dc070020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:48.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.057+0000 7fc2e0a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2dc15e530 0x7fc2dc070560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:48.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.057+0000 7fc2e0a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc2dc0aed80 con 0x7fc2dc15e530 2024-09-10T08:47:48.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.057+0000 7fc2e0a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc2dc0b4510 con 0x7fc2dc0ccc00 2024-09-10T08:47:48.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.057+0000 7fc2e0a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc2dc0aef00 con 0x7fc2dc06cc20 2024-09-10T08:47:48.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.058+0000 7fc2db200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2dc15e530 0x7fc2dc070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:48.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.058+0000 7fc2db200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2dc15e530 0x7fc2dc070560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35638/0 (socket says 172.21.15.2:35638) 2024-09-10T08:47:48.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.058+0000 7fc2db200640 1 -- 172.21.15.2:0/878567422 learned_addr learned my addr 172.21.15.2:0/878567422 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:48.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.058+0000 7fc2da800640 1 --2- 172.21.15.2:0/878567422 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2dc06cc20 0x7fc2dc14b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:48.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.058+0000 7fc2d9e00640 1 --2- 172.21.15.2:0/878567422 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2dc0ccc00 0x7fc2dc070020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:48.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.058+0000 7fc2db200640 1 -- 172.21.15.2:0/878567422 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2dc06cc20 msgr2=0x7fc2dc14b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:48.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.058+0000 7fc2db200640 1 --2- 172.21.15.2:0/878567422 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2dc06cc20 0x7fc2dc14b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:48.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.058+0000 7fc2db200640 1 -- 172.21.15.2:0/878567422 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2dc0ccc00 msgr2=0x7fc2dc070020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:48.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.058+0000 7fc2db200640 1 --2- 172.21.15.2:0/878567422 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2dc0ccc00 0x7fc2dc070020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:48.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.058+0000 7fc2db200640 1 -- 172.21.15.2:0/878567422 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2dc1f4550 con 0x7fc2dc15e530 2024-09-10T08:47:48.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.058+0000 7fc2db200640 1 --2- 172.21.15.2:0/878567422 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2dc15e530 0x7fc2dc070560 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc2d4007e90 tx=0x7fc2d400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:48.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.059+0000 7fc2d2a00640 1 -- 172.21.15.2:0/878567422 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d4014420 con 0x7fc2dc15e530 2024-09-10T08:47:48.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.059+0000 7fc2d2a00640 1 -- 172.21.15.2:0/878567422 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2d4019070 con 0x7fc2dc15e530 2024-09-10T08:47:48.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.059+0000 7fc2d2a00640 1 -- 172.21.15.2:0/878567422 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d4014800 con 0x7fc2dc15e530 2024-09-10T08:47:48.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.059+0000 7fc2e0a00640 1 -- 172.21.15.2:0/878567422 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2dc1f47f0 con 0x7fc2dc15e530 2024-09-10T08:47:48.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.059+0000 7fc2e0a00640 1 -- 172.21.15.2:0/878567422 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2dc1f4db0 con 0x7fc2dc15e530 2024-09-10T08:47:48.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.060+0000 7fc2e0a00640 1 -- 172.21.15.2:0/878567422 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2dc072fa0 con 0x7fc2dc15e530 2024-09-10T08:47:48.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.061+0000 7fc2d2a00640 1 -- 172.21.15.2:0/878567422 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc2d40149a0 con 0x7fc2dc15e530 2024-09-10T08:47:48.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.062+0000 7fc2d2a00640 1 --2- 172.21.15.2:0/878567422 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fc2bc06be30 0x7fc2bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:48.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.062+0000 7fc2d2a00640 1 -- 172.21.15.2:0/878567422 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7fc2d408b410 con 0x7fc2dc15e530 2024-09-10T08:47:48.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.062+0000 7fc2da800640 1 --2- 172.21.15.2:0/878567422 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fc2bc06be30 0x7fc2bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:48.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.063+0000 7fc2da800640 1 --2- 172.21.15.2:0/878567422 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fc2bc06be30 0x7fc2bc06e2f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc003610 tx=0x7fc2cc008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:48.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.066+0000 7fc2d2a00640 1 -- 172.21.15.2:0/878567422 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc2d4059890 con 0x7fc2dc15e530 2024-09-10T08:47:48.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.317+0000 7fc2e0a00640 1 -- 172.21.15.2:0/878567422 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fc2dc14b890 con 0x7fc2dc15e530 2024-09-10T08:47:48.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.318+0000 7fc2d2a00640 1 -- 172.21.15.2:0/878567422 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v2) ==== 80+0+6645 (secure 0 0 0) 0x7fc2d405db90 con 0x7fc2dc15e530 2024-09-10T08:47:48.318 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:47:48.318 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T08:47:48.318 INFO:teuthology.orchestra.run.smithi002.stdout: "auth_dump": [ 2024-09-10T08:47:48.318 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T08:47:48.318 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.a", 2024-09-10T08:47:48.318 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQA1B+BmEVRhABAA8jfjpX9lvikdox7CR8zSCg==", 2024-09-10T08:47:48.318 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-09-10T08:47:48.318 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2024-09-10T08:47:48.319 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2024-09-10T08:47:48.319 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2024-09-10T08:47:48.319 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2024-09-10T08:47:48.319 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T08:47:48.319 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T08:47:48.319 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T08:47:48.319 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.b", 2024-09-10T08:47:48.319 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQA1B+BmsZkXFBAAG3SVjh3zdn5K3GMN3FXkbQ==", 2024-09-10T08:47:48.319 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-09-10T08:47:48.319 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2024-09-10T08:47:48.319 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2024-09-10T08:47:48.319 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2024-09-10T08:47:48.320 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2024-09-10T08:47:48.320 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T08:47:48.320 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T08:47:48.320 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T08:47:48.320 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.c", 2024-09-10T08:47:48.320 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQA1B+BmS64iChAAFZZOEpnV/8hKcMm8FsyqaQ==", 2024-09-10T08:47:48.320 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-09-10T08:47:48.320 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2024-09-10T08:47:48.320 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2024-09-10T08:47:48.320 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2024-09-10T08:47:48.320 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2024-09-10T08:47:48.320 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T08:47:48.320 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T08:47:48.321 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T08:47:48.321 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.d", 2024-09-10T08:47:48.321 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQA1B+Bm7bkzHhAAkPguX9SLuN+yCHnua4ZRnA==", 2024-09-10T08:47:48.321 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-09-10T08:47:48.321 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2024-09-10T08:47:48.321 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2024-09-10T08:47:48.321 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2024-09-10T08:47:48.321 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2024-09-10T08:47:48.321 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T08:47:48.321 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T08:47:48.321 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T08:47:48.321 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.0", 2024-09-10T08:47:48.322 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQA3B+Bmiim9EhAA+HiARCGbkniPIJ8MhzOjpA==", 2024-09-10T08:47:48.322 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-09-10T08:47:48.322 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2024-09-10T08:47:48.322 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2024-09-10T08:47:48.322 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2024-09-10T08:47:48.322 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T08:47:48.322 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T08:47:48.322 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T08:47:48.322 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.1", 2024-09-10T08:47:48.322 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQA6B+BmDx73LBAAoKZSnY1Qaqolkj9Yzq1cAg==", 2024-09-10T08:47:48.322 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-09-10T08:47:48.322 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2024-09-10T08:47:48.322 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2024-09-10T08:47:48.322 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2024-09-10T08:47:48.323 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T08:47:48.323 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T08:47:48.323 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T08:47:48.323 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.2", 2024-09-10T08:47:48.323 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQA9B+BmBVpTNxAAnPBoBFkC/MSP/GAXZFcbuw==", 2024-09-10T08:47:48.323 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-09-10T08:47:48.323 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2024-09-10T08:47:48.323 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2024-09-10T08:47:48.323 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2024-09-10T08:47:48.323 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T08:47:48.323 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T08:47:48.323 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T08:47:48.324 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.3", 2024-09-10T08:47:48.324 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBBB+Bmt6tfBRAAXTfRz7dGEqtzOnFwr7WX6g==", 2024-09-10T08:47:48.324 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-09-10T08:47:48.324 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2024-09-10T08:47:48.324 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2024-09-10T08:47:48.324 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2024-09-10T08:47:48.324 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T08:47:48.324 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T08:47:48.324 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T08:47:48.324 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.4", 2024-09-10T08:47:48.324 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBHB+BmDJrLBBAAykb4iQOnFAxc3UoWpKsl5Q==", 2024-09-10T08:47:48.324 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-09-10T08:47:48.324 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2024-09-10T08:47:48.324 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2024-09-10T08:47:48.324 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2024-09-10T08:47:48.325 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T08:47:48.325 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T08:47:48.325 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T08:47:48.325 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.5", 2024-09-10T08:47:48.325 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBKB+BmOM9QEBAAeqFkW1v4h1IJOQw/pLYYbw==", 2024-09-10T08:47:48.325 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-09-10T08:47:48.325 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2024-09-10T08:47:48.325 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2024-09-10T08:47:48.325 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2024-09-10T08:47:48.325 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T08:47:48.325 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T08:47:48.325 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T08:47:48.325 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.6", 2024-09-10T08:47:48.326 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBNB+Bm6PhuGxAACnqiol+6kzbqqYRdOAD3vw==", 2024-09-10T08:47:48.326 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-09-10T08:47:48.326 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2024-09-10T08:47:48.326 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2024-09-10T08:47:48.326 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2024-09-10T08:47:48.326 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T08:47:48.326 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T08:47:48.326 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T08:47:48.326 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.7", 2024-09-10T08:47:48.326 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBQB+BmOj/lMxAA5l5RGbrqLbPLTHslAT8fuA==", 2024-09-10T08:47:48.326 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-09-10T08:47:48.326 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2024-09-10T08:47:48.326 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2024-09-10T08:47:48.326 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2024-09-10T08:47:48.327 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T08:47:48.327 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T08:47:48.327 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T08:47:48.327 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.0", 2024-09-10T08:47:48.327 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQA1B+Bmtsv1JhAAUIdP6HQM/8FYI9fUbtrLmw==", 2024-09-10T08:47:48.327 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-09-10T08:47:48.327 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2024-09-10T08:47:48.327 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow r", 2024-09-10T08:47:48.327 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow rw", 2024-09-10T08:47:48.327 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rwx" 2024-09-10T08:47:48.327 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T08:47:48.327 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T08:47:48.327 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T08:47:48.328 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.1", 2024-09-10T08:47:48.328 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQA1B+Bmna4pNBAAukbWPsLviCm0X4GnOfJ03g==", 2024-09-10T08:47:48.328 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-09-10T08:47:48.328 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2024-09-10T08:47:48.328 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow r", 2024-09-10T08:47:48.328 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow rw", 2024-09-10T08:47:48.328 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rwx" 2024-09-10T08:47:48.328 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T08:47:48.328 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T08:47:48.328 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T08:47:48.328 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.2", 2024-09-10T08:47:48.328 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQA1B+Bm1I9rLRAAbflFrTJ2wgprqehY/bhyOg==", 2024-09-10T08:47:48.328 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-09-10T08:47:48.328 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2024-09-10T08:47:48.329 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow r", 2024-09-10T08:47:48.329 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow rw", 2024-09-10T08:47:48.329 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rwx" 2024-09-10T08:47:48.329 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T08:47:48.329 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T08:47:48.329 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T08:47:48.329 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.3", 2024-09-10T08:47:48.329 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQA1B+BmXP/DOhAAi4c5yj2RVc9D23jd1ti7iw==", 2024-09-10T08:47:48.329 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-09-10T08:47:48.329 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2024-09-10T08:47:48.329 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow r", 2024-09-10T08:47:48.329 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow rw", 2024-09-10T08:47:48.329 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rwx" 2024-09-10T08:47:48.330 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T08:47:48.330 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T08:47:48.330 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T08:47:48.330 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.admin", 2024-09-10T08:47:48.330 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQA0B+Bmrjc6CxAAJm8WJw1QK3ziVsy00eU8eQ==", 2024-09-10T08:47:48.330 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-09-10T08:47:48.330 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2024-09-10T08:47:48.330 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2024-09-10T08:47:48.330 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2024-09-10T08:47:48.330 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2024-09-10T08:47:48.330 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T08:47:48.330 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T08:47:48.330 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T08:47:48.330 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.bootstrap-mds", 2024-09-10T08:47:48.331 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBiB+Bmyp6/HBAAYlXBrd2+RXJdaWgaJtp9cw==", 2024-09-10T08:47:48.331 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-09-10T08:47:48.331 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile bootstrap-mds" 2024-09-10T08:47:48.331 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T08:47:48.331 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T08:47:48.331 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T08:47:48.331 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.bootstrap-mgr", 2024-09-10T08:47:48.331 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBiB+BmHaq/HBAAPi9JjIk4fTpue6nGVn6bGQ==", 2024-09-10T08:47:48.331 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-09-10T08:47:48.331 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile bootstrap-mgr" 2024-09-10T08:47:48.331 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T08:47:48.331 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T08:47:48.331 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T08:47:48.331 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.bootstrap-osd", 2024-09-10T08:47:48.332 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBiB+Bm1LK/HBAAGNg9IBeQ06KUuPkS0779Cw==", 2024-09-10T08:47:48.332 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-09-10T08:47:48.332 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile bootstrap-osd" 2024-09-10T08:47:48.332 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T08:47:48.332 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T08:47:48.332 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T08:47:48.332 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.bootstrap-rbd", 2024-09-10T08:47:48.332 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBiB+BmXbu/HBAAvw1CYRMG4L3s11T5xEv8+Q==", 2024-09-10T08:47:48.332 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-09-10T08:47:48.332 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile bootstrap-rbd" 2024-09-10T08:47:48.332 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T08:47:48.332 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T08:47:48.332 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T08:47:48.332 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-09-10T08:47:48.333 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBiB+Bm6sm/HBAAMyYMtBhHvd+JjRPz9GGenA==", 2024-09-10T08:47:48.333 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-09-10T08:47:48.333 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-09-10T08:47:48.333 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T08:47:48.333 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T08:47:48.333 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T08:47:48.333 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.bootstrap-rgw", 2024-09-10T08:47:48.333 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQBiB+BmuNK/HBAAGDsuUb7oNHtuISHJzGTmDg==", 2024-09-10T08:47:48.333 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-09-10T08:47:48.333 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile bootstrap-rgw" 2024-09-10T08:47:48.333 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T08:47:48.333 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T08:47:48.333 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T08:47:48.333 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mgr.x", 2024-09-10T08:47:48.334 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQA0B+BmYLRANRAAy4BZ/nE9vytgN98l8ltTqA==", 2024-09-10T08:47:48.334 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-09-10T08:47:48.334 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2024-09-10T08:47:48.334 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile mgr", 2024-09-10T08:47:48.334 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2024-09-10T08:47:48.334 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T08:47:48.334 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-10T08:47:48.334 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T08:47:48.334 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mgr.y", 2024-09-10T08:47:48.334 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQA0B+BmwlgbLRAAkqvP1xOF2u1HvHJJ83akSQ==", 2024-09-10T08:47:48.334 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2024-09-10T08:47:48.334 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2024-09-10T08:47:48.334 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile mgr", 2024-09-10T08:47:48.335 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2024-09-10T08:47:48.335 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T08:47:48.335 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T08:47:48.335 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2024-09-10T08:47:48.335 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T08:47:48.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.320+0000 7fc2e0a00640 1 -- 172.21.15.2:0/878567422 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fc2bc06be30 msgr2=0x7fc2bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:48.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.320+0000 7fc2e0a00640 1 --2- 172.21.15.2:0/878567422 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fc2bc06be30 0x7fc2bc06e2f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc003610 tx=0x7fc2cc008040 comp rx=0 tx=0).stop 2024-09-10T08:47:48.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.320+0000 7fc2e0a00640 1 -- 172.21.15.2:0/878567422 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2dc15e530 msgr2=0x7fc2dc070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:48.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.320+0000 7fc2e0a00640 1 --2- 172.21.15.2:0/878567422 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2dc15e530 0x7fc2dc070560 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc2d4007e90 tx=0x7fc2d400e4b0 comp rx=0 tx=0).stop 2024-09-10T08:47:48.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.320+0000 7fc2e0a00640 1 -- 172.21.15.2:0/878567422 shutdown_connections 2024-09-10T08:47:48.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.320+0000 7fc2e0a00640 1 --2- 172.21.15.2:0/878567422 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc2dc15e530 0x7fc2dc070560 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:48.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.320+0000 7fc2e0a00640 1 --2- 172.21.15.2:0/878567422 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2dc0ccc00 0x7fc2dc070020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:48.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.320+0000 7fc2e0a00640 1 --2- 172.21.15.2:0/878567422 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fc2bc06be30 0x7fc2bc06e2f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:48.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.320+0000 7fc2e0a00640 1 --2- 172.21.15.2:0/878567422 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc2dc06cc20 0x7fc2dc14b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:48.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.320+0000 7fc2e0a00640 1 -- 172.21.15.2:0/878567422 >> 172.21.15.2:0/878567422 conn(0x7fc2dc072480 msgr2=0x7fc2dc0b0cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:48.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.320+0000 7fc2e0a00640 1 -- 172.21.15.2:0/878567422 shutdown_connections 2024-09-10T08:47:48.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.320+0000 7fc2e0a00640 1 -- 172.21.15.2:0/878567422 wait complete. 2024-09-10T08:47:48.338 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-09-10T08:47:48.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.494+0000 7f1d32000640 1 Processor -- start 2024-09-10T08:47:48.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.494+0000 7f1d32000640 1 -- start start 2024-09-10T08:47:48.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.495+0000 7f1d32000640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f1d2c15c460 0x7f1d2c15d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:48.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.495+0000 7f1d32000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1d2c0cf310 0x7f1d2c0b43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:48.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.495+0000 7f1d32000640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d2c1603b0 con 0x7f1d2c06df50 2024-09-10T08:47:48.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.495+0000 7f1d32000640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f1d2c161030 con 0x7f1d2c15c460 2024-09-10T08:47:48.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.495+0000 7f1d32000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1d2c15da70 con 0x7f1d2c0cf310 2024-09-10T08:47:48.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.495+0000 7f1d2aa00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f1d2c06df50 0x7f1d2c0cec00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:51962/0 (socket says 172.21.15.2:51962) 2024-09-10T08:47:48.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.495+0000 7f1d2aa00640 1 -- 172.21.15.2:0/2456082662 learned_addr learned my addr 172.21.15.2:0/2456082662 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:47:48.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.496+0000 7f1d2b400640 1 --2- 172.21.15.2:0/2456082662 >> v2:172.21.15.155:3300/0 conn(0x7f1d2c15c460 0x7f1d2c15d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:48.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.496+0000 7f1d2be00640 1 --2- 172.21.15.2:0/2456082662 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1d2c0cf310 0x7f1d2c0b43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:48.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.496+0000 7f1d2a000640 1 -- 172.21.15.2:0/2456082662 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 994709161 0 0) 0x7f1d2c1603b0 con 0x7f1d2c06df50 2024-09-10T08:47:48.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.496+0000 7f1d2a000640 1 -- 172.21.15.2:0/2456082662 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d10003520 con 0x7f1d2c06df50 2024-09-10T08:47:48.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.496+0000 7f1d2b400640 1 -- 172.21.15.2:0/2456082662 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1d2c0cf310 msgr2=0x7f1d2c0b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:48.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.496+0000 7f1d2b400640 1 --2- 172.21.15.2:0/2456082662 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1d2c0cf310 0x7f1d2c0b43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:48.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.496+0000 7f1d2b400640 1 -- 172.21.15.2:0/2456082662 >> v1:172.21.15.2:6789/0 conn(0x7f1d2c06df50 legacy=0x7f1d2c0cec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:48.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.496+0000 7f1d2b400640 1 -- 172.21.15.2:0/2456082662 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d2c160690 con 0x7f1d2c15c460 2024-09-10T08:47:48.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.496+0000 7f1d2be00640 1 --2- 172.21.15.2:0/2456082662 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1d2c0cf310 0x7f1d2c0b43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:47:48.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.497+0000 7f1d2b400640 1 --2- 172.21.15.2:0/2456082662 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d2c15c460 0x7f1d2c15d530 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c0097d0 tx=0x7f1d1c02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6601238b918659b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:48.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.498+0000 7f1d2a000640 1 -- 172.21.15.2:0/2456082662 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d1c037070 con 0x7f1d2c15c460 2024-09-10T08:47:48.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.498+0000 7f1d2a000640 1 -- 172.21.15.2:0/2456082662 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d1c032440 con 0x7f1d2c15c460 2024-09-10T08:47:48.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.498+0000 7f1d2a000640 1 -- 172.21.15.2:0/2456082662 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d1c0327f0 con 0x7f1d2c15c460 2024-09-10T08:47:48.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.499+0000 7f1d32000640 1 -- 172.21.15.2:0/2456082662 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d2c15c460 msgr2=0x7f1d2c15d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:48.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.499+0000 7f1d32000640 1 --2- 172.21.15.2:0/2456082662 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d2c15c460 0x7f1d2c15d530 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c0097d0 tx=0x7f1d1c02a1c0 comp rx=0 tx=0).stop 2024-09-10T08:47:48.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.499+0000 7f1d32000640 1 -- 172.21.15.2:0/2456082662 shutdown_connections 2024-09-10T08:47:48.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.499+0000 7f1d32000640 1 --2- 172.21.15.2:0/2456082662 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1d2c0cf310 0x7f1d2c0b43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:48.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.499+0000 7f1d32000640 1 --2- 172.21.15.2:0/2456082662 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d2c15c460 0x7f1d2c15d530 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:48.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.499+0000 7f1d32000640 1 -- 172.21.15.2:0/2456082662 >> 172.21.15.2:0/2456082662 conn(0x7f1d2c0d02c0 msgr2=0x7f1d2c0d06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:48.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.499+0000 7f1d32000640 1 -- 172.21.15.2:0/2456082662 shutdown_connections 2024-09-10T08:47:48.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.499+0000 7f1d32000640 1 -- 172.21.15.2:0/2456082662 wait complete. 2024-09-10T08:47:48.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.500+0000 7f1d32000640 1 Processor -- start 2024-09-10T08:47:48.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.500+0000 7f1d32000640 1 -- start start 2024-09-10T08:47:48.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.501+0000 7f1d32000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d2c06df50 0x7f1d2c1554f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:48.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.501+0000 7f1d32000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d2c0cf310 0x7f1d2c09afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:48.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.501+0000 7f1d32000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1d2c15c460 0x7f1d2c157860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:48.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.501+0000 7f1d32000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1d2c160080 con 0x7f1d2c06df50 2024-09-10T08:47:48.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.501+0000 7f1d32000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1d2c160c50 con 0x7f1d2c0cf310 2024-09-10T08:47:48.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.501+0000 7f1d32000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1d2c15c840 con 0x7f1d2c15c460 2024-09-10T08:47:48.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.502+0000 7f1d2b400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d2c06df50 0x7f1d2c1554f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:48.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.502+0000 7f1d2b400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d2c06df50 0x7f1d2c1554f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35642/0 (socket says 172.21.15.2:35642) 2024-09-10T08:47:48.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.502+0000 7f1d2b400640 1 -- 172.21.15.2:0/243314877 learned_addr learned my addr 172.21.15.2:0/243314877 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:48.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.502+0000 7f1d2aa00640 1 --2- 172.21.15.2:0/243314877 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d2c0cf310 0x7f1d2c09afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:48.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.502+0000 7f1d2be00640 1 --2- 172.21.15.2:0/243314877 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1d2c15c460 0x7f1d2c157860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:48.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.502+0000 7f1d2b400640 1 -- 172.21.15.2:0/243314877 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1d2c15c460 msgr2=0x7f1d2c157860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:48.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.502+0000 7f1d2b400640 1 --2- 172.21.15.2:0/243314877 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1d2c15c460 0x7f1d2c157860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:48.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.502+0000 7f1d2b400640 1 -- 172.21.15.2:0/243314877 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d2c0cf310 msgr2=0x7f1d2c09afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:48.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.502+0000 7f1d2b400640 1 --2- 172.21.15.2:0/243314877 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d2c0cf310 0x7f1d2c09afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:48.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.502+0000 7f1d2b400640 1 -- 172.21.15.2:0/243314877 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d2c0cb610 con 0x7f1d2c06df50 2024-09-10T08:47:48.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.502+0000 7f1d2aa00640 1 --2- 172.21.15.2:0/243314877 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d2c0cf310 0x7f1d2c09afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:47:48.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.502+0000 7f1d2be00640 1 --2- 172.21.15.2:0/243314877 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1d2c15c460 0x7f1d2c157860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:47:48.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.502+0000 7f1d2b400640 1 --2- 172.21.15.2:0/243314877 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d2c06df50 0x7f1d2c1554f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c035040 tx=0x7f1d1c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:48.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.503+0000 7f1d23400640 1 -- 172.21.15.2:0/243314877 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d1c041020 con 0x7f1d2c06df50 2024-09-10T08:47:48.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.503+0000 7f1d23400640 1 -- 172.21.15.2:0/243314877 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d1c03d720 con 0x7f1d2c06df50 2024-09-10T08:47:48.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.503+0000 7f1d23400640 1 -- 172.21.15.2:0/243314877 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d1c037040 con 0x7f1d2c06df50 2024-09-10T08:47:48.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.503+0000 7f1d32000640 1 -- 172.21.15.2:0/243314877 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d2c0cb8f0 con 0x7f1d2c06df50 2024-09-10T08:47:48.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.503+0000 7f1d32000640 1 -- 172.21.15.2:0/243314877 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d2c0cb230 con 0x7f1d2c06df50 2024-09-10T08:47:48.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.504+0000 7f1d32000640 1 -- 172.21.15.2:0/243314877 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d2c0d06a0 con 0x7f1d2c06df50 2024-09-10T08:47:48.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.505+0000 7f1d23400640 1 -- 172.21.15.2:0/243314877 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1d1c044020 con 0x7f1d2c06df50 2024-09-10T08:47:48.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.506+0000 7f1d23400640 1 --2- 172.21.15.2:0/243314877 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f1d0c06be30 0x7f1d0c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:48.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.506+0000 7f1d23400640 1 -- 172.21.15.2:0/243314877 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7f1d1c0ab4a0 con 0x7f1d2c06df50 2024-09-10T08:47:48.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.507+0000 7f1d2aa00640 1 --2- 172.21.15.2:0/243314877 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f1d0c06be30 0x7f1d0c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:48.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.507+0000 7f1d2aa00640 1 --2- 172.21.15.2:0/243314877 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f1d0c06be30 0x7f1d0c06e2f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1d18007fd0 tx=0x7f1d18009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:48.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.511+0000 7f1d23400640 1 -- 172.21.15.2:0/243314877 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1d2c0d06a0 con 0x7f1d2c06df50 2024-09-10T08:47:48.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.760+0000 7f1d32000640 1 -- 172.21.15.2:0/243314877 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f1d2c06ed00 con 0x7f1d2c06df50 2024-09-10T08:47:48.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.763+0000 7f1d23400640 1 -- 172.21.15.2:0/243314877 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v3) ==== 90+0+0 (secure 0 0 0) 0x7f1d1c04b030 con 0x7f1d2c06df50 2024-09-10T08:47:48.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.766+0000 7f1d32000640 1 -- 172.21.15.2:0/243314877 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f1d0c06be30 msgr2=0x7f1d0c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:48.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.766+0000 7f1d32000640 1 --2- 172.21.15.2:0/243314877 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f1d0c06be30 0x7f1d0c06e2f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1d18007fd0 tx=0x7f1d18009040 comp rx=0 tx=0).stop 2024-09-10T08:47:48.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.766+0000 7f1d32000640 1 -- 172.21.15.2:0/243314877 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d2c06df50 msgr2=0x7f1d2c1554f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:48.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.766+0000 7f1d32000640 1 --2- 172.21.15.2:0/243314877 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d2c06df50 0x7f1d2c1554f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c035040 tx=0x7f1d1c0046c0 comp rx=0 tx=0).stop 2024-09-10T08:47:48.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.766+0000 7f1d32000640 1 -- 172.21.15.2:0/243314877 shutdown_connections 2024-09-10T08:47:48.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.766+0000 7f1d32000640 1 --2- 172.21.15.2:0/243314877 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f1d0c06be30 0x7f1d0c06e2f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:48.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.766+0000 7f1d32000640 1 --2- 172.21.15.2:0/243314877 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1d2c15c460 0x7f1d2c157860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:48.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.766+0000 7f1d32000640 1 --2- 172.21.15.2:0/243314877 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d2c0cf310 0x7f1d2c09afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:48.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.766+0000 7f1d32000640 1 --2- 172.21.15.2:0/243314877 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1d2c06df50 0x7f1d2c1554f0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:48.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.766+0000 7f1d32000640 1 -- 172.21.15.2:0/243314877 >> 172.21.15.2:0/243314877 conn(0x7f1d2c0d02c0 msgr2=0x7f1d2c06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:48.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.766+0000 7f1d32000640 1 -- 172.21.15.2:0/243314877 shutdown_connections 2024-09-10T08:47:48.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.766+0000 7f1d32000640 1 -- 172.21.15.2:0/243314877 wait complete. 2024-09-10T08:47:48.781 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-09-10T08:47:48.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.941+0000 7f73aae00640 1 Processor -- start 2024-09-10T08:47:48.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.942+0000 7f73aae00640 1 -- start start 2024-09-10T08:47:48.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.943+0000 7f73aae00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f73a415b4c0 0x7f73a40cf6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:48.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.943+0000 7f73aae00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f73a40af590 0x7f73a406f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:48.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.943+0000 7f73aae00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73a406f5a0 0x7f73a40ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:48.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.943+0000 7f73aae00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f73a40afa00 con 0x7f73a415b4c0 2024-09-10T08:47:48.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.943+0000 7f73aae00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f73a406fa10 con 0x7f73a40af590 2024-09-10T08:47:48.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.943+0000 7f73aae00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f73a40d1130 con 0x7f73a406f5a0 2024-09-10T08:47:48.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.943+0000 7f73a3e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f73a415b4c0 0x7f73a40cf6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:48.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.943+0000 7f73a3e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f73a415b4c0 0x7f73a40cf6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35654/0 (socket says 172.21.15.2:35654) 2024-09-10T08:47:48.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.943+0000 7f73a3e00640 1 -- 172.21.15.2:0/502781745 learned_addr learned my addr 172.21.15.2:0/502781745 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:48.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.943+0000 7f73a8e00640 1 --2- 172.21.15.2:0/502781745 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73a406f5a0 0x7f73a40ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:48.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.943+0000 7f739be00640 1 --2- 172.21.15.2:0/502781745 >> v2:172.21.15.155:3300/0 conn(0x7f73a40af590 0x7f73a406f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:48.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.943+0000 7f73a3e00640 1 -- 172.21.15.2:0/502781745 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73a406f5a0 msgr2=0x7f73a40ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:48.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.943+0000 7f73a3e00640 1 --2- 172.21.15.2:0/502781745 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73a406f5a0 0x7f73a40ce5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:48.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.943+0000 7f73a3e00640 1 -- 172.21.15.2:0/502781745 >> v2:172.21.15.155:3300/0 conn(0x7f73a40af590 msgr2=0x7f73a406f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:48.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.943+0000 7f73a3e00640 1 --2- 172.21.15.2:0/502781745 >> v2:172.21.15.155:3300/0 conn(0x7f73a40af590 0x7f73a406f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:48.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.943+0000 7f73a3e00640 1 -- 172.21.15.2:0/502781745 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73a40ad390 con 0x7f73a415b4c0 2024-09-10T08:47:48.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.944+0000 7f739be00640 1 --2- 172.21.15.2:0/502781745 >> v2:172.21.15.155:3300/0 conn(0x7f73a40af590 0x7f73a406f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:47:48.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.944+0000 7f73a3e00640 1 --2- 172.21.15.2:0/502781745 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73a415b4c0 0x7f73a40cf6d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f73a40743b0 tx=0x7f739402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b9506ab9b7f0433 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:48.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.945+0000 7f73a3400640 1 -- 172.21.15.2:0/502781745 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7394037070 con 0x7f73a415b4c0 2024-09-10T08:47:48.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.945+0000 7f73a3400640 1 -- 172.21.15.2:0/502781745 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7394032440 con 0x7f73a415b4c0 2024-09-10T08:47:48.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.945+0000 7f73a3400640 1 -- 172.21.15.2:0/502781745 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7394032810 con 0x7f73a415b4c0 2024-09-10T08:47:48.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.945+0000 7f73aae00640 1 -- 172.21.15.2:0/502781745 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73a415b4c0 msgr2=0x7f73a40cf6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:48.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.945+0000 7f73aae00640 1 --2- 172.21.15.2:0/502781745 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73a415b4c0 0x7f73a40cf6d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f73a40743b0 tx=0x7f739402a140 comp rx=0 tx=0).stop 2024-09-10T08:47:48.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.945+0000 7f73aae00640 1 -- 172.21.15.2:0/502781745 shutdown_connections 2024-09-10T08:47:48.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.945+0000 7f73aae00640 1 --2- 172.21.15.2:0/502781745 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73a406f5a0 0x7f73a40ce5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:48.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.945+0000 7f73aae00640 1 --2- 172.21.15.2:0/502781745 >> v2:172.21.15.155:3300/0 conn(0x7f73a40af590 0x7f73a406f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:48.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.945+0000 7f73aae00640 1 --2- 172.21.15.2:0/502781745 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73a415b4c0 0x7f73a40cf6d0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:48.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.945+0000 7f73aae00640 1 -- 172.21.15.2:0/502781745 >> 172.21.15.2:0/502781745 conn(0x7f73a40d02c0 msgr2=0x7f73a40d06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:48.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.945+0000 7f73aae00640 1 -- 172.21.15.2:0/502781745 shutdown_connections 2024-09-10T08:47:48.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.946+0000 7f73aae00640 1 -- 172.21.15.2:0/502781745 wait complete. 2024-09-10T08:47:48.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.947+0000 7f73aae00640 1 Processor -- start 2024-09-10T08:47:48.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.947+0000 7f73aae00640 1 -- start start 2024-09-10T08:47:48.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.948+0000 7f73aae00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73a406f5a0 0x7f73a41ef490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:48.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.948+0000 7f73aae00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73a40af590 0x7f73a409a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:48.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.948+0000 7f73aae00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73a415b4c0 0x7f73a409aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:48.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.948+0000 7f73aae00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f73a40ad950 con 0x7f73a406f5a0 2024-09-10T08:47:48.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.948+0000 7f73aae00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f73a40ad140 con 0x7f73a415b4c0 2024-09-10T08:47:48.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.948+0000 7f73aae00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f73a40adc30 con 0x7f73a40af590 2024-09-10T08:47:48.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.948+0000 7f73a3e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73a406f5a0 0x7f73a41ef490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:48.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.948+0000 7f73a3e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73a406f5a0 0x7f73a41ef490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35670/0 (socket says 172.21.15.2:35670) 2024-09-10T08:47:48.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.949+0000 7f73a3e00640 1 -- 172.21.15.2:0/3487638293 learned_addr learned my addr 172.21.15.2:0/3487638293 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:48.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.949+0000 7f739be00640 1 --2- 172.21.15.2:0/3487638293 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73a40af590 0x7f73a409a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:48.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.949+0000 7f73a8e00640 1 --2- 172.21.15.2:0/3487638293 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73a415b4c0 0x7f73a409aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:48.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.949+0000 7f73a3e00640 1 -- 172.21.15.2:0/3487638293 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73a40af590 msgr2=0x7f73a409a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:48.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.949+0000 7f73a3e00640 1 --2- 172.21.15.2:0/3487638293 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73a40af590 0x7f73a409a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:48.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.949+0000 7f73a3e00640 1 -- 172.21.15.2:0/3487638293 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73a415b4c0 msgr2=0x7f73a409aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:48.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.949+0000 7f73a3e00640 1 --2- 172.21.15.2:0/3487638293 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73a415b4c0 0x7f73a409aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:48.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.949+0000 7f73a3e00640 1 -- 172.21.15.2:0/3487638293 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73a409d500 con 0x7f73a406f5a0 2024-09-10T08:47:48.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.949+0000 7f73a3e00640 1 --2- 172.21.15.2:0/3487638293 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73a406f5a0 0x7f73a41ef490 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f739402a180 tx=0x7f73940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:48.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.949+0000 7f73a0c00640 1 -- 172.21.15.2:0/3487638293 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7394037040 con 0x7f73a406f5a0 2024-09-10T08:47:48.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.950+0000 7f73a0c00640 1 -- 172.21.15.2:0/3487638293 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7394042070 con 0x7f73a406f5a0 2024-09-10T08:47:48.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.950+0000 7f73a0c00640 1 -- 172.21.15.2:0/3487638293 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7394030880 con 0x7f73a406f5a0 2024-09-10T08:47:48.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.950+0000 7f73aae00640 1 -- 172.21.15.2:0/3487638293 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73a409d7e0 con 0x7f73a406f5a0 2024-09-10T08:47:48.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.950+0000 7f73aae00640 1 -- 172.21.15.2:0/3487638293 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73a409dda0 con 0x7f73a406f5a0 2024-09-10T08:47:48.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.951+0000 7f73aae00640 1 -- 172.21.15.2:0/3487638293 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73a4071ef0 con 0x7f73a406f5a0 2024-09-10T08:47:48.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.951+0000 7f73a0c00640 1 -- 172.21.15.2:0/3487638293 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7394030a20 con 0x7f73a406f5a0 2024-09-10T08:47:48.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.952+0000 7f73a0c00640 1 --2- 172.21.15.2:0/3487638293 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f7380070240 0x7f7380072700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:48.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.952+0000 7f73a0c00640 1 -- 172.21.15.2:0/3487638293 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7f73940ab580 con 0x7f73a406f5a0 2024-09-10T08:47:48.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.953+0000 7f739be00640 1 --2- 172.21.15.2:0/3487638293 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f7380070240 0x7f7380072700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:48.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.953+0000 7f739be00640 1 --2- 172.21.15.2:0/3487638293 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f7380070240 0x7f7380072700 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f73a41512f0 tx=0x7f738c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:48.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:48.957+0000 7f73a0c00640 1 -- 172.21.15.2:0/3487638293 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f739407a0e0 con 0x7f73a406f5a0 2024-09-10T08:47:49.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.210+0000 7f73aae00640 1 -- 172.21.15.2:0/3487638293 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f73a406f1c0 con 0x7f73a406f5a0 2024-09-10T08:47:49.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.212+0000 7f73a0c00640 1 -- 172.21.15.2:0/3487638293 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v4) ==== 90+0+0 (secure 0 0 0) 0x7f73940799e0 con 0x7f73a406f5a0 2024-09-10T08:47:49.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.215+0000 7f73aae00640 1 -- 172.21.15.2:0/3487638293 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f7380070240 msgr2=0x7f7380072700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:49.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.215+0000 7f73aae00640 1 --2- 172.21.15.2:0/3487638293 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f7380070240 0x7f7380072700 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f73a41512f0 tx=0x7f738c008040 comp rx=0 tx=0).stop 2024-09-10T08:47:49.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.215+0000 7f73aae00640 1 -- 172.21.15.2:0/3487638293 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73a406f5a0 msgr2=0x7f73a41ef490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:49.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.215+0000 7f73aae00640 1 --2- 172.21.15.2:0/3487638293 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73a406f5a0 0x7f73a41ef490 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f739402a180 tx=0x7f73940046c0 comp rx=0 tx=0).stop 2024-09-10T08:47:49.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.215+0000 7f73aae00640 1 -- 172.21.15.2:0/3487638293 shutdown_connections 2024-09-10T08:47:49.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.215+0000 7f73aae00640 1 --2- 172.21.15.2:0/3487638293 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73a415b4c0 0x7f73a409aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:49.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.215+0000 7f73aae00640 1 --2- 172.21.15.2:0/3487638293 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f7380070240 0x7f7380072700 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:49.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.215+0000 7f73aae00640 1 --2- 172.21.15.2:0/3487638293 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f73a40af590 0x7f73a409a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:49.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.215+0000 7f73aae00640 1 --2- 172.21.15.2:0/3487638293 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f73a406f5a0 0x7f73a41ef490 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:49.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.215+0000 7f73aae00640 1 -- 172.21.15.2:0/3487638293 >> 172.21.15.2:0/3487638293 conn(0x7f73a40d02c0 msgr2=0x7f73a40cf0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:49.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.216+0000 7f73aae00640 1 -- 172.21.15.2:0/3487638293 shutdown_connections 2024-09-10T08:47:49.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.216+0000 7f73aae00640 1 -- 172.21.15.2:0/3487638293 wait complete. 2024-09-10T08:47:49.232 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-09-10T08:47:49.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.390+0000 7fb087600640 1 Processor -- start 2024-09-10T08:47:49.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.390+0000 7fb087600640 1 -- start start 2024-09-10T08:47:49.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.391+0000 7fb087600640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb08006f770 0x7fb0800cf6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:49.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.391+0000 7fb087600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0800af590 0x7fb0800ae150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:49.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.391+0000 7fb087600640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0800ad390 con 0x7fb08015b4c0 2024-09-10T08:47:49.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.391+0000 7fb087600640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fb0800afa00 con 0x7fb08006f770 2024-09-10T08:47:49.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.391+0000 7fb087600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb0800d1130 con 0x7fb0800af590 2024-09-10T08:47:49.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.391+0000 7fb084c00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fb08015b4c0 0x7fb08006f060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:51970/0 (socket says 172.21.15.2:51970) 2024-09-10T08:47:49.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.391+0000 7fb084c00640 1 -- 172.21.15.2:0/345269373 learned_addr learned my addr 172.21.15.2:0/345269373 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:47:49.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.391+0000 7fb07fe00640 1 -- 172.21.15.2:0/345269373 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 306318122 0 0) 0x7fb0800ad390 con 0x7fb08015b4c0 2024-09-10T08:47:49.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.392+0000 7fb07fe00640 1 -- 172.21.15.2:0/345269373 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb064005730 con 0x7fb08015b4c0 2024-09-10T08:47:49.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.392+0000 7fb085600640 1 --2- 172.21.15.2:0/345269373 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0800af590 0x7fb0800ae150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:49.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.392+0000 7fb077e00640 1 --2- 172.21.15.2:0/345269373 >> v2:172.21.15.155:3300/0 conn(0x7fb08006f770 0x7fb0800cf6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:49.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.392+0000 7fb07fe00640 1 -- 172.21.15.2:0/345269373 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3212205980 0 0) 0x7fb064005730 con 0x7fb08015b4c0 2024-09-10T08:47:49.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.392+0000 7fb07fe00640 1 -- 172.21.15.2:0/345269373 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0800af590 msgr2=0x7fb0800ae150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:49.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.392+0000 7fb07fe00640 1 --2- 172.21.15.2:0/345269373 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0800af590 0x7fb0800ae150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:49.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.392+0000 7fb07fe00640 1 -- 172.21.15.2:0/345269373 >> v2:172.21.15.155:3300/0 conn(0x7fb08006f770 msgr2=0x7fb0800cf6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:49.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.392+0000 7fb07fe00640 1 --2- 172.21.15.2:0/345269373 >> v2:172.21.15.155:3300/0 conn(0x7fb08006f770 0x7fb0800cf6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:49.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.392+0000 7fb07fe00640 1 -- 172.21.15.2:0/345269373 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0800ad670 con 0x7fb08015b4c0 2024-09-10T08:47:49.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.392+0000 7fb07fe00640 1 -- 172.21.15.2:0/345269373 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2345211856 0 0) 0x7fb070001670 con 0x7fb08015b4c0 2024-09-10T08:47:49.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.392+0000 7fb07fe00640 1 -- 172.21.15.2:0/345269373 >> v1:172.21.15.2:6789/0 conn(0x7fb08015b4c0 legacy=0x7fb08006f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:49.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.392+0000 7fb07fe00640 1 --2- 172.21.15.2:0/345269373 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb064005bc0 0x7fb064005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:49.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.392+0000 7fb07fe00640 1 --2- 172.21.15.2:0/345269373 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0800af590 0x7fb064006a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:49.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.392+0000 7fb07fe00640 1 --2- 172.21.15.2:0/345269373 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb064006f50 0x7fb0640073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:49.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.392+0000 7fb07fe00640 1 -- 172.21.15.2:0/345269373 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb0800afa00 con 0x7fb064006f50 2024-09-10T08:47:49.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.392+0000 7fb07fe00640 1 -- 172.21.15.2:0/345269373 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb06400dbd0 con 0x7fb064005bc0 2024-09-10T08:47:49.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.392+0000 7fb07fe00640 1 -- 172.21.15.2:0/345269373 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb06400dd50 con 0x7fb0800af590 2024-09-10T08:47:49.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.392+0000 7fb084c00640 1 --2- 172.21.15.2:0/345269373 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb064005bc0 0x7fb064005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:49.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.393+0000 7fb085600640 1 --2- 172.21.15.2:0/345269373 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb064006f50 0x7fb0640073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:49.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.393+0000 7fb077e00640 1 --2- 172.21.15.2:0/345269373 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0800af590 0x7fb064006a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:49.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.393+0000 7fb085600640 1 -- 172.21.15.2:0/345269373 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0800af590 msgr2=0x7fb064006a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:49.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.393+0000 7fb085600640 1 --2- 172.21.15.2:0/345269373 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb0800af590 0x7fb064006a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:49.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.393+0000 7fb085600640 1 -- 172.21.15.2:0/345269373 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb064005bc0 msgr2=0x7fb064005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:49.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.393+0000 7fb085600640 1 --2- 172.21.15.2:0/345269373 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb064005bc0 0x7fb064005fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:49.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.393+0000 7fb085600640 1 -- 172.21.15.2:0/345269373 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb064005730 con 0x7fb064006f50 2024-09-10T08:47:49.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.394+0000 7fb085600640 1 --2- 172.21.15.2:0/345269373 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb064006f50 0x7fb0640073d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb078009fc0 tx=0x7fb064007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f06cdab53378dbc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:49.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.394+0000 7fb07fe00640 1 -- 172.21.15.2:0/345269373 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb078009c10 con 0x7fb064006f50 2024-09-10T08:47:49.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.394+0000 7fb07fe00640 1 -- 172.21.15.2:0/345269373 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb078036070 con 0x7fb064006f50 2024-09-10T08:47:49.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.394+0000 7fb07fe00640 1 -- 172.21.15.2:0/345269373 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb078031880 con 0x7fb064006f50 2024-09-10T08:47:49.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.395+0000 7fb087600640 1 -- 172.21.15.2:0/345269373 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb064006f50 msgr2=0x7fb0640073d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:49.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.395+0000 7fb087600640 1 --2- 172.21.15.2:0/345269373 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb064006f50 0x7fb0640073d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb078009fc0 tx=0x7fb064007a40 comp rx=0 tx=0).stop 2024-09-10T08:47:49.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.395+0000 7fb085600640 1 -- 172.21.15.2:0/345269373 reap_dead start 2024-09-10T08:47:49.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.395+0000 7fb087600640 1 -- 172.21.15.2:0/345269373 shutdown_connections 2024-09-10T08:47:49.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.395+0000 7fb087600640 1 -- 172.21.15.2:0/345269373 >> 172.21.15.2:0/345269373 conn(0x7fb0800d02c0 msgr2=0x7fb0800d06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:49.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.395+0000 7fb087600640 1 -- 172.21.15.2:0/345269373 shutdown_connections 2024-09-10T08:47:49.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.395+0000 7fb087600640 1 -- 172.21.15.2:0/345269373 wait complete. 2024-09-10T08:47:49.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.397+0000 7fb087600640 1 Processor -- start 2024-09-10T08:47:49.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.397+0000 7fb087600640 1 -- start start 2024-09-10T08:47:49.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.398+0000 7fb087600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb064006f50 0x7fb080148770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:49.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.398+0000 7fb087600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb080152fc0 0x7fb08015e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:49.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.398+0000 7fb087600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb080153440 0x7fb08015e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:49.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.398+0000 7fb087600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb0800adc30 con 0x7fb064006f50 2024-09-10T08:47:49.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.398+0000 7fb087600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb0800ad140 con 0x7fb080152fc0 2024-09-10T08:47:49.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.398+0000 7fb087600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb080071ef0 con 0x7fb080153440 2024-09-10T08:47:49.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.398+0000 7fb084c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb064006f50 0x7fb080148770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:49.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.398+0000 7fb084c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb064006f50 0x7fb080148770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35688/0 (socket says 172.21.15.2:35688) 2024-09-10T08:47:49.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.398+0000 7fb084c00640 1 -- 172.21.15.2:0/587742417 learned_addr learned my addr 172.21.15.2:0/587742417 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:49.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.398+0000 7fb077e00640 1 --2- 172.21.15.2:0/587742417 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb080152fc0 0x7fb08015e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:49.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.398+0000 7fb085600640 1 --2- 172.21.15.2:0/587742417 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb080153440 0x7fb08015e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:49.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.398+0000 7fb084c00640 1 -- 172.21.15.2:0/587742417 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb080153440 msgr2=0x7fb08015e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:49.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.398+0000 7fb084c00640 1 --2- 172.21.15.2:0/587742417 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb080153440 0x7fb08015e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:49.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.398+0000 7fb084c00640 1 -- 172.21.15.2:0/587742417 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb080152fc0 msgr2=0x7fb08015e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:49.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.398+0000 7fb084c00640 1 --2- 172.21.15.2:0/587742417 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb080152fc0 0x7fb08015e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:49.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.398+0000 7fb084c00640 1 -- 172.21.15.2:0/587742417 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb080153a10 con 0x7fb064006f50 2024-09-10T08:47:49.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.398+0000 7fb085600640 1 --2- 172.21.15.2:0/587742417 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb080153440 0x7fb08015e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:47:49.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.399+0000 7fb084c00640 1 --2- 172.21.15.2:0/587742417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb064006f50 0x7fb080148770 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb070007310 tx=0x7fb0700077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:49.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.399+0000 7fb07d600640 1 -- 172.21.15.2:0/587742417 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb07000f9c0 con 0x7fb064006f50 2024-09-10T08:47:49.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.399+0000 7fb07d600640 1 -- 172.21.15.2:0/587742417 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb070018070 con 0x7fb064006f50 2024-09-10T08:47:49.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.399+0000 7fb07d600640 1 -- 172.21.15.2:0/587742417 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb07000fda0 con 0x7fb064006f50 2024-09-10T08:47:49.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.399+0000 7fb087600640 1 -- 172.21.15.2:0/587742417 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb080153cf0 con 0x7fb064006f50 2024-09-10T08:47:49.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.399+0000 7fb087600640 1 -- 172.21.15.2:0/587742417 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0801542b0 con 0x7fb064006f50 2024-09-10T08:47:49.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.400+0000 7fb087600640 1 -- 172.21.15.2:0/587742417 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb08015b8a0 con 0x7fb064006f50 2024-09-10T08:47:49.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.401+0000 7fb07d600640 1 -- 172.21.15.2:0/587742417 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb07001d460 con 0x7fb064006f50 2024-09-10T08:47:49.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.402+0000 7fb07d600640 1 --2- 172.21.15.2:0/587742417 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fb05c06be60 0x7fb05c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:49.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.402+0000 7fb07d600640 1 -- 172.21.15.2:0/587742417 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7fb07008ae40 con 0x7fb064006f50 2024-09-10T08:47:49.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.403+0000 7fb077e00640 1 --2- 172.21.15.2:0/587742417 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fb05c06be60 0x7fb05c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:49.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.403+0000 7fb077e00640 1 --2- 172.21.15.2:0/587742417 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fb05c06be60 0x7fb05c06e320 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb0800cefb0 tx=0x7fb068008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:49.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.406+0000 7fb07d600640 1 -- 172.21.15.2:0/587742417 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb0700599a0 con 0x7fb064006f50 2024-09-10T08:47:49.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.658+0000 7fb087600640 1 -- 172.21.15.2:0/587742417 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7fb080159880 con 0x7fb064006f50 2024-09-10T08:47:49.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.661+0000 7fb07d600640 1 -- 172.21.15.2:0/587742417 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v5) ==== 90+0+0 (secure 0 0 0) 0x7fb0700592a0 con 0x7fb064006f50 2024-09-10T08:47:49.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.663+0000 7fb087600640 1 -- 172.21.15.2:0/587742417 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fb05c06be60 msgr2=0x7fb05c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:49.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.663+0000 7fb087600640 1 --2- 172.21.15.2:0/587742417 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fb05c06be60 0x7fb05c06e320 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb0800cefb0 tx=0x7fb068008040 comp rx=0 tx=0).stop 2024-09-10T08:47:49.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.663+0000 7fb087600640 1 -- 172.21.15.2:0/587742417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb064006f50 msgr2=0x7fb080148770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:49.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.663+0000 7fb087600640 1 --2- 172.21.15.2:0/587742417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb064006f50 0x7fb080148770 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb070007310 tx=0x7fb0700077d0 comp rx=0 tx=0).stop 2024-09-10T08:47:49.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.663+0000 7fb087600640 1 -- 172.21.15.2:0/587742417 shutdown_connections 2024-09-10T08:47:49.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.663+0000 7fb087600640 1 --2- 172.21.15.2:0/587742417 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fb05c06be60 0x7fb05c06e320 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:49.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.663+0000 7fb087600640 1 --2- 172.21.15.2:0/587742417 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb080153440 0x7fb08015e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:49.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.663+0000 7fb087600640 1 --2- 172.21.15.2:0/587742417 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb080152fc0 0x7fb08015e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:49.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.663+0000 7fb087600640 1 --2- 172.21.15.2:0/587742417 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb064006f50 0x7fb080148770 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:49.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.663+0000 7fb087600640 1 -- 172.21.15.2:0/587742417 >> 172.21.15.2:0/587742417 conn(0x7fb0800d02c0 msgr2=0x7fb0800b0010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:49.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.663+0000 7fb087600640 1 -- 172.21.15.2:0/587742417 shutdown_connections 2024-09-10T08:47:49.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.663+0000 7fb087600640 1 -- 172.21.15.2:0/587742417 wait complete. 2024-09-10T08:47:49.678 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-09-10T08:47:49.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.841+0000 7f46c7200640 1 Processor -- start 2024-09-10T08:47:49.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.841+0000 7f46c7200640 1 -- start start 2024-09-10T08:47:49.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.842+0000 7f46c7200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46c815e500 0x7f46c80cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:49.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.842+0000 7f46c7200640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f46c80d0b50 0x7f46c80d0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:49.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.842+0000 7f46c7200640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46c80d0350 con 0x7f46c80d4d90 2024-09-10T08:47:49.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.842+0000 7f46c7200640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f46c815e8e0 con 0x7f46c80d0b50 2024-09-10T08:47:49.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.842+0000 7f46c7200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f46c80d2080 con 0x7f46c815e500 2024-09-10T08:47:49.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.843+0000 7f46c5e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46c815e500 0x7f46c80cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:49.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.843+0000 7f46c5e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46c815e500 0x7f46c80cefb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.2:34348/0 (socket says 172.21.15.2:34348) 2024-09-10T08:47:49.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.843+0000 7f46c5400640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f46c80d4d90 0x7f46c80d2e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.2:59398/0 (socket says 172.21.15.2:59398) 2024-09-10T08:47:49.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.843+0000 7f46c6800640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f46c80d0b50 0x7f46c80d0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:49.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.843+0000 7f46c5e00640 1 -- 172.21.15.2:0/2387657504 learned_addr learned my addr 172.21.15.2:0/2387657504 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:49.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.843+0000 7f46c5e00640 1 -- 172.21.15.2:0/2387657504 >> v2:172.21.15.155:3300/0 conn(0x7f46c80d0b50 msgr2=0x7f46c80d0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:49.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.843+0000 7f46c5e00640 1 --2- 172.21.15.2:0/2387657504 >> v2:172.21.15.155:3300/0 conn(0x7f46c80d0b50 0x7f46c80d0fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:49.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.843+0000 7f46c5e00640 1 -- 172.21.15.2:0/2387657504 >> v1:172.21.15.155:6789/0 conn(0x7f46c80d4d90 legacy=0x7f46c80d2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:49.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.843+0000 7f46c5e00640 1 -- 172.21.15.2:0/2387657504 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46c80d2360 con 0x7f46c815e500 2024-09-10T08:47:49.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.843+0000 7f46c4a00640 1 -- 172.21.15.2:0/2387657504 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3854116910 0 0) 0x7f46c80d0350 con 0x7f46c80d4d90 2024-09-10T08:47:49.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.844+0000 7f46c6800640 1 --2- 172.21.15.2:0/2387657504 >> v2:172.21.15.155:3300/0 conn(0x7f46c80d0b50 0x7f46c80d0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:47:49.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.845+0000 7f46c5e00640 1 --2- 172.21.15.2:0/2387657504 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46c815e500 0x7f46c80cefb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f46b8009870 tx=0x7f46b802a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff49ec309f3f312a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:49.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.845+0000 7f46c4a00640 1 -- 172.21.15.2:0/2387657504 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46b8037070 con 0x7f46c815e500 2024-09-10T08:47:49.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.845+0000 7f46c4a00640 1 -- 172.21.15.2:0/2387657504 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46b8032440 con 0x7f46c815e500 2024-09-10T08:47:49.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.845+0000 7f46c4a00640 1 -- 172.21.15.2:0/2387657504 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46b8032810 con 0x7f46c815e500 2024-09-10T08:47:49.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.846+0000 7f46c7200640 1 -- 172.21.15.2:0/2387657504 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46c815e500 msgr2=0x7f46c80cefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:49.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.846+0000 7f46c7200640 1 --2- 172.21.15.2:0/2387657504 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46c815e500 0x7f46c80cefb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f46b8009870 tx=0x7f46b802a250 comp rx=0 tx=0).stop 2024-09-10T08:47:49.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.846+0000 7f46c7200640 1 -- 172.21.15.2:0/2387657504 shutdown_connections 2024-09-10T08:47:49.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.846+0000 7f46c7200640 1 --2- 172.21.15.2:0/2387657504 >> v2:172.21.15.155:3300/0 conn(0x7f46c80d0b50 0x7f46c80d0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:49.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.846+0000 7f46c7200640 1 --2- 172.21.15.2:0/2387657504 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46c815e500 0x7f46c80cefb0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:49.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.846+0000 7f46c7200640 1 -- 172.21.15.2:0/2387657504 >> 172.21.15.2:0/2387657504 conn(0x7f46c809d720 msgr2=0x7f46c80d4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:49.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.846+0000 7f46c7200640 1 -- 172.21.15.2:0/2387657504 shutdown_connections 2024-09-10T08:47:49.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.846+0000 7f46c7200640 1 -- 172.21.15.2:0/2387657504 wait complete. 2024-09-10T08:47:49.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.847+0000 7f46c7200640 1 Processor -- start 2024-09-10T08:47:49.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.847+0000 7f46c7200640 1 -- start start 2024-09-10T08:47:49.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.848+0000 7f46c7200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46c80d0b50 0x7f46c815d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:49.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.848+0000 7f46c7200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46c80d4d90 0x7f46c81e8670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:49.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.848+0000 7f46c7200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46c815e500 0x7f46c80cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:49.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.848+0000 7f46c7200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f46c80cff90 con 0x7f46c815e500 2024-09-10T08:47:49.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.848+0000 7f46c7200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f46c80d2920 con 0x7f46c80d0b50 2024-09-10T08:47:49.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.848+0000 7f46c7200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f46c80d0110 con 0x7f46c80d4d90 2024-09-10T08:47:49.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.849+0000 7f46c6800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46c815e500 0x7f46c80cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:49.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.849+0000 7f46c6800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46c815e500 0x7f46c80cb4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35702/0 (socket says 172.21.15.2:35702) 2024-09-10T08:47:49.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.849+0000 7f46c6800640 1 -- 172.21.15.2:0/1587289797 learned_addr learned my addr 172.21.15.2:0/1587289797 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:49.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.849+0000 7f46c5400640 1 --2- 172.21.15.2:0/1587289797 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46c80d4d90 0x7f46c81e8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:49.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.849+0000 7f46c5e00640 1 --2- 172.21.15.2:0/1587289797 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46c80d0b50 0x7f46c815d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:49.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.849+0000 7f46c6800640 1 -- 172.21.15.2:0/1587289797 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46c80d4d90 msgr2=0x7f46c81e8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:49.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.849+0000 7f46c6800640 1 --2- 172.21.15.2:0/1587289797 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46c80d4d90 0x7f46c81e8670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:49.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.849+0000 7f46c6800640 1 -- 172.21.15.2:0/1587289797 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46c80d0b50 msgr2=0x7f46c815d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:49.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.849+0000 7f46c6800640 1 --2- 172.21.15.2:0/1587289797 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46c80d0b50 0x7f46c815d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:49.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.849+0000 7f46c6800640 1 -- 172.21.15.2:0/1587289797 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46c815da30 con 0x7f46c815e500 2024-09-10T08:47:49.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.849+0000 7f46c6800640 1 --2- 172.21.15.2:0/1587289797 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46c815e500 0x7f46c80cb4e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f46c000efc0 tx=0x7f46c000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:49.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.850+0000 7f46be000640 1 -- 172.21.15.2:0/1587289797 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c0018030 con 0x7f46c815e500 2024-09-10T08:47:49.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.850+0000 7f46be000640 1 -- 172.21.15.2:0/1587289797 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46c000cdf0 con 0x7f46c815e500 2024-09-10T08:47:49.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.850+0000 7f46be000640 1 -- 172.21.15.2:0/1587289797 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c0003bb0 con 0x7f46c815e500 2024-09-10T08:47:49.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.850+0000 7f46c7200640 1 -- 172.21.15.2:0/1587289797 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46c81e90c0 con 0x7f46c815e500 2024-09-10T08:47:49.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.850+0000 7f46c7200640 1 -- 172.21.15.2:0/1587289797 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46c815f600 con 0x7f46c815e500 2024-09-10T08:47:49.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.851+0000 7f46c7200640 1 -- 172.21.15.2:0/1587289797 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46c80cefb0 con 0x7f46c815e500 2024-09-10T08:47:49.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.852+0000 7f46be000640 1 -- 172.21.15.2:0/1587289797 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f46c001b070 con 0x7f46c815e500 2024-09-10T08:47:49.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.852+0000 7f46be000640 1 --2- 172.21.15.2:0/1587289797 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f46a806be30 0x7f46a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:49.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.853+0000 7f46be000640 1 -- 172.21.15.2:0/1587289797 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7f46c008b6f0 con 0x7f46c815e500 2024-09-10T08:47:49.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.853+0000 7f46c5e00640 1 --2- 172.21.15.2:0/1587289797 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f46a806be30 0x7f46a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:49.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.854+0000 7f46c5e00640 1 --2- 172.21.15.2:0/1587289797 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f46a806be30 0x7f46a806e2f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f46b8034000 tx=0x7f46b802e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:49.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:49.857+0000 7f46be000640 1 -- 172.21.15.2:0/1587289797 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f46c0010040 con 0x7f46c815e500 2024-09-10T08:47:50.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.109+0000 7f46c7200640 1 -- 172.21.15.2:0/1587289797 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f46c80d1a20 con 0x7f46c815e500 2024-09-10T08:47:50.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.112+0000 7f46be000640 1 -- 172.21.15.2:0/1587289797 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v6) ==== 90+0+0 (secure 0 0 0) 0x7f46c005a250 con 0x7f46c815e500 2024-09-10T08:47:50.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.114+0000 7f46c7200640 1 -- 172.21.15.2:0/1587289797 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f46a806be30 msgr2=0x7f46a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:50.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.114+0000 7f46c7200640 1 --2- 172.21.15.2:0/1587289797 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f46a806be30 0x7f46a806e2f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f46b8034000 tx=0x7f46b802e000 comp rx=0 tx=0).stop 2024-09-10T08:47:50.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.114+0000 7f46c7200640 1 -- 172.21.15.2:0/1587289797 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46c815e500 msgr2=0x7f46c80cb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:50.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.114+0000 7f46c7200640 1 --2- 172.21.15.2:0/1587289797 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46c815e500 0x7f46c80cb4e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f46c000efc0 tx=0x7f46c000c490 comp rx=0 tx=0).stop 2024-09-10T08:47:50.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.114+0000 7f46c7200640 1 -- 172.21.15.2:0/1587289797 shutdown_connections 2024-09-10T08:47:50.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.114+0000 7f46c7200640 1 --2- 172.21.15.2:0/1587289797 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46c815e500 0x7f46c80cb4e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:50.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.114+0000 7f46c7200640 1 --2- 172.21.15.2:0/1587289797 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f46a806be30 0x7f46a806e2f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:50.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.114+0000 7f46c7200640 1 --2- 172.21.15.2:0/1587289797 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f46c80d4d90 0x7f46c81e8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:50.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.114+0000 7f46c7200640 1 --2- 172.21.15.2:0/1587289797 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46c80d0b50 0x7f46c815d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:50.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.114+0000 7f46c7200640 1 -- 172.21.15.2:0/1587289797 >> 172.21.15.2:0/1587289797 conn(0x7f46c809d720 msgr2=0x7f46c80b8e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:50.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.114+0000 7f46c7200640 1 -- 172.21.15.2:0/1587289797 shutdown_connections 2024-09-10T08:47:50.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.114+0000 7f46c7200640 1 -- 172.21.15.2:0/1587289797 wait complete. 2024-09-10T08:47:50.133 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-09-10T08:47:50.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.290+0000 7f3400000640 1 Processor -- start 2024-09-10T08:47:50.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.290+0000 7f3400000640 1 -- start start 2024-09-10T08:47:50.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.291+0000 7f3400000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33f815b4c0 0x7f33f80cf6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:50.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.291+0000 7f3400000640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f33f80af590 0x7f33f806f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:50.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.291+0000 7f3400000640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33f80af160 con 0x7f33f806f5a0 2024-09-10T08:47:50.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.291+0000 7f3400000640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f33f80d1130 con 0x7f33f80af590 2024-09-10T08:47:50.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.291+0000 7f3400000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f33f80ad140 con 0x7f33f815b4c0 2024-09-10T08:47:50.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.291+0000 7f33fe000640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f33f806f5a0 0x7f33f80ce5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:51982/0 (socket says 172.21.15.2:51982) 2024-09-10T08:47:50.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.291+0000 7f33fe000640 1 -- 172.21.15.2:0/3255404086 learned_addr learned my addr 172.21.15.2:0/3255404086 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:47:50.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.291+0000 7f33fcc00640 1 --2- 172.21.15.2:0/3255404086 >> v2:172.21.15.155:3300/0 conn(0x7f33f80af590 0x7f33f806f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:50.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.291+0000 7f33fd600640 1 --2- 172.21.15.2:0/3255404086 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33f815b4c0 0x7f33f80cf6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:50.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.292+0000 7f33f7e00640 1 -- 172.21.15.2:0/3255404086 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2799357216 0 0) 0x7f33f80af160 con 0x7f33f806f5a0 2024-09-10T08:47:50.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.292+0000 7f33f7e00640 1 -- 172.21.15.2:0/3255404086 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f33e0005730 con 0x7f33f806f5a0 2024-09-10T08:47:50.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.292+0000 7f33f7e00640 1 -- 172.21.15.2:0/3255404086 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1784032596 0 0) 0x7f33e0005730 con 0x7f33f806f5a0 2024-09-10T08:47:50.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.292+0000 7f33fcc00640 1 -- 172.21.15.2:0/3255404086 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33f815b4c0 msgr2=0x7f33f80cf6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:50.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.292+0000 7f33fcc00640 1 --2- 172.21.15.2:0/3255404086 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33f815b4c0 0x7f33f80cf6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:50.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.292+0000 7f33fcc00640 1 -- 172.21.15.2:0/3255404086 >> v1:172.21.15.2:6789/0 conn(0x7f33f806f5a0 legacy=0x7f33f80ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:50.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.292+0000 7f33fcc00640 1 -- 172.21.15.2:0/3255404086 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33f80ad390 con 0x7f33f80af590 2024-09-10T08:47:50.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.292+0000 7f33fd600640 1 --2- 172.21.15.2:0/3255404086 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33f815b4c0 0x7f33f80cf6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:47:50.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.293+0000 7f33fcc00640 1 --2- 172.21.15.2:0/3255404086 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33f80af590 0x7f33f806f060 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f33e40097a0 tx=0x7f33e402a080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd79d3ab9c8b0344 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:50.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.293+0000 7f33f7e00640 1 -- 172.21.15.2:0/3255404086 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e4037070 con 0x7f33f80af590 2024-09-10T08:47:50.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.293+0000 7f33f7e00640 1 -- 172.21.15.2:0/3255404086 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33e402ab10 con 0x7f33f80af590 2024-09-10T08:47:50.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.293+0000 7f33f7e00640 1 -- 172.21.15.2:0/3255404086 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f00019f0 con 0x7f33f80af590 2024-09-10T08:47:50.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.294+0000 7f3400000640 1 -- 172.21.15.2:0/3255404086 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33f80af590 msgr2=0x7f33f806f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:50.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.294+0000 7f3400000640 1 --2- 172.21.15.2:0/3255404086 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33f80af590 0x7f33f806f060 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f33e40097a0 tx=0x7f33e402a080 comp rx=0 tx=0).stop 2024-09-10T08:47:50.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.294+0000 7f3400000640 1 -- 172.21.15.2:0/3255404086 shutdown_connections 2024-09-10T08:47:50.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.294+0000 7f3400000640 1 --2- 172.21.15.2:0/3255404086 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33f80af590 0x7f33f806f060 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:50.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.294+0000 7f3400000640 1 --2- 172.21.15.2:0/3255404086 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33f815b4c0 0x7f33f80cf6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:50.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.294+0000 7f3400000640 1 -- 172.21.15.2:0/3255404086 >> 172.21.15.2:0/3255404086 conn(0x7f33f80d02c0 msgr2=0x7f33f80d06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:50.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.294+0000 7f3400000640 1 -- 172.21.15.2:0/3255404086 shutdown_connections 2024-09-10T08:47:50.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.294+0000 7f3400000640 1 -- 172.21.15.2:0/3255404086 wait complete. 2024-09-10T08:47:50.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.296+0000 7f3400000640 1 Processor -- start 2024-09-10T08:47:50.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.296+0000 7f3400000640 1 -- start start 2024-09-10T08:47:50.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.297+0000 7f3400000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33f806f5a0 0x7f33f815e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:50.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.297+0000 7f3400000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33f80af590 0x7f33f815b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:50.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.297+0000 7f3400000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33f815b4c0 0x7f33f8147860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:50.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.297+0000 7f3400000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f33f80ad950 con 0x7f33f806f5a0 2024-09-10T08:47:50.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.297+0000 7f3400000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f33f80af9d0 con 0x7f33f815b4c0 2024-09-10T08:47:50.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.297+0000 7f3400000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f33f80adc30 con 0x7f33f80af590 2024-09-10T08:47:50.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.297+0000 7f33fd600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33f806f5a0 0x7f33f815e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:50.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.297+0000 7f33fd600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33f806f5a0 0x7f33f815e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35712/0 (socket says 172.21.15.2:35712) 2024-09-10T08:47:50.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.297+0000 7f33fd600640 1 -- 172.21.15.2:0/4172513118 learned_addr learned my addr 172.21.15.2:0/4172513118 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:50.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.297+0000 7f33fe000640 1 --2- 172.21.15.2:0/4172513118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33f815b4c0 0x7f33f8147860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:50.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.297+0000 7f33fcc00640 1 --2- 172.21.15.2:0/4172513118 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33f80af590 0x7f33f815b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:50.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.297+0000 7f33fd600640 1 -- 172.21.15.2:0/4172513118 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33f80af590 msgr2=0x7f33f815b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:50.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.297+0000 7f33fd600640 1 --2- 172.21.15.2:0/4172513118 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33f80af590 0x7f33f815b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:50.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.297+0000 7f33fd600640 1 -- 172.21.15.2:0/4172513118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33f815b4c0 msgr2=0x7f33f8147860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:50.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.297+0000 7f33fd600640 1 --2- 172.21.15.2:0/4172513118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33f815b4c0 0x7f33f8147860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:50.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.297+0000 7f33fd600640 1 -- 172.21.15.2:0/4172513118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33f8153a10 con 0x7f33f806f5a0 2024-09-10T08:47:50.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.297+0000 7f33fcc00640 1 --2- 172.21.15.2:0/4172513118 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33f80af590 0x7f33f815b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:47:50.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.298+0000 7f33fd600640 1 --2- 172.21.15.2:0/4172513118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33f806f5a0 0x7f33f815e740 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f33ec00e990 tx=0x7f33ec00ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:50.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.298+0000 7f33f5600640 1 -- 172.21.15.2:0/4172513118 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33ec017070 con 0x7f33f806f5a0 2024-09-10T08:47:50.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.298+0000 7f33f5600640 1 -- 172.21.15.2:0/4172513118 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33ec00c980 con 0x7f33f806f5a0 2024-09-10T08:47:50.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.298+0000 7f33f5600640 1 -- 172.21.15.2:0/4172513118 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33ec00cd50 con 0x7f33f806f5a0 2024-09-10T08:47:50.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.298+0000 7f3400000640 1 -- 172.21.15.2:0/4172513118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33f8153450 con 0x7f33f806f5a0 2024-09-10T08:47:50.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.298+0000 7f3400000640 1 -- 172.21.15.2:0/4172513118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33f815df40 con 0x7f33f806f5a0 2024-09-10T08:47:50.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.299+0000 7f3400000640 1 -- 172.21.15.2:0/4172513118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33f8071ef0 con 0x7f33f806f5a0 2024-09-10T08:47:50.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.300+0000 7f33f5600640 1 -- 172.21.15.2:0/4172513118 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f33ec01a070 con 0x7f33f806f5a0 2024-09-10T08:47:50.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.301+0000 7f33f5600640 1 --2- 172.21.15.2:0/4172513118 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f33d806be30 0x7f33d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:50.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.301+0000 7f33f5600640 1 -- 172.21.15.2:0/4172513118 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7f33ec08abb0 con 0x7f33f806f5a0 2024-09-10T08:47:50.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.301+0000 7f33fcc00640 1 --2- 172.21.15.2:0/4172513118 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f33d806be30 0x7f33d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:50.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.302+0000 7f33fcc00640 1 --2- 172.21.15.2:0/4172513118 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f33d806be30 0x7f33d806e2f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f33e4034000 tx=0x7f33e402e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:50.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.305+0000 7f33f5600640 1 -- 172.21.15.2:0/4172513118 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f33ec059680 con 0x7f33f806f5a0 2024-09-10T08:47:50.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.559+0000 7f3400000640 1 -- 172.21.15.2:0/4172513118 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f33f806ced0 con 0x7f33f806f5a0 2024-09-10T08:47:50.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.561+0000 7f33f5600640 1 -- 172.21.15.2:0/4172513118 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v7) ==== 97+0+0 (secure 0 0 0) 0x7f33ec058f80 con 0x7f33f806f5a0 2024-09-10T08:47:50.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.563+0000 7f3400000640 1 -- 172.21.15.2:0/4172513118 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f33d806be30 msgr2=0x7f33d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:50.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.563+0000 7f3400000640 1 --2- 172.21.15.2:0/4172513118 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f33d806be30 0x7f33d806e2f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f33e4034000 tx=0x7f33e402e000 comp rx=0 tx=0).stop 2024-09-10T08:47:50.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.563+0000 7f3400000640 1 -- 172.21.15.2:0/4172513118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33f806f5a0 msgr2=0x7f33f815e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:50.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.563+0000 7f3400000640 1 --2- 172.21.15.2:0/4172513118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33f806f5a0 0x7f33f815e740 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f33ec00e990 tx=0x7f33ec00ee50 comp rx=0 tx=0).stop 2024-09-10T08:47:50.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.563+0000 7f3400000640 1 -- 172.21.15.2:0/4172513118 shutdown_connections 2024-09-10T08:47:50.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.563+0000 7f3400000640 1 --2- 172.21.15.2:0/4172513118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33f815b4c0 0x7f33f8147860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:50.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.563+0000 7f3400000640 1 --2- 172.21.15.2:0/4172513118 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f33d806be30 0x7f33d806e2f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:50.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.563+0000 7f3400000640 1 --2- 172.21.15.2:0/4172513118 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33f80af590 0x7f33f815b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:50.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.563+0000 7f3400000640 1 --2- 172.21.15.2:0/4172513118 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f33f806f5a0 0x7f33f815e740 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:50.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.563+0000 7f3400000640 1 -- 172.21.15.2:0/4172513118 >> 172.21.15.2:0/4172513118 conn(0x7f33f80d02c0 msgr2=0x7f33f80ce7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:50.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.563+0000 7f3400000640 1 -- 172.21.15.2:0/4172513118 shutdown_connections 2024-09-10T08:47:50.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.563+0000 7f3400000640 1 -- 172.21.15.2:0/4172513118 wait complete. 2024-09-10T08:47:50.579 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-09-10T08:47:50.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.735+0000 7f2441800640 1 Processor -- start 2024-09-10T08:47:50.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.735+0000 7f2441800640 1 -- start start 2024-09-10T08:47:50.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.736+0000 7f2441800640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f243c06dd80 0x7f243c0d05f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:50.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.736+0000 7f2441800640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f243c0cf550 con 0x7f243c15eaa0 2024-09-10T08:47:50.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.736+0000 7f2441800640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f243c0cf830 con 0x7f243c15e6c0 2024-09-10T08:47:50.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.736+0000 7f2441800640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f243c0cf2f0 con 0x7f243c06dd80 2024-09-10T08:47:50.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.736+0000 7f243a000640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f243c15eaa0 0x7f243c06d670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:51998/0 (socket says 172.21.15.2:51998) 2024-09-10T08:47:50.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.736+0000 7f243a000640 1 -- 172.21.15.2:0/3121424903 learned_addr learned my addr 172.21.15.2:0/3121424903 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:47:50.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.737+0000 7f243b400640 1 --2- 172.21.15.2:0/3121424903 >> v2:172.21.15.155:3300/0 conn(0x7f243c06dd80 0x7f243c0d05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:50.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.737+0000 7f2439600640 1 -- 172.21.15.2:0/3121424903 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1374122939 0 0) 0x7f243c0cf550 con 0x7f243c15eaa0 2024-09-10T08:47:50.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.737+0000 7f2439600640 1 -- 172.21.15.2:0/3121424903 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2420003520 con 0x7f243c15eaa0 2024-09-10T08:47:50.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.737+0000 7f2439600640 1 -- 172.21.15.2:0/3121424903 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3450443635 0 0) 0x7f243c0cf830 con 0x7f243c15e6c0 2024-09-10T08:47:50.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.737+0000 7f2439600640 1 -- 172.21.15.2:0/3121424903 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f243c0cf550 con 0x7f243c15e6c0 2024-09-10T08:47:50.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.737+0000 7f243b400640 1 -- 172.21.15.2:0/3121424903 >> v1:172.21.15.155:6789/0 conn(0x7f243c15e6c0 legacy=0x7f243c0d4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:50.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.737+0000 7f243b400640 1 -- 172.21.15.2:0/3121424903 >> v1:172.21.15.2:6789/0 conn(0x7f243c15eaa0 legacy=0x7f243c06d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:50.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.737+0000 7f243b400640 1 -- 172.21.15.2:0/3121424903 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f243c0cfb10 con 0x7f243c06dd80 2024-09-10T08:47:50.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.738+0000 7f243b400640 1 --2- 172.21.15.2:0/3121424903 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f243c06dd80 0x7f243c0d05f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2434009dc0 tx=0x7f243402a730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=458a75417407b75d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:50.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.739+0000 7f2439600640 1 -- 172.21.15.2:0/3121424903 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2434007740 con 0x7f243c06dd80 2024-09-10T08:47:50.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.739+0000 7f2439600640 1 -- 172.21.15.2:0/3121424903 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24340078e0 con 0x7f243c06dd80 2024-09-10T08:47:50.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.739+0000 7f2439600640 1 -- 172.21.15.2:0/3121424903 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2434007cb0 con 0x7f243c06dd80 2024-09-10T08:47:50.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.739+0000 7f2441800640 1 -- 172.21.15.2:0/3121424903 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f243c06dd80 msgr2=0x7f243c0d05f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:50.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.739+0000 7f2441800640 1 --2- 172.21.15.2:0/3121424903 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f243c06dd80 0x7f243c0d05f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2434009dc0 tx=0x7f243402a730 comp rx=0 tx=0).stop 2024-09-10T08:47:50.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.739+0000 7f2441800640 1 -- 172.21.15.2:0/3121424903 shutdown_connections 2024-09-10T08:47:50.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.739+0000 7f2441800640 1 --2- 172.21.15.2:0/3121424903 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f243c06dd80 0x7f243c0d05f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:50.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.739+0000 7f2441800640 1 -- 172.21.15.2:0/3121424903 >> 172.21.15.2:0/3121424903 conn(0x7f243c08bfd0 msgr2=0x7f243c0d4540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:50.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.739+0000 7f2441800640 1 -- 172.21.15.2:0/3121424903 shutdown_connections 2024-09-10T08:47:50.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.739+0000 7f2441800640 1 -- 172.21.15.2:0/3121424903 wait complete. 2024-09-10T08:47:50.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.741+0000 7f2441800640 1 Processor -- start 2024-09-10T08:47:50.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.741+0000 7f2441800640 1 -- start start 2024-09-10T08:47:50.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.742+0000 7f2441800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f243c06dd80 0x7f243c1587d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:50.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.742+0000 7f2441800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f243c15e6c0 0x7f243c1f47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:50.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.742+0000 7f2441800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f243c15eaa0 0x7f243c0b9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:50.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.742+0000 7f2441800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f243c06cfc0 con 0x7f243c15eaa0 2024-09-10T08:47:50.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.742+0000 7f2441800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f243c0d00d0 con 0x7f243c06dd80 2024-09-10T08:47:50.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.742+0000 7f2441800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f243c06d140 con 0x7f243c15e6c0 2024-09-10T08:47:50.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.742+0000 7f243b400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f243c15eaa0 0x7f243c0b9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:50.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.742+0000 7f243b400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f243c15eaa0 0x7f243c0b9c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35728/0 (socket says 172.21.15.2:35728) 2024-09-10T08:47:50.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.742+0000 7f243b400640 1 -- 172.21.15.2:0/3503592989 learned_addr learned my addr 172.21.15.2:0/3503592989 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:50.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.742+0000 7f243aa00640 1 --2- 172.21.15.2:0/3503592989 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f243c06dd80 0x7f243c1587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:50.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.742+0000 7f243a000640 1 --2- 172.21.15.2:0/3503592989 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f243c15e6c0 0x7f243c1f47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:50.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.743+0000 7f243b400640 1 -- 172.21.15.2:0/3503592989 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f243c15e6c0 msgr2=0x7f243c1f47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:50.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.743+0000 7f243b400640 1 --2- 172.21.15.2:0/3503592989 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f243c15e6c0 0x7f243c1f47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:50.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.743+0000 7f243b400640 1 -- 172.21.15.2:0/3503592989 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f243c06dd80 msgr2=0x7f243c1587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:50.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.743+0000 7f243b400640 1 --2- 172.21.15.2:0/3503592989 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f243c06dd80 0x7f243c1587d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:50.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.743+0000 7f243b400640 1 -- 172.21.15.2:0/3503592989 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f243c0b8a30 con 0x7f243c15eaa0 2024-09-10T08:47:50.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.743+0000 7f243b400640 1 --2- 172.21.15.2:0/3503592989 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f243c15eaa0 0x7f243c0b9c80 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2434009ee0 tx=0x7f2434004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:50.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.743+0000 7f2432a00640 1 -- 172.21.15.2:0/3503592989 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f243403f070 con 0x7f243c15eaa0 2024-09-10T08:47:50.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.743+0000 7f2432a00640 1 -- 172.21.15.2:0/3503592989 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2434031bc0 con 0x7f243c15eaa0 2024-09-10T08:47:50.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.743+0000 7f2432a00640 1 -- 172.21.15.2:0/3503592989 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2434009450 con 0x7f243c15eaa0 2024-09-10T08:47:50.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.743+0000 7f2441800640 1 -- 172.21.15.2:0/3503592989 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f243c0b8cd0 con 0x7f243c15eaa0 2024-09-10T08:47:50.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.743+0000 7f2441800640 1 -- 172.21.15.2:0/3503592989 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f243c0cbe50 con 0x7f243c15eaa0 2024-09-10T08:47:50.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.744+0000 7f2441800640 1 -- 172.21.15.2:0/3503592989 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f243c0d1c30 con 0x7f243c15eaa0 2024-09-10T08:47:50.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.745+0000 7f2432a00640 1 -- 172.21.15.2:0/3503592989 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f243403b410 con 0x7f243c15eaa0 2024-09-10T08:47:50.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.746+0000 7f2432a00640 1 --2- 172.21.15.2:0/3503592989 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f241c06be30 0x7f241c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:50.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.746+0000 7f2432a00640 1 -- 172.21.15.2:0/3503592989 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7f24340ac210 con 0x7f243c15eaa0 2024-09-10T08:47:50.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.747+0000 7f243aa00640 1 --2- 172.21.15.2:0/3503592989 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f241c06be30 0x7f241c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:50.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.747+0000 7f243aa00640 1 --2- 172.21.15.2:0/3503592989 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f241c06be30 0x7f241c06e2f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f242c007fd0 tx=0x7f242c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:50.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:50.750+0000 7f2432a00640 1 -- 172.21.15.2:0/3503592989 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f243407a720 con 0x7f243c15eaa0 2024-09-10T08:47:51.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.000+0000 7f2441800640 1 -- 172.21.15.2:0/3503592989 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f243c0b5c70 con 0x7f243c15eaa0 2024-09-10T08:47:51.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.002+0000 7f2432a00640 1 -- 172.21.15.2:0/3503592989 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7f243407ea20 con 0x7f243c15eaa0 2024-09-10T08:47:51.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.004+0000 7f2441800640 1 -- 172.21.15.2:0/3503592989 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f241c06be30 msgr2=0x7f241c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:51.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.004+0000 7f2441800640 1 --2- 172.21.15.2:0/3503592989 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f241c06be30 0x7f241c06e2f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f242c007fd0 tx=0x7f242c009040 comp rx=0 tx=0).stop 2024-09-10T08:47:51.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.004+0000 7f2441800640 1 -- 172.21.15.2:0/3503592989 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f243c15eaa0 msgr2=0x7f243c0b9c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:51.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.004+0000 7f2441800640 1 --2- 172.21.15.2:0/3503592989 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f243c15eaa0 0x7f243c0b9c80 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2434009ee0 tx=0x7f2434004a40 comp rx=0 tx=0).stop 2024-09-10T08:47:51.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.004+0000 7f2441800640 1 -- 172.21.15.2:0/3503592989 shutdown_connections 2024-09-10T08:47:51.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.004+0000 7f2441800640 1 --2- 172.21.15.2:0/3503592989 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f243c15eaa0 0x7f243c0b9c80 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:51.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.004+0000 7f2441800640 1 --2- 172.21.15.2:0/3503592989 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f241c06be30 0x7f241c06e2f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:51.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.004+0000 7f2441800640 1 --2- 172.21.15.2:0/3503592989 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f243c15e6c0 0x7f243c1f47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:51.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.004+0000 7f2441800640 1 --2- 172.21.15.2:0/3503592989 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f243c06dd80 0x7f243c1587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:51.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.004+0000 7f2441800640 1 -- 172.21.15.2:0/3503592989 >> 172.21.15.2:0/3503592989 conn(0x7f243c08bfd0 msgr2=0x7f243c1e90e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:51.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.004+0000 7f2441800640 1 -- 172.21.15.2:0/3503592989 shutdown_connections 2024-09-10T08:47:51.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.004+0000 7f2441800640 1 -- 172.21.15.2:0/3503592989 wait complete. 2024-09-10T08:47:51.021 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-10T08:47:51.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.177+0000 7f24b7200640 1 Processor -- start 2024-09-10T08:47:51.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.177+0000 7f24b7200640 1 -- start start 2024-09-10T08:47:51.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.178+0000 7f24b7200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f24b815e6a0 0x7f24b80d2850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:51.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.178+0000 7f24b7200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24b80b64b0 0x7f24b80b7600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:51.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.178+0000 7f24b7200640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24b80d31a0 con 0x7f24b80cec10 2024-09-10T08:47:51.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.178+0000 7f24b7200640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f24b80d3480 con 0x7f24b815e6a0 2024-09-10T08:47:51.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.178+0000 7f24b7200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f24b80d3760 con 0x7f24b80b64b0 2024-09-10T08:47:51.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.178+0000 7f24b5400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f24b80cec10 0x7f24b80b5da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52014/0 (socket says 172.21.15.2:52014) 2024-09-10T08:47:51.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.178+0000 7f24b5e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f24b815e6a0 0x7f24b80d2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:51.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.178+0000 7f24b5400640 1 -- 172.21.15.2:0/1638433158 learned_addr learned my addr 172.21.15.2:0/1638433158 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:47:51.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.179+0000 7f24b6800640 1 --2- 172.21.15.2:0/1638433158 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24b80b64b0 0x7f24b80b7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:51.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.179+0000 7f24b4a00640 1 -- 172.21.15.2:0/1638433158 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3795748314 0 0) 0x7f24b80d31a0 con 0x7f24b80cec10 2024-09-10T08:47:51.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.179+0000 7f24b5e00640 1 -- 172.21.15.2:0/1638433158 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24b80b64b0 msgr2=0x7f24b80b7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:51.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.179+0000 7f24b5e00640 1 --2- 172.21.15.2:0/1638433158 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24b80b64b0 0x7f24b80b7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:51.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.179+0000 7f24b5e00640 1 -- 172.21.15.2:0/1638433158 >> v1:172.21.15.2:6789/0 conn(0x7f24b80cec10 legacy=0x7f24b80b5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:51.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.179+0000 7f24b5e00640 1 -- 172.21.15.2:0/1638433158 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24b80d3a40 con 0x7f24b815e6a0 2024-09-10T08:47:51.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.179+0000 7f24b6800640 1 --2- 172.21.15.2:0/1638433158 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24b80b64b0 0x7f24b80b7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:47:51.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.180+0000 7f24b5e00640 1 --2- 172.21.15.2:0/1638433158 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24b815e6a0 0x7f24b80d2850 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f24a80097a0 tx=0x7f24a802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba465567560b72ae server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:51.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.180+0000 7f24b4a00640 1 -- 172.21.15.2:0/1638433158 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a8037070 con 0x7f24b815e6a0 2024-09-10T08:47:51.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.180+0000 7f24b4a00640 1 -- 172.21.15.2:0/1638433158 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24a8032440 con 0x7f24b815e6a0 2024-09-10T08:47:51.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.180+0000 7f24b4a00640 1 -- 172.21.15.2:0/1638433158 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a8032810 con 0x7f24b815e6a0 2024-09-10T08:47:51.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.181+0000 7f24b7200640 1 -- 172.21.15.2:0/1638433158 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24b815e6a0 msgr2=0x7f24b80d2850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:51.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.181+0000 7f24b7200640 1 --2- 172.21.15.2:0/1638433158 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24b815e6a0 0x7f24b80d2850 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f24a80097a0 tx=0x7f24a802a210 comp rx=0 tx=0).stop 2024-09-10T08:47:51.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.181+0000 7f24b7200640 1 -- 172.21.15.2:0/1638433158 shutdown_connections 2024-09-10T08:47:51.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.181+0000 7f24b7200640 1 --2- 172.21.15.2:0/1638433158 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24b80b64b0 0x7f24b80b7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:51.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.181+0000 7f24b7200640 1 --2- 172.21.15.2:0/1638433158 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24b815e6a0 0x7f24b80d2850 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:51.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.181+0000 7f24b7200640 1 -- 172.21.15.2:0/1638433158 >> 172.21.15.2:0/1638433158 conn(0x7f24b80d0da0 msgr2=0x7f24b80d1180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:51.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.181+0000 7f24b7200640 1 -- 172.21.15.2:0/1638433158 shutdown_connections 2024-09-10T08:47:51.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.181+0000 7f24b7200640 1 -- 172.21.15.2:0/1638433158 wait complete. 2024-09-10T08:47:51.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.182+0000 7f24b7200640 1 Processor -- start 2024-09-10T08:47:51.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.183+0000 7f24b7200640 1 -- start start 2024-09-10T08:47:51.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.183+0000 7f24b7200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24b80b64b0 0x7f24b8156300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:51.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.183+0000 7f24b7200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24b80cec10 0x7f24b80cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:51.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.183+0000 7f24b7200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24b815e6a0 0x7f24b80ca0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:51.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.183+0000 7f24b7200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f24b80d2d90 con 0x7f24b80b64b0 2024-09-10T08:47:51.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.183+0000 7f24b7200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f24b815ea80 con 0x7f24b815e6a0 2024-09-10T08:47:51.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.183+0000 7f24b7200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f24b80d2f10 con 0x7f24b80cec10 2024-09-10T08:47:51.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.184+0000 7f24b5e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24b80b64b0 0x7f24b8156300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:51.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.184+0000 7f24b5e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24b80b64b0 0x7f24b8156300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35750/0 (socket says 172.21.15.2:35750) 2024-09-10T08:47:51.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.184+0000 7f24b5e00640 1 -- 172.21.15.2:0/2005657903 learned_addr learned my addr 172.21.15.2:0/2005657903 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:51.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.184+0000 7f24b5400640 1 --2- 172.21.15.2:0/2005657903 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24b80cec10 0x7f24b80cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:51.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.184+0000 7f24b6800640 1 --2- 172.21.15.2:0/2005657903 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24b815e6a0 0x7f24b80ca0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:51.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.184+0000 7f24b5e00640 1 -- 172.21.15.2:0/2005657903 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24b80cec10 msgr2=0x7f24b80cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:51.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.184+0000 7f24b5e00640 1 --2- 172.21.15.2:0/2005657903 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24b80cec10 0x7f24b80cceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:51.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.184+0000 7f24b5e00640 1 -- 172.21.15.2:0/2005657903 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24b815e6a0 msgr2=0x7f24b80ca0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:51.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.184+0000 7f24b5e00640 1 --2- 172.21.15.2:0/2005657903 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24b815e6a0 0x7f24b80ca0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:51.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.184+0000 7f24b5e00640 1 -- 172.21.15.2:0/2005657903 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24b80cd5b0 con 0x7f24b80b64b0 2024-09-10T08:47:51.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.184+0000 7f24b6800640 1 --2- 172.21.15.2:0/2005657903 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24b815e6a0 0x7f24b80ca0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:47:51.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.184+0000 7f24b5400640 1 --2- 172.21.15.2:0/2005657903 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24b80cec10 0x7f24b80cceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:47:51.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.185+0000 7f24b5e00640 1 --2- 172.21.15.2:0/2005657903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24b80b64b0 0x7f24b8156300 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f24a8000c00 tx=0x7f24a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:51.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.185+0000 7f24ae000640 1 -- 172.21.15.2:0/2005657903 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a8037040 con 0x7f24b80b64b0 2024-09-10T08:47:51.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.185+0000 7f24ae000640 1 -- 172.21.15.2:0/2005657903 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24a8042070 con 0x7f24b80b64b0 2024-09-10T08:47:51.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.185+0000 7f24ae000640 1 -- 172.21.15.2:0/2005657903 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a8030a70 con 0x7f24b80b64b0 2024-09-10T08:47:51.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.185+0000 7f24b7200640 1 -- 172.21.15.2:0/2005657903 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24b80cb490 con 0x7f24b80b64b0 2024-09-10T08:47:51.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.185+0000 7f24b7200640 1 -- 172.21.15.2:0/2005657903 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24b80cba50 con 0x7f24b80b64b0 2024-09-10T08:47:51.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.186+0000 7f24b7200640 1 -- 172.21.15.2:0/2005657903 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24b80b8680 con 0x7f24b80b64b0 2024-09-10T08:47:51.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.187+0000 7f24ae000640 1 -- 172.21.15.2:0/2005657903 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f24a8030c10 con 0x7f24b80b64b0 2024-09-10T08:47:51.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.188+0000 7f24ae000640 1 --2- 172.21.15.2:0/2005657903 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f249806be30 0x7f249806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:51.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.188+0000 7f24ae000640 1 -- 172.21.15.2:0/2005657903 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7f24a80ab7e0 con 0x7f24b80b64b0 2024-09-10T08:47:51.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.188+0000 7f24b5400640 1 --2- 172.21.15.2:0/2005657903 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f249806be30 0x7f249806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:51.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.189+0000 7f24b5400640 1 --2- 172.21.15.2:0/2005657903 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f249806be30 0x7f249806e2f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f24b80b8a10 tx=0x7f24a4007c10 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:51.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.192+0000 7f24ae000640 1 -- 172.21.15.2:0/2005657903 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f24a8045360 con 0x7f24b80b64b0 2024-09-10T08:47:51.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.381+0000 7f24b7200640 1 -- 172.21.15.2:0/2005657903 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f24b80b83a0 con 0x7f24b80b64b0 2024-09-10T08:47:51.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.382+0000 7f24ae000640 1 -- 172.21.15.2:0/2005657903 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v34) ==== 84+0+65 (secure 0 0 0) 0x7f24a807a2b0 con 0x7f24b80b64b0 2024-09-10T08:47:51.382 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:47:51.382 INFO:teuthology.orchestra.run.smithi002.stdout:[ 2024-09-10T08:47:51.382 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T08:47:51.382 INFO:teuthology.orchestra.run.smithi002.stdout: "poolnum": 1, 2024-09-10T08:47:51.383 INFO:teuthology.orchestra.run.smithi002.stdout: "poolname": ".mgr" 2024-09-10T08:47:51.383 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T08:47:51.383 INFO:teuthology.orchestra.run.smithi002.stdout:] 2024-09-10T08:47:51.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.384+0000 7f24b7200640 1 -- 172.21.15.2:0/2005657903 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f249806be30 msgr2=0x7f249806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:51.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.384+0000 7f24b7200640 1 --2- 172.21.15.2:0/2005657903 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f249806be30 0x7f249806e2f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f24b80b8a10 tx=0x7f24a4007c10 comp rx=0 tx=0).stop 2024-09-10T08:47:51.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.384+0000 7f24b7200640 1 -- 172.21.15.2:0/2005657903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24b80b64b0 msgr2=0x7f24b8156300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:51.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.384+0000 7f24b7200640 1 --2- 172.21.15.2:0/2005657903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24b80b64b0 0x7f24b8156300 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f24a8000c00 tx=0x7f24a80046c0 comp rx=0 tx=0).stop 2024-09-10T08:47:51.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.384+0000 7f24b7200640 1 -- 172.21.15.2:0/2005657903 shutdown_connections 2024-09-10T08:47:51.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.384+0000 7f24b7200640 1 --2- 172.21.15.2:0/2005657903 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24b815e6a0 0x7f24b80ca0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:51.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.384+0000 7f24b7200640 1 --2- 172.21.15.2:0/2005657903 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f249806be30 0x7f249806e2f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:51.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.384+0000 7f24b7200640 1 --2- 172.21.15.2:0/2005657903 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24b80cec10 0x7f24b80cceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:51.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.384+0000 7f24b7200640 1 --2- 172.21.15.2:0/2005657903 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24b80b64b0 0x7f24b8156300 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:51.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.384+0000 7f24b7200640 1 -- 172.21.15.2:0/2005657903 >> 172.21.15.2:0/2005657903 conn(0x7f24b80d0da0 msgr2=0x7f24b80b5d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:51.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.384+0000 7f24b7200640 1 -- 172.21.15.2:0/2005657903 shutdown_connections 2024-09-10T08:47:51.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.385+0000 7f24b7200640 1 -- 172.21.15.2:0/2005657903 wait complete. 2024-09-10T08:47:51.400 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-10T08:47:51.401 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-10T08:47:51.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.561+0000 7f0482c00640 1 Processor -- start 2024-09-10T08:47:51.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.561+0000 7f0482c00640 1 -- start start 2024-09-10T08:47:51.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.562+0000 7f0482c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f047c15bf60 0x7f047c15d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:51.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.562+0000 7f0482c00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f047c0ad640 0x7f047c072b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:51.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.562+0000 7f0482c00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f047c071dc0 con 0x7f047c15dd70 2024-09-10T08:47:51.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.562+0000 7f0482c00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f047c0720a0 con 0x7f047c0ad640 2024-09-10T08:47:51.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.562+0000 7f0482c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f047c072380 con 0x7f047c15bf60 2024-09-10T08:47:51.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.563+0000 7f0482200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f047c0ad640 0x7f047c072b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:51.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.563+0000 7f0480e00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f047c15dd70 0x7f047c0acf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52022/0 (socket says 172.21.15.2:52022) 2024-09-10T08:47:51.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.563+0000 7f0480e00640 1 -- 172.21.15.2:0/1605690715 learned_addr learned my addr 172.21.15.2:0/1605690715 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:47:51.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.563+0000 7f0481800640 1 --2- 172.21.15.2:0/1605690715 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f047c15bf60 0x7f047c15d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:51.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.563+0000 7f0482200640 1 -- 172.21.15.2:0/1605690715 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f047c15bf60 msgr2=0x7f047c15d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:51.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.563+0000 7f0482200640 1 --2- 172.21.15.2:0/1605690715 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f047c15bf60 0x7f047c15d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:51.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.563+0000 7f0482200640 1 -- 172.21.15.2:0/1605690715 >> v1:172.21.15.2:6789/0 conn(0x7f047c15dd70 legacy=0x7f047c0acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:51.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.563+0000 7f0482200640 1 -- 172.21.15.2:0/1605690715 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f047c072660 con 0x7f047c0ad640 2024-09-10T08:47:51.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.564+0000 7f0482200640 1 --2- 172.21.15.2:0/1605690715 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f047c0ad640 0x7f047c072b80 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0474009d90 tx=0x7f047402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e28ba612f273c47 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:51.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.564+0000 7f047be00640 1 -- 172.21.15.2:0/1605690715 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0474007740 con 0x7f047c0ad640 2024-09-10T08:47:51.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.565+0000 7f047be00640 1 -- 172.21.15.2:0/1605690715 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04740078e0 con 0x7f047c0ad640 2024-09-10T08:47:51.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.565+0000 7f047be00640 1 -- 172.21.15.2:0/1605690715 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0474007cb0 con 0x7f047c0ad640 2024-09-10T08:47:51.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.565+0000 7f0482c00640 1 -- 172.21.15.2:0/1605690715 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f047c0ad640 msgr2=0x7f047c072b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:51.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.565+0000 7f0482c00640 1 --2- 172.21.15.2:0/1605690715 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f047c0ad640 0x7f047c072b80 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0474009d90 tx=0x7f047402a660 comp rx=0 tx=0).stop 2024-09-10T08:47:51.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.565+0000 7f0482c00640 1 -- 172.21.15.2:0/1605690715 shutdown_connections 2024-09-10T08:47:51.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.565+0000 7f0482c00640 1 --2- 172.21.15.2:0/1605690715 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f047c0ad640 0x7f047c072b80 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:51.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.565+0000 7f0482c00640 1 --2- 172.21.15.2:0/1605690715 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f047c15bf60 0x7f047c15d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:51.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.565+0000 7f0482c00640 1 -- 172.21.15.2:0/1605690715 >> 172.21.15.2:0/1605690715 conn(0x7f047c06c240 msgr2=0x7f047c0b1c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:51.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.565+0000 7f0482c00640 1 -- 172.21.15.2:0/1605690715 shutdown_connections 2024-09-10T08:47:51.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.565+0000 7f0482c00640 1 -- 172.21.15.2:0/1605690715 wait complete. 2024-09-10T08:47:51.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.567+0000 7f0482c00640 1 Processor -- start 2024-09-10T08:47:51.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.567+0000 7f0482c00640 1 -- start start 2024-09-10T08:47:51.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.568+0000 7f0482c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f047c0ad640 0x7f047c1f8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:51.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.568+0000 7f0482c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f047c15bf60 0x7f047c15ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:51.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.568+0000 7f0482c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f047c14ecc0 0x7f047c145790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:51.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.568+0000 7f0482c00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f047c073240 con 0x7f047c0ad640 2024-09-10T08:47:51.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.568+0000 7f0482c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f047c0730c0 con 0x7f047c14ecc0 2024-09-10T08:47:51.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.568+0000 7f0482c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f047c0733c0 con 0x7f047c15bf60 2024-09-10T08:47:51.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.568+0000 7f0481800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f047c0ad640 0x7f047c1f8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:51.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.568+0000 7f0481800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f047c0ad640 0x7f047c1f8390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35774/0 (socket says 172.21.15.2:35774) 2024-09-10T08:47:51.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.568+0000 7f0481800640 1 -- 172.21.15.2:0/1019354142 learned_addr learned my addr 172.21.15.2:0/1019354142 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:51.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.568+0000 7f0482200640 1 --2- 172.21.15.2:0/1019354142 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f047c14ecc0 0x7f047c145790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:51.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.568+0000 7f0480e00640 1 --2- 172.21.15.2:0/1019354142 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f047c15bf60 0x7f047c15ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:51.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.569+0000 7f0481800640 1 -- 172.21.15.2:0/1019354142 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f047c15bf60 msgr2=0x7f047c15ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:51.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.569+0000 7f0481800640 1 --2- 172.21.15.2:0/1019354142 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f047c15bf60 0x7f047c15ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:51.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.569+0000 7f0481800640 1 -- 172.21.15.2:0/1019354142 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f047c14ecc0 msgr2=0x7f047c145790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:51.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.569+0000 7f0481800640 1 --2- 172.21.15.2:0/1019354142 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f047c14ecc0 0x7f047c145790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:51.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.569+0000 7f0481800640 1 -- 172.21.15.2:0/1019354142 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f047c15ec80 con 0x7f047c0ad640 2024-09-10T08:47:51.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.569+0000 7f0481800640 1 --2- 172.21.15.2:0/1019354142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f047c0ad640 0x7f047c1f8390 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f047000e9b0 tx=0x7f047000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:51.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.569+0000 7f0479600640 1 -- 172.21.15.2:0/1019354142 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0470017070 con 0x7f047c0ad640 2024-09-10T08:47:51.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.569+0000 7f0479600640 1 -- 172.21.15.2:0/1019354142 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f047000c9a0 con 0x7f047c0ad640 2024-09-10T08:47:51.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.569+0000 7f0479600640 1 -- 172.21.15.2:0/1019354142 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f047000cd90 con 0x7f047c0ad640 2024-09-10T08:47:51.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.569+0000 7f0482c00640 1 -- 172.21.15.2:0/1019354142 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f047c15ef60 con 0x7f047c0ad640 2024-09-10T08:47:51.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.570+0000 7f0482c00640 1 -- 172.21.15.2:0/1019354142 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f047c15b140 con 0x7f047c0ad640 2024-09-10T08:47:51.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.571+0000 7f0482c00640 1 -- 172.21.15.2:0/1019354142 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f047c072b80 con 0x7f047c0ad640 2024-09-10T08:47:51.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.572+0000 7f0479600640 1 -- 172.21.15.2:0/1019354142 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f047001a070 con 0x7f047c0ad640 2024-09-10T08:47:51.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.572+0000 7f0479600640 1 --2- 172.21.15.2:0/1019354142 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f045c06be30 0x7f045c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:51.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.572+0000 7f0479600640 1 -- 172.21.15.2:0/1019354142 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5249+0+0 (secure 0 0 0) 0x7f047008afe0 con 0x7f047c0ad640 2024-09-10T08:47:51.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.573+0000 7f0480e00640 1 --2- 172.21.15.2:0/1019354142 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f045c06be30 0x7f045c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:51.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.574+0000 7f0480e00640 1 --2- 172.21.15.2:0/1019354142 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f045c06be30 0x7f045c06e2f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f047c14f1e0 tx=0x7f0468007e80 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:51.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.577+0000 7f0479600640 1 -- 172.21.15.2:0/1019354142 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0470059510 con 0x7f047c0ad640 2024-09-10T08:47:51.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:51.762+0000 7f0482c00640 1 -- 172.21.15.2:0/1019354142 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f047c0b28d0 con 0x7f047c0ad640 2024-09-10T08:47:52.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.004+0000 7f0479600640 1 -- 172.21.15.2:0/1019354142 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v35) ==== 138+0+0 (secure 0 0 0) 0x7f047005d810 con 0x7f047c0ad640 2024-09-10T08:47:52.005 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' created 2024-09-10T08:47:52.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.007+0000 7f0482c00640 1 -- 172.21.15.2:0/1019354142 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f045c06be30 msgr2=0x7f045c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:52.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.007+0000 7f0482c00640 1 --2- 172.21.15.2:0/1019354142 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f045c06be30 0x7f045c06e2f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f047c14f1e0 tx=0x7f0468007e80 comp rx=0 tx=0).stop 2024-09-10T08:47:52.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.007+0000 7f0482c00640 1 -- 172.21.15.2:0/1019354142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f047c0ad640 msgr2=0x7f047c1f8390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:52.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.007+0000 7f0482c00640 1 --2- 172.21.15.2:0/1019354142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f047c0ad640 0x7f047c1f8390 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f047000e9b0 tx=0x7f047000ee70 comp rx=0 tx=0).stop 2024-09-10T08:47:52.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.007+0000 7f0482c00640 1 -- 172.21.15.2:0/1019354142 shutdown_connections 2024-09-10T08:47:52.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.007+0000 7f0482c00640 1 --2- 172.21.15.2:0/1019354142 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f047c14ecc0 0x7f047c145790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:52.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.007+0000 7f0482c00640 1 --2- 172.21.15.2:0/1019354142 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f045c06be30 0x7f045c06e2f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:52.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.007+0000 7f0482c00640 1 --2- 172.21.15.2:0/1019354142 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f047c15bf60 0x7f047c15ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:52.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.007+0000 7f0482c00640 1 --2- 172.21.15.2:0/1019354142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f047c0ad640 0x7f047c1f8390 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:52.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.007+0000 7f0482c00640 1 -- 172.21.15.2:0/1019354142 >> 172.21.15.2:0/1019354142 conn(0x7f047c06c240 msgr2=0x7f047c0b45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:52.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.008+0000 7f0482c00640 1 -- 172.21.15.2:0/1019354142 shutdown_connections 2024-09-10T08:47:52.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.008+0000 7f0482c00640 1 -- 172.21.15.2:0/1019354142 wait complete. 2024-09-10T08:47:52.029 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-10T08:47:52.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.192+0000 7fe709800640 1 Processor -- start 2024-09-10T08:47:52.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.192+0000 7fe709800640 1 -- start start 2024-09-10T08:47:52.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.193+0000 7fe709800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe70409acb0 0x7fe7040d0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:52.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.193+0000 7fe709800640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe70409b090 0x7fe7040d0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:52.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.193+0000 7fe709800640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7040d13f0 con 0x7fe7041625f0 2024-09-10T08:47:52.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.193+0000 7fe709800640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fe7040b2900 con 0x7fe70409b090 2024-09-10T08:47:52.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.193+0000 7fe709800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe7040b1cf0 con 0x7fe70409acb0 2024-09-10T08:47:52.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.193+0000 7fe703400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fe7041625f0 0x7fe704162a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52030/0 (socket says 172.21.15.2:52030) 2024-09-10T08:47:52.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.193+0000 7fe703400640 1 -- 172.21.15.2:0/984806349 learned_addr learned my addr 172.21.15.2:0/984806349 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:47:52.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.193+0000 7fe702a00640 1 --2- 172.21.15.2:0/984806349 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe70409acb0 0x7fe7040d0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:52.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.193+0000 7fe6fbe00640 1 --2- 172.21.15.2:0/984806349 >> v2:172.21.15.155:3300/0 conn(0x7fe70409b090 0x7fe7040d0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:52.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.194+0000 7fe702000640 1 -- 172.21.15.2:0/984806349 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1164243022 0 0) 0x7fe7040d13f0 con 0x7fe7041625f0 2024-09-10T08:47:52.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.194+0000 7fe702000640 1 -- 172.21.15.2:0/984806349 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe6e8003520 con 0x7fe7041625f0 2024-09-10T08:47:52.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.194+0000 7fe702a00640 1 -- 172.21.15.2:0/984806349 >> v2:172.21.15.155:3300/0 conn(0x7fe70409b090 msgr2=0x7fe7040d0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:52.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.194+0000 7fe702a00640 1 --2- 172.21.15.2:0/984806349 >> v2:172.21.15.155:3300/0 conn(0x7fe70409b090 0x7fe7040d0eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:52.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.194+0000 7fe702a00640 1 -- 172.21.15.2:0/984806349 >> v1:172.21.15.2:6789/0 conn(0x7fe7041625f0 legacy=0x7fe704162a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:52.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.194+0000 7fe702a00640 1 -- 172.21.15.2:0/984806349 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7040b1fd0 con 0x7fe70409acb0 2024-09-10T08:47:52.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.195+0000 7fe702a00640 1 --2- 172.21.15.2:0/984806349 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe70409acb0 0x7fe7040d0970 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe6f40097a0 tx=0x7fe6f402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8cfec35f9fa0b446 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:52.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.196+0000 7fe702000640 1 -- 172.21.15.2:0/984806349 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f4037070 con 0x7fe70409acb0 2024-09-10T08:47:52.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.196+0000 7fe702000640 1 -- 172.21.15.2:0/984806349 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6f4032440 con 0x7fe70409acb0 2024-09-10T08:47:52.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.196+0000 7fe702000640 1 -- 172.21.15.2:0/984806349 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f4032810 con 0x7fe70409acb0 2024-09-10T08:47:52.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.196+0000 7fe709800640 1 -- 172.21.15.2:0/984806349 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe70409acb0 msgr2=0x7fe7040d0970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:52.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.196+0000 7fe709800640 1 --2- 172.21.15.2:0/984806349 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe70409acb0 0x7fe7040d0970 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe6f40097a0 tx=0x7fe6f402a180 comp rx=0 tx=0).stop 2024-09-10T08:47:52.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.196+0000 7fe709800640 1 -- 172.21.15.2:0/984806349 shutdown_connections 2024-09-10T08:47:52.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.196+0000 7fe709800640 1 --2- 172.21.15.2:0/984806349 >> v2:172.21.15.155:3300/0 conn(0x7fe70409b090 0x7fe7040d0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:52.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.196+0000 7fe709800640 1 --2- 172.21.15.2:0/984806349 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe70409acb0 0x7fe7040d0970 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:52.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.196+0000 7fe709800640 1 -- 172.21.15.2:0/984806349 >> 172.21.15.2:0/984806349 conn(0x7fe7040b3e80 msgr2=0x7fe7040b4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:52.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.196+0000 7fe709800640 1 -- 172.21.15.2:0/984806349 shutdown_connections 2024-09-10T08:47:52.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.196+0000 7fe709800640 1 -- 172.21.15.2:0/984806349 wait complete. 2024-09-10T08:47:52.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.198+0000 7fe709800640 1 Processor -- start 2024-09-10T08:47:52.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.198+0000 7fe709800640 1 -- start start 2024-09-10T08:47:52.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.199+0000 7fe709800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe70409acb0 0x7fe704156a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:52.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.199+0000 7fe709800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe70409b090 0x7fe704148990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:52.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.199+0000 7fe709800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe7041625f0 0x7fe70415be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:52.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.199+0000 7fe709800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe70406ca60 con 0x7fe70409acb0 2024-09-10T08:47:52.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.199+0000 7fe709800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe7040b2590 con 0x7fe7041625f0 2024-09-10T08:47:52.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.199+0000 7fe709800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe70406cbe0 con 0x7fe70409b090 2024-09-10T08:47:52.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.199+0000 7fe702a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe70409acb0 0x7fe704156a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:52.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.199+0000 7fe702a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe70409acb0 0x7fe704156a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35776/0 (socket says 172.21.15.2:35776) 2024-09-10T08:47:52.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.199+0000 7fe702a00640 1 -- 172.21.15.2:0/2415164685 learned_addr learned my addr 172.21.15.2:0/2415164685 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:52.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.200+0000 7fe6fbe00640 1 --2- 172.21.15.2:0/2415164685 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe70409b090 0x7fe704148990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:52.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.200+0000 7fe703400640 1 --2- 172.21.15.2:0/2415164685 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe7041625f0 0x7fe70415be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:52.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.200+0000 7fe702a00640 1 -- 172.21.15.2:0/2415164685 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe70409b090 msgr2=0x7fe704148990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:52.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.200+0000 7fe702a00640 1 --2- 172.21.15.2:0/2415164685 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe70409b090 0x7fe704148990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:52.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.200+0000 7fe702a00640 1 -- 172.21.15.2:0/2415164685 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe7041625f0 msgr2=0x7fe70415be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:52.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.200+0000 7fe702a00640 1 --2- 172.21.15.2:0/2415164685 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe7041625f0 0x7fe70415be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:52.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.200+0000 7fe702a00640 1 -- 172.21.15.2:0/2415164685 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7041573e0 con 0x7fe70409acb0 2024-09-10T08:47:52.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.200+0000 7fe6fbe00640 1 --2- 172.21.15.2:0/2415164685 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe70409b090 0x7fe704148990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:47:52.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.200+0000 7fe702a00640 1 --2- 172.21.15.2:0/2415164685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe70409acb0 0x7fe704156a90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe6f4035040 tx=0x7fe6f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:52.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.200+0000 7fe6faa00640 1 -- 172.21.15.2:0/2415164685 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f4041030 con 0x7fe70409acb0 2024-09-10T08:47:52.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.200+0000 7fe6faa00640 1 -- 172.21.15.2:0/2415164685 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6f403d4e0 con 0x7fe70409acb0 2024-09-10T08:47:52.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.200+0000 7fe6faa00640 1 -- 172.21.15.2:0/2415164685 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f4037040 con 0x7fe70409acb0 2024-09-10T08:47:52.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.200+0000 7fe709800640 1 -- 172.21.15.2:0/2415164685 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe70415b370 con 0x7fe70409acb0 2024-09-10T08:47:52.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.201+0000 7fe709800640 1 -- 172.21.15.2:0/2415164685 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe704156fd0 con 0x7fe70409acb0 2024-09-10T08:47:52.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.202+0000 7fe6f3e00640 1 -- 172.21.15.2:0/2415164685 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6d4005290 con 0x7fe70409acb0 2024-09-10T08:47:52.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.203+0000 7fe6faa00640 1 -- 172.21.15.2:0/2415164685 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe6f4044070 con 0x7fe70409acb0 2024-09-10T08:47:52.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.203+0000 7fe6faa00640 1 --2- 172.21.15.2:0/2415164685 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fe6e006be30 0x7fe6e006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:52.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.204+0000 7fe6faa00640 1 -- 172.21.15.2:0/2415164685 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5619+0+0 (secure 0 0 0) 0x7fe6f40ab4b0 con 0x7fe70409acb0 2024-09-10T08:47:52.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.204+0000 7fe6fbe00640 1 --2- 172.21.15.2:0/2415164685 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fe6e006be30 0x7fe6e006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:52.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.205+0000 7fe6fbe00640 1 --2- 172.21.15.2:0/2415164685 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fe6e006be30 0x7fe6e006e2f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe70415ad30 tx=0x7fe6ec008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:52.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.208+0000 7fe6faa00640 1 -- 172.21.15.2:0/2415164685 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe6f4079e20 con 0x7fe70409acb0 2024-09-10T08:47:52.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:52.395+0000 7fe6f3e00640 1 -- 172.21.15.2:0/2415164685 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fe6d4005580 con 0x7fe70409acb0 2024-09-10T08:47:53.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.007+0000 7fe6faa00640 1 -- 172.21.15.2:0/2415164685 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v36) ==== 170+0+0 (secure 0 0 0) 0x7fe6f4079720 con 0x7fe70409acb0 2024-09-10T08:47:53.008 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' created 2024-09-10T08:47:53.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.011+0000 7fe6f3e00640 1 -- 172.21.15.2:0/2415164685 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fe6e006be30 msgr2=0x7fe6e006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:53.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.011+0000 7fe6f3e00640 1 --2- 172.21.15.2:0/2415164685 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fe6e006be30 0x7fe6e006e2f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe70415ad30 tx=0x7fe6ec008040 comp rx=0 tx=0).stop 2024-09-10T08:47:53.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.011+0000 7fe6f3e00640 1 -- 172.21.15.2:0/2415164685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe70409acb0 msgr2=0x7fe704156a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:53.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.011+0000 7fe6f3e00640 1 --2- 172.21.15.2:0/2415164685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe70409acb0 0x7fe704156a90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe6f4035040 tx=0x7fe6f40046c0 comp rx=0 tx=0).stop 2024-09-10T08:47:53.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.011+0000 7fe6f3e00640 1 -- 172.21.15.2:0/2415164685 shutdown_connections 2024-09-10T08:47:53.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.011+0000 7fe6f3e00640 1 --2- 172.21.15.2:0/2415164685 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe7041625f0 0x7fe70415be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:53.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.011+0000 7fe6f3e00640 1 --2- 172.21.15.2:0/2415164685 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fe6e006be30 0x7fe6e006e2f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:53.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.011+0000 7fe6f3e00640 1 --2- 172.21.15.2:0/2415164685 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe70409b090 0x7fe704148990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:53.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.011+0000 7fe6f3e00640 1 --2- 172.21.15.2:0/2415164685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe70409acb0 0x7fe704156a90 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:53.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.011+0000 7fe6f3e00640 1 -- 172.21.15.2:0/2415164685 >> 172.21.15.2:0/2415164685 conn(0x7fe7040b3e80 msgr2=0x7fe704071750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:53.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.011+0000 7fe6f3e00640 1 -- 172.21.15.2:0/2415164685 shutdown_connections 2024-09-10T08:47:53.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.011+0000 7fe6f3e00640 1 -- 172.21.15.2:0/2415164685 wait complete. 2024-09-10T08:47:53.048 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-10T08:47:53.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.208+0000 7fb261c00640 1 Processor -- start 2024-09-10T08:47:53.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.208+0000 7fb261c00640 1 -- start start 2024-09-10T08:47:53.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.209+0000 7fb261c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb25c0b20e0 0x7fb25c169480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:53.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.209+0000 7fb261c00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb25c0d3150 con 0x7fb25c161bb0 2024-09-10T08:47:53.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.209+0000 7fb261c00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb25c0cfbf0 con 0x7fb25c161f90 2024-09-10T08:47:53.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.209+0000 7fb261c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb25c0cfed0 con 0x7fb25c0b20e0 2024-09-10T08:47:53.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.210+0000 7fb25be00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fb25c161bb0 0x7fb25c0d2330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52040/0 (socket says 172.21.15.2:52040) 2024-09-10T08:47:53.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.210+0000 7fb25be00640 1 -- 172.21.15.2:0/901573643 learned_addr learned my addr 172.21.15.2:0/901573643 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:47:53.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.210+0000 7fb261200640 1 --2- 172.21.15.2:0/901573643 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb25c0b20e0 0x7fb25c169480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:53.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.210+0000 7fb25b400640 1 -- 172.21.15.2:0/901573643 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1671223490 0 0) 0x7fb25c0d3150 con 0x7fb25c161bb0 2024-09-10T08:47:53.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.210+0000 7fb25b400640 1 -- 172.21.15.2:0/901573643 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb240003520 con 0x7fb25c161bb0 2024-09-10T08:47:53.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.210+0000 7fb25b400640 1 -- 172.21.15.2:0/901573643 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4050707569 0 0) 0x7fb25c0cfbf0 con 0x7fb25c161f90 2024-09-10T08:47:53.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.210+0000 7fb25b400640 1 -- 172.21.15.2:0/901573643 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb25c0d3150 con 0x7fb25c161f90 2024-09-10T08:47:53.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.210+0000 7fb261200640 1 -- 172.21.15.2:0/901573643 >> v1:172.21.15.155:6789/0 conn(0x7fb25c161f90 legacy=0x7fb25c0d2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:53.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.210+0000 7fb261200640 1 -- 172.21.15.2:0/901573643 >> v1:172.21.15.2:6789/0 conn(0x7fb25c161bb0 legacy=0x7fb25c0d2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:53.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.210+0000 7fb261200640 1 -- 172.21.15.2:0/901573643 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb25c0d01b0 con 0x7fb25c0b20e0 2024-09-10T08:47:53.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.211+0000 7fb261200640 1 --2- 172.21.15.2:0/901573643 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb25c0b20e0 0x7fb25c169480 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb254009dc0 tx=0x7fb25402a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c53ff47abec0eb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:53.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.212+0000 7fb25b400640 1 -- 172.21.15.2:0/901573643 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb254007740 con 0x7fb25c0b20e0 2024-09-10T08:47:53.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.212+0000 7fb25b400640 1 -- 172.21.15.2:0/901573643 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2540078e0 con 0x7fb25c0b20e0 2024-09-10T08:47:53.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.212+0000 7fb25b400640 1 -- 172.21.15.2:0/901573643 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb254007cb0 con 0x7fb25c0b20e0 2024-09-10T08:47:53.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.212+0000 7fb261c00640 1 -- 172.21.15.2:0/901573643 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb25c0b20e0 msgr2=0x7fb25c169480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:53.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.212+0000 7fb261c00640 1 --2- 172.21.15.2:0/901573643 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb25c0b20e0 0x7fb25c169480 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb254009dc0 tx=0x7fb25402a6d0 comp rx=0 tx=0).stop 2024-09-10T08:47:53.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.212+0000 7fb261c00640 1 -- 172.21.15.2:0/901573643 shutdown_connections 2024-09-10T08:47:53.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.212+0000 7fb261c00640 1 --2- 172.21.15.2:0/901573643 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb25c0b20e0 0x7fb25c169480 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:53.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.212+0000 7fb261c00640 1 -- 172.21.15.2:0/901573643 >> 172.21.15.2:0/901573643 conn(0x7fb25c09d700 msgr2=0x7fb25c0d4430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:53.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.212+0000 7fb261c00640 1 -- 172.21.15.2:0/901573643 shutdown_connections 2024-09-10T08:47:53.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.212+0000 7fb261c00640 1 -- 172.21.15.2:0/901573643 wait complete. 2024-09-10T08:47:53.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.214+0000 7fb261c00640 1 Processor -- start 2024-09-10T08:47:53.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.214+0000 7fb261c00640 1 -- start start 2024-09-10T08:47:53.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.215+0000 7fb261c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb25c0b20e0 0x7fb25c0b8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:53.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.215+0000 7fb261c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb25c161bb0 0x7fb25c1f4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:53.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.215+0000 7fb261c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb25c161f90 0x7fb25c0ce5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:53.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.215+0000 7fb261c00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb25c0d52c0 con 0x7fb25c0b20e0 2024-09-10T08:47:53.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.215+0000 7fb261c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb25c0b3280 con 0x7fb25c161bb0 2024-09-10T08:47:53.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.215+0000 7fb261c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb25c0d4e70 con 0x7fb25c161f90 2024-09-10T08:47:53.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.215+0000 7fb25be00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb25c0b20e0 0x7fb25c0b8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:53.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.215+0000 7fb25be00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb25c0b20e0 0x7fb25c0b8890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35792/0 (socket says 172.21.15.2:35792) 2024-09-10T08:47:53.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.215+0000 7fb25be00640 1 -- 172.21.15.2:0/3104212622 learned_addr learned my addr 172.21.15.2:0/3104212622 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:53.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.216+0000 7fb253400640 1 --2- 172.21.15.2:0/3104212622 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb25c161bb0 0x7fb25c1f4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:53.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.216+0000 7fb261200640 1 --2- 172.21.15.2:0/3104212622 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb25c161f90 0x7fb25c0ce5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:53.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.216+0000 7fb25be00640 1 -- 172.21.15.2:0/3104212622 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb25c161f90 msgr2=0x7fb25c0ce5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:53.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.216+0000 7fb25be00640 1 --2- 172.21.15.2:0/3104212622 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb25c161f90 0x7fb25c0ce5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:53.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.216+0000 7fb25be00640 1 -- 172.21.15.2:0/3104212622 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb25c161bb0 msgr2=0x7fb25c1f4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:53.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.216+0000 7fb25be00640 1 --2- 172.21.15.2:0/3104212622 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb25c161bb0 0x7fb25c1f4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:53.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.216+0000 7fb25be00640 1 -- 172.21.15.2:0/3104212622 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb25c1f4e50 con 0x7fb25c0b20e0 2024-09-10T08:47:53.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.216+0000 7fb261200640 1 --2- 172.21.15.2:0/3104212622 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb25c161f90 0x7fb25c0ce5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:47:53.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.216+0000 7fb25be00640 1 --2- 172.21.15.2:0/3104212622 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb25c0b20e0 0x7fb25c0b8890 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb24c00c500 tx=0x7fb24c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:53.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.216+0000 7fb258c00640 1 -- 172.21.15.2:0/3104212622 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb24c017070 con 0x7fb25c0b20e0 2024-09-10T08:47:53.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.216+0000 7fb258c00640 1 -- 172.21.15.2:0/3104212622 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb24c005ce0 con 0x7fb25c0b20e0 2024-09-10T08:47:53.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.216+0000 7fb258c00640 1 -- 172.21.15.2:0/3104212622 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb24c0072f0 con 0x7fb25c0b20e0 2024-09-10T08:47:53.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.216+0000 7fb261c00640 1 -- 172.21.15.2:0/3104212622 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb25c0b77f0 con 0x7fb25c0b20e0 2024-09-10T08:47:53.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.217+0000 7fb261c00640 1 -- 172.21.15.2:0/3104212622 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb25c0b7db0 con 0x7fb25c0b20e0 2024-09-10T08:47:53.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.218+0000 7fb261c00640 1 -- 172.21.15.2:0/3104212622 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb25c0d2af0 con 0x7fb25c0b20e0 2024-09-10T08:47:53.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.219+0000 7fb258c00640 1 -- 172.21.15.2:0/3104212622 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb24c01a070 con 0x7fb25c0b20e0 2024-09-10T08:47:53.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.220+0000 7fb258c00640 1 --2- 172.21.15.2:0/3104212622 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fb23806be30 0x7fb23806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:53.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.220+0000 7fb258c00640 1 -- 172.21.15.2:0/3104212622 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6001+0+0 (secure 0 0 0) 0x7fb24c08a2f0 con 0x7fb25c0b20e0 2024-09-10T08:47:53.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.220+0000 7fb253400640 1 --2- 172.21.15.2:0/3104212622 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fb23806be30 0x7fb23806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:53.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.221+0000 7fb253400640 1 --2- 172.21.15.2:0/3104212622 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fb23806be30 0x7fb23806e2f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb244007fd0 tx=0x7fb244009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:53.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.225+0000 7fb258c00640 1 -- 172.21.15.2:0/3104212622 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb25c1f4e50 con 0x7fb25c0b20e0 2024-09-10T08:47:53.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:53.445+0000 7fb261c00640 1 -- 172.21.15.2:0/3104212622 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fb25c0cb790 con 0x7fb25c0b20e0 2024-09-10T08:47:54.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.027+0000 7fb258c00640 1 -- 172.21.15.2:0/3104212622 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v14) ==== 172+0+0 (secure 0 0 0) 0x7fb24c058510 con 0x7fb25c0b20e0 2024-09-10T08:47:54.030 INFO:teuthology.orchestra.run.smithi002.stderr:new fs with metadata pool 5 and data pool 6 2024-09-10T08:47:54.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.037+0000 7fb261c00640 1 -- 172.21.15.2:0/3104212622 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fb23806be30 msgr2=0x7fb23806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:54.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.037+0000 7fb261c00640 1 --2- 172.21.15.2:0/3104212622 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fb23806be30 0x7fb23806e2f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb244007fd0 tx=0x7fb244009040 comp rx=0 tx=0).stop 2024-09-10T08:47:54.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.037+0000 7fb261c00640 1 -- 172.21.15.2:0/3104212622 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb25c0b20e0 msgr2=0x7fb25c0b8890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:54.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.037+0000 7fb261c00640 1 --2- 172.21.15.2:0/3104212622 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb25c0b20e0 0x7fb25c0b8890 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb24c00c500 tx=0x7fb24c00c9c0 comp rx=0 tx=0).stop 2024-09-10T08:47:54.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.038+0000 7fb261c00640 1 -- 172.21.15.2:0/3104212622 shutdown_connections 2024-09-10T08:47:54.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.038+0000 7fb261c00640 1 --2- 172.21.15.2:0/3104212622 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fb23806be30 0x7fb23806e2f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:54.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.038+0000 7fb261c00640 1 --2- 172.21.15.2:0/3104212622 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb25c161f90 0x7fb25c0ce5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:54.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.038+0000 7fb261c00640 1 --2- 172.21.15.2:0/3104212622 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb25c161bb0 0x7fb25c1f4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:54.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.038+0000 7fb261c00640 1 --2- 172.21.15.2:0/3104212622 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb25c0b20e0 0x7fb25c0b8890 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:54.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.038+0000 7fb261c00640 1 -- 172.21.15.2:0/3104212622 >> 172.21.15.2:0/3104212622 conn(0x7fb25c09d700 msgr2=0x7fb25c0d16c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:54.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.042+0000 7fb261c00640 1 -- 172.21.15.2:0/3104212622 shutdown_connections 2024-09-10T08:47:54.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.042+0000 7fb261c00640 1 -- 172.21.15.2:0/3104212622 wait complete. 2024-09-10T08:47:54.073 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:47:54.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.232+0000 7f5023e00640 1 Processor -- start 2024-09-10T08:47:54.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.232+0000 7f5023e00640 1 -- start start 2024-09-10T08:47:54.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.233+0000 7f5023e00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f501c15e720 0x7f501c1621f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:54.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.233+0000 7f5023e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f501c071350 0x7f501c168520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:54.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.233+0000 7f5023e00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f501c0d0580 con 0x7f501c162730 2024-09-10T08:47:54.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.233+0000 7f5023e00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f501c162b80 con 0x7f501c15e720 2024-09-10T08:47:54.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.233+0000 7f5023e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f501c15eb00 con 0x7f501c071350 2024-09-10T08:47:54.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.233+0000 7f5020a00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f501c162730 0x7f501c070c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52046/0 (socket says 172.21.15.2:52046) 2024-09-10T08:47:54.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.233+0000 7f5020a00640 1 -- 172.21.15.2:0/392609449 learned_addr learned my addr 172.21.15.2:0/392609449 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:47:54.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.233+0000 7f5021400640 1 --2- 172.21.15.2:0/392609449 >> v2:172.21.15.155:3300/0 conn(0x7f501c15e720 0x7f501c1621f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:54.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.233+0000 7f5021e00640 1 --2- 172.21.15.2:0/392609449 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f501c071350 0x7f501c168520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:54.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.234+0000 7f501be00640 1 -- 172.21.15.2:0/392609449 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3459720407 0 0) 0x7f5008001110 con 0x7f501c162730 2024-09-10T08:47:54.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.234+0000 7f501be00640 1 -- 172.21.15.2:0/392609449 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5004003520 con 0x7f501c162730 2024-09-10T08:47:54.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.234+0000 7f5021400640 1 -- 172.21.15.2:0/392609449 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f501c071350 msgr2=0x7f501c168520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:54.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.234+0000 7f5021400640 1 --2- 172.21.15.2:0/392609449 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f501c071350 0x7f501c168520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:54.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.234+0000 7f5021400640 1 -- 172.21.15.2:0/392609449 >> v1:172.21.15.2:6789/0 conn(0x7f501c162730 legacy=0x7f501c070c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:54.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.234+0000 7f5021400640 1 -- 172.21.15.2:0/392609449 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f501c06ed30 con 0x7f501c15e720 2024-09-10T08:47:54.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.235+0000 7f5021400640 1 --2- 172.21.15.2:0/392609449 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f501c15e720 0x7f501c1621f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f50100097a0 tx=0x7f501002a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10e7f57015a5955e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:54.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.235+0000 7f501be00640 1 -- 172.21.15.2:0/392609449 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5010037070 con 0x7f501c15e720 2024-09-10T08:47:54.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.235+0000 7f501be00640 1 -- 172.21.15.2:0/392609449 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5010032440 con 0x7f501c15e720 2024-09-10T08:47:54.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.235+0000 7f501be00640 1 -- 172.21.15.2:0/392609449 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5010032810 con 0x7f501c15e720 2024-09-10T08:47:54.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.236+0000 7f5023e00640 1 -- 172.21.15.2:0/392609449 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f501c15e720 msgr2=0x7f501c1621f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:54.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.236+0000 7f5023e00640 1 --2- 172.21.15.2:0/392609449 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f501c15e720 0x7f501c1621f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f50100097a0 tx=0x7f501002a230 comp rx=0 tx=0).stop 2024-09-10T08:47:54.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.236+0000 7f5023e00640 1 -- 172.21.15.2:0/392609449 shutdown_connections 2024-09-10T08:47:54.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.236+0000 7f5023e00640 1 --2- 172.21.15.2:0/392609449 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f501c071350 0x7f501c168520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:54.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.236+0000 7f5023e00640 1 --2- 172.21.15.2:0/392609449 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f501c15e720 0x7f501c1621f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:54.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.236+0000 7f5023e00640 1 -- 172.21.15.2:0/392609449 >> 172.21.15.2:0/392609449 conn(0x7f501c0d23f0 msgr2=0x7f501c0d2800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:54.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.236+0000 7f5023e00640 1 -- 172.21.15.2:0/392609449 shutdown_connections 2024-09-10T08:47:54.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.236+0000 7f5023e00640 1 -- 172.21.15.2:0/392609449 wait complete. 2024-09-10T08:47:54.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.238+0000 7f5023e00640 1 Processor -- start 2024-09-10T08:47:54.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.238+0000 7f5023e00640 1 -- start start 2024-09-10T08:47:54.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.239+0000 7f5023e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f501c071350 0x7f501c15c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:54.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.239+0000 7f5023e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f501c15e720 0x7f501c0b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:54.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.239+0000 7f5023e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f501c162730 0x7f501c0b7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:54.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.239+0000 7f5023e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f501c0d0dc0 con 0x7f501c162730 2024-09-10T08:47:54.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.239+0000 7f5023e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f501c0d0ae0 con 0x7f501c071350 2024-09-10T08:47:54.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.239+0000 7f5023e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f501c0d10a0 con 0x7f501c15e720 2024-09-10T08:47:54.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.239+0000 7f5021e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f501c162730 0x7f501c0b7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:54.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.239+0000 7f5021e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f501c162730 0x7f501c0b7e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35802/0 (socket says 172.21.15.2:35802) 2024-09-10T08:47:54.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.239+0000 7f5021e00640 1 -- 172.21.15.2:0/1287781218 learned_addr learned my addr 172.21.15.2:0/1287781218 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:54.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.239+0000 7f5021400640 1 --2- 172.21.15.2:0/1287781218 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f501c071350 0x7f501c15c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:54.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.239+0000 7f5020a00640 1 --2- 172.21.15.2:0/1287781218 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f501c15e720 0x7f501c0b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:54.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.239+0000 7f5021e00640 1 -- 172.21.15.2:0/1287781218 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f501c15e720 msgr2=0x7f501c0b7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:54.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.239+0000 7f5021e00640 1 --2- 172.21.15.2:0/1287781218 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f501c15e720 0x7f501c0b7910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:54.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.239+0000 7f5021e00640 1 -- 172.21.15.2:0/1287781218 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f501c071350 msgr2=0x7f501c15c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:54.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.239+0000 7f5021e00640 1 --2- 172.21.15.2:0/1287781218 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f501c071350 0x7f501c15c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:54.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.239+0000 7f5021e00640 1 -- 172.21.15.2:0/1287781218 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f501c15ce70 con 0x7f501c162730 2024-09-10T08:47:54.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.240+0000 7f5021e00640 1 --2- 172.21.15.2:0/1287781218 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f501c162730 0x7f501c0b7e50 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f501400efc0 tx=0x7f501400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:54.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.240+0000 7f5019600640 1 -- 172.21.15.2:0/1287781218 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5014018020 con 0x7f501c162730 2024-09-10T08:47:54.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.240+0000 7f5019600640 1 -- 172.21.15.2:0/1287781218 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5014014480 con 0x7f501c162730 2024-09-10T08:47:54.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.240+0000 7f5023e00640 1 -- 172.21.15.2:0/1287781218 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f501c15ecb0 con 0x7f501c162730 2024-09-10T08:47:54.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.240+0000 7f5019600640 1 -- 172.21.15.2:0/1287781218 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5014014870 con 0x7f501c162730 2024-09-10T08:47:54.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.240+0000 7f5023e00640 1 -- 172.21.15.2:0/1287781218 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f501c15f270 con 0x7f501c162730 2024-09-10T08:47:54.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.241+0000 7f5023e00640 1 -- 172.21.15.2:0/1287781218 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f501c0d1380 con 0x7f501c162730 2024-09-10T08:47:54.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.242+0000 7f5019600640 1 -- 172.21.15.2:0/1287781218 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5014005d10 con 0x7f501c162730 2024-09-10T08:47:54.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.243+0000 7f5019600640 1 --2- 172.21.15.2:0/1287781218 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f4ffc06be80 0x7f4ffc06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:54.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.243+0000 7f5019600640 1 -- 172.21.15.2:0/1287781218 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f501408be80 con 0x7f501c162730 2024-09-10T08:47:54.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.244+0000 7f5021400640 1 --2- 172.21.15.2:0/1287781218 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f4ffc06be80 0x7f4ffc06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:54.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.244+0000 7f5021400640 1 --2- 172.21.15.2:0/1287781218 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f4ffc06be80 0x7f4ffc06e340 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5010034000 tx=0x7f501002e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:54.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.248+0000 7f5019600640 1 -- 172.21.15.2:0/1287781218 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5014022030 con 0x7f501c162730 2024-09-10T08:47:54.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.435+0000 7f5023e00640 1 -- 172.21.15.2:0/1287781218 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f501c0d3220 con 0x7f501c162730 2024-09-10T08:47:54.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.436+0000 7f5019600640 1 -- 172.21.15.2:0/1287781218 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) ==== 74+0+16955 (secure 0 0 0) 0x7f501c15ce70 con 0x7f501c162730 2024-09-10T08:47:54.437 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:47:54.437 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":37,"fsid":"f20a15a7-d363-4d44-98cb-4f4f466b52b8","created":"2024-09-10T08:46:26.481619+0000","modified":"2024-09-10T08:47:53.446412+0000","last_up_change":"2024-09-10T08:46:39.323912+0000","last_in_change":"2024-09-10T08:46:29.499894+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:46:39.426180+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:47:51.804125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-10T08:47:52.436532+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c90be333-506b-46d1-b00a-10d089a84776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6822","nonce":298678486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6823","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6826","nonce":298678486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6831","nonce":298678486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6829","nonce":298678486}]},"public_addr":"172.21.15.2:6822/298678486","cluster_addr":"172.21.15.2:6826/298678486","heartbeat_back_addr":"172.21.15.2:6831/298678486","heartbeat_front_addr":"172.21.15.2:6829/298678486","state":["exists","up"]},{"osd":1,"uuid":"3f8bdde8-6cd3-4112-8939-a876191c7368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6809","nonce":1619566025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6811","nonce":1619566025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6815","nonce":1619566025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6813","nonce":1619566025}]},"public_addr":"172.21.15.2:6809/1619566025","cluster_addr":"172.21.15.2:6811/1619566025","heartbeat_back_addr":"172.21.15.2:6815/1619566025","heartbeat_front_addr":"172.21.15.2:6813/1619566025","state":["exists","up"]},{"osd":2,"uuid":"3835f5ab-ed3a-4f46-ae6c-f0edf21708d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6801","nonce":3992427579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6803","nonce":3992427579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6807","nonce":3992427579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6805","nonce":3992427579}]},"public_addr":"172.21.15.2:6801/3992427579","cluster_addr":"172.21.15.2:6803/3992427579","heartbeat_back_addr":"172.21.15.2:6807/3992427579","heartbeat_front_addr":"172.21.15.2:6805/3992427579","state":["exists","up"]},{"osd":3,"uuid":"add6ad27-b411-4a82-9622-b0c1c1782cf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6817","nonce":1270626884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6819","nonce":1270626884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6827","nonce":1270626884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6824","nonce":1270626884}]},"public_addr":"172.21.15.2:6817/1270626884","cluster_addr":"172.21.15.2:6819/1270626884","heartbeat_back_addr":"172.21.15.2:6827/1270626884","heartbeat_front_addr":"172.21.15.2:6824/1270626884","state":["exists","up"]},{"osd":4,"uuid":"c7b642f4-8bd2-4262-9a82-ee1061cfab7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6803","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6806","nonce":553254873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6813","nonce":553254873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6822","nonce":553254873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6819","nonce":553254873}]},"public_addr":"172.21.15.155:6806/553254873","cluster_addr":"172.21.15.155:6813/553254873","heartbeat_back_addr":"172.21.15.155:6822/553254873","heartbeat_front_addr":"172.21.15.155:6819/553254873","state":["exists","up"]},{"osd":5,"uuid":"fb53289a-419f-46d8-9e3a-384ac529dc57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6805","nonce":2107688472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6811","nonce":2107688472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6823","nonce":2107688472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6817","nonce":2107688472}]},"public_addr":"172.21.15.155:6805/2107688472","cluster_addr":"172.21.15.155:6811/2107688472","heartbeat_back_addr":"172.21.15.155:6823/2107688472","heartbeat_front_addr":"172.21.15.155:6817/2107688472","state":["exists","up"]},{"osd":6,"uuid":"3f9ddd54-ede4-4565-aff6-ae1c07e7c678","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6825","nonce":944542383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6827","nonce":944542383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6831","nonce":944542383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6829","nonce":944542383}]},"public_addr":"172.21.15.155:6825/944542383","cluster_addr":"172.21.15.155:6827/944542383","heartbeat_back_addr":"172.21.15.155:6831/944542383","heartbeat_front_addr":"172.21.15.155:6829/944542383","state":["exists","up"]},{"osd":7,"uuid":"328d0681-eef4-4556-94e1-9745bd4adbe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6801","nonce":2220093913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6807","nonce":2220093913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6818","nonce":2220093913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6812","nonce":2220093913}]},"public_addr":"172.21.15.155:6801/2220093913","cluster_addr":"172.21.15.155:6807/2220093913","heartbeat_back_addr":"172.21.15.155:6818/2220093913","heartbeat_front_addr":"172.21.15.155:6812/2220093913","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.052980+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.104550+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.025661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:35.784354+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:35.863363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.322312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.100890+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:35.763584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:47:54.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.438+0000 7f5023e00640 1 -- 172.21.15.2:0/1287781218 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f4ffc06be80 msgr2=0x7f4ffc06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:54.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.438+0000 7f5023e00640 1 --2- 172.21.15.2:0/1287781218 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f4ffc06be80 0x7f4ffc06e340 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5010034000 tx=0x7f501002e000 comp rx=0 tx=0).stop 2024-09-10T08:47:54.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.438+0000 7f5023e00640 1 -- 172.21.15.2:0/1287781218 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f501c162730 msgr2=0x7f501c0b7e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:54.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.438+0000 7f5023e00640 1 --2- 172.21.15.2:0/1287781218 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f501c162730 0x7f501c0b7e50 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f501400efc0 tx=0x7f501400c490 comp rx=0 tx=0).stop 2024-09-10T08:47:54.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.438+0000 7f5023e00640 1 -- 172.21.15.2:0/1287781218 shutdown_connections 2024-09-10T08:47:54.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.438+0000 7f5023e00640 1 --2- 172.21.15.2:0/1287781218 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f501c162730 0x7f501c0b7e50 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:54.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.438+0000 7f5023e00640 1 --2- 172.21.15.2:0/1287781218 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f4ffc06be80 0x7f4ffc06e340 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:54.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.438+0000 7f5023e00640 1 --2- 172.21.15.2:0/1287781218 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f501c15e720 0x7f501c0b7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:54.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.438+0000 7f5023e00640 1 --2- 172.21.15.2:0/1287781218 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f501c071350 0x7f501c15c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:54.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.438+0000 7f5023e00640 1 -- 172.21.15.2:0/1287781218 >> 172.21.15.2:0/1287781218 conn(0x7f501c0d23f0 msgr2=0x7f501c0b12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:54.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.439+0000 7f5023e00640 1 -- 172.21.15.2:0/1287781218 shutdown_connections 2024-09-10T08:47:54.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.439+0000 7f5023e00640 1 -- 172.21.15.2:0/1287781218 wait complete. 2024-09-10T08:47:54.456 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:47:54.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.612+0000 7f2aaa800640 1 Processor -- start 2024-09-10T08:47:54.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.612+0000 7f2aaa800640 1 -- start start 2024-09-10T08:47:54.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.613+0000 7f2aaa800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2aa4067d30 0x7f2aa40b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:54.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.613+0000 7f2aaa800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2aa40b41e0 0x7f2aa40b4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:54.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.613+0000 7f2aaa800640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2aa406ea10 con 0x7f2aa4067950 2024-09-10T08:47:54.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.613+0000 7f2aaa800640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f2aa406f620 con 0x7f2aa40b41e0 2024-09-10T08:47:54.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.613+0000 7f2aaa800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2aa406ecf0 con 0x7f2aa4067d30 2024-09-10T08:47:54.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.614+0000 7f2aa3e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2aa40b41e0 0x7f2aa40b4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:54.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.614+0000 7f2aa3e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2aa40b41e0 0x7f2aa40b4690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35808/0 (socket says 172.21.15.2:35808) 2024-09-10T08:47:54.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.614+0000 7f2aa3e00640 1 -- 172.21.15.2:0/3866388528 learned_addr learned my addr 172.21.15.2:0/3866388528 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:54.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.614+0000 7f2aa2a00640 1 --2- 172.21.15.2:0/3866388528 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2aa4067d30 0x7f2aa40b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:54.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.614+0000 7f2aa3e00640 1 -- 172.21.15.2:0/3866388528 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2aa4067d30 msgr2=0x7f2aa40b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:54.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.614+0000 7f2aa3e00640 1 --2- 172.21.15.2:0/3866388528 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2aa4067d30 0x7f2aa40b3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:54.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.614+0000 7f2aa3e00640 1 -- 172.21.15.2:0/3866388528 >> v1:172.21.15.155:6789/0 conn(0x7f2aa4067950 legacy=0x7f2aa415f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:54.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.614+0000 7f2aa3e00640 1 -- 172.21.15.2:0/3866388528 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2aa406efd0 con 0x7f2aa40b41e0 2024-09-10T08:47:54.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.614+0000 7f2aa2a00640 1 --2- 172.21.15.2:0/3866388528 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2aa4067d30 0x7f2aa40b3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:47:54.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.615+0000 7f2aa3e00640 1 --2- 172.21.15.2:0/3866388528 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2aa40b41e0 0x7f2aa40b4690 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c009e50 tx=0x7f2a9c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7fb08ae04054c63 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:54.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.615+0000 7f2aa2000640 1 -- 172.21.15.2:0/3866388528 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c036070 con 0x7f2aa40b41e0 2024-09-10T08:47:54.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.615+0000 7f2aa2000640 1 -- 172.21.15.2:0/3866388528 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a9c031600 con 0x7f2aa40b41e0 2024-09-10T08:47:54.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.615+0000 7f2aa2000640 1 -- 172.21.15.2:0/3866388528 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c0319d0 con 0x7f2aa40b41e0 2024-09-10T08:47:54.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.616+0000 7f2aaa800640 1 -- 172.21.15.2:0/3866388528 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2aa40b41e0 msgr2=0x7f2aa40b4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:54.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.616+0000 7f2aaa800640 1 --2- 172.21.15.2:0/3866388528 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2aa40b41e0 0x7f2aa40b4690 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c009e50 tx=0x7f2a9c02a6a0 comp rx=0 tx=0).stop 2024-09-10T08:47:54.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.616+0000 7f2aaa800640 1 -- 172.21.15.2:0/3866388528 shutdown_connections 2024-09-10T08:47:54.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.616+0000 7f2aaa800640 1 --2- 172.21.15.2:0/3866388528 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2aa4067d30 0x7f2aa40b3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:54.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.616+0000 7f2aaa800640 1 --2- 172.21.15.2:0/3866388528 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2aa40b41e0 0x7f2aa40b4690 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:54.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.616+0000 7f2aaa800640 1 -- 172.21.15.2:0/3866388528 >> 172.21.15.2:0/3866388528 conn(0x7f2aa40735e0 msgr2=0x7f2aa406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:54.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.616+0000 7f2aaa800640 1 -- 172.21.15.2:0/3866388528 shutdown_connections 2024-09-10T08:47:54.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.616+0000 7f2aaa800640 1 -- 172.21.15.2:0/3866388528 wait complete. 2024-09-10T08:47:54.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.618+0000 7f2aaa800640 1 Processor -- start 2024-09-10T08:47:54.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.618+0000 7f2aaa800640 1 -- start start 2024-09-10T08:47:54.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.619+0000 7f2aaa800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2aa4067950 0x7f2aa4140df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:54.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.619+0000 7f2aaa800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2aa4067d30 0x7f2aa41590b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:54.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.619+0000 7f2aaa800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2aa40b41e0 0x7f2aa4157bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:54.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.619+0000 7f2aaa800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2aa4068170 con 0x7f2aa40b41e0 2024-09-10T08:47:54.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.619+0000 7f2aaa800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2aa406e700 con 0x7f2aa4067950 2024-09-10T08:47:54.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.619+0000 7f2aaa800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2aa4151810 con 0x7f2aa4067d30 2024-09-10T08:47:54.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.619+0000 7f2aa3e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2aa40b41e0 0x7f2aa4157bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:54.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.619+0000 7f2aa3400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2aa4067950 0x7f2aa4140df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:54.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.619+0000 7f2aa3e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2aa40b41e0 0x7f2aa4157bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35816/0 (socket says 172.21.15.2:35816) 2024-09-10T08:47:54.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.619+0000 7f2aa3e00640 1 -- 172.21.15.2:0/926546065 learned_addr learned my addr 172.21.15.2:0/926546065 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:54.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.619+0000 7f2aa2a00640 1 --2- 172.21.15.2:0/926546065 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2aa4067d30 0x7f2aa41590b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:54.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.619+0000 7f2aa3e00640 1 -- 172.21.15.2:0/926546065 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2aa4067d30 msgr2=0x7f2aa41590b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:54.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.619+0000 7f2aa3e00640 1 --2- 172.21.15.2:0/926546065 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2aa4067d30 0x7f2aa41590b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:54.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.619+0000 7f2aa3e00640 1 -- 172.21.15.2:0/926546065 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2aa4067950 msgr2=0x7f2aa4140df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:54.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.619+0000 7f2aa3e00640 1 --2- 172.21.15.2:0/926546065 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2aa4067950 0x7f2aa4140df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:54.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.619+0000 7f2aa3e00640 1 -- 172.21.15.2:0/926546065 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2aa41539e0 con 0x7f2aa40b41e0 2024-09-10T08:47:54.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.620+0000 7f2aa3e00640 1 --2- 172.21.15.2:0/926546065 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2aa40b41e0 0x7f2aa4157bf0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c009f70 tx=0x7f2a9c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:54.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.620+0000 7f2a9b400640 1 -- 172.21.15.2:0/926546065 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c03f020 con 0x7f2aa40b41e0 2024-09-10T08:47:54.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.620+0000 7f2a9b400640 1 -- 172.21.15.2:0/926546065 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a9c037040 con 0x7f2aa40b41e0 2024-09-10T08:47:54.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.620+0000 7f2aaa800640 1 -- 172.21.15.2:0/926546065 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2aa4151530 con 0x7f2aa40b41e0 2024-09-10T08:47:54.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.620+0000 7f2a9b400640 1 -- 172.21.15.2:0/926546065 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c036070 con 0x7f2aa40b41e0 2024-09-10T08:47:54.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.620+0000 7f2aaa800640 1 -- 172.21.15.2:0/926546065 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2aa4141330 con 0x7f2aa40b41e0 2024-09-10T08:47:54.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.621+0000 7f2aaa800640 1 -- 172.21.15.2:0/926546065 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2aa40704b0 con 0x7f2aa40b41e0 2024-09-10T08:47:54.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.622+0000 7f2a9b400640 1 -- 172.21.15.2:0/926546065 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2a9c042020 con 0x7f2aa40b41e0 2024-09-10T08:47:54.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.623+0000 7f2a9b400640 1 --2- 172.21.15.2:0/926546065 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f2a8406be30 0x7f2a8406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:54.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.623+0000 7f2a9b400640 1 -- 172.21.15.2:0/926546065 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f2a9c0ab3f0 con 0x7f2aa40b41e0 2024-09-10T08:47:54.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.624+0000 7f2aa3400640 1 --2- 172.21.15.2:0/926546065 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f2a8406be30 0x7f2a8406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:54.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.624+0000 7f2aa3400640 1 --2- 172.21.15.2:0/926546065 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f2a8406be30 0x7f2a8406e2f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2a94001780 tx=0x7f2a94009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:54.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.628+0000 7f2a9b400640 1 -- 172.21.15.2:0/926546065 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2a9c049030 con 0x7f2aa40b41e0 2024-09-10T08:47:54.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.811+0000 7f2aaa800640 1 -- 172.21.15.2:0/926546065 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2aa406c550 con 0x7f2aa40b41e0 2024-09-10T08:47:54.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.813+0000 7f2a9b400640 1 -- 172.21.15.2:0/926546065 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) ==== 74+0+16955 (secure 0 0 0) 0x7f2a9c079530 con 0x7f2aa40b41e0 2024-09-10T08:47:54.813 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:47:54.813 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":37,"fsid":"f20a15a7-d363-4d44-98cb-4f4f466b52b8","created":"2024-09-10T08:46:26.481619+0000","modified":"2024-09-10T08:47:53.446412+0000","last_up_change":"2024-09-10T08:46:39.323912+0000","last_in_change":"2024-09-10T08:46:29.499894+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:46:39.426180+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:47:51.804125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-10T08:47:52.436532+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c90be333-506b-46d1-b00a-10d089a84776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6822","nonce":298678486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6823","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6826","nonce":298678486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6831","nonce":298678486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6829","nonce":298678486}]},"public_addr":"172.21.15.2:6822/298678486","cluster_addr":"172.21.15.2:6826/298678486","heartbeat_back_addr":"172.21.15.2:6831/298678486","heartbeat_front_addr":"172.21.15.2:6829/298678486","state":["exists","up"]},{"osd":1,"uuid":"3f8bdde8-6cd3-4112-8939-a876191c7368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6809","nonce":1619566025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6811","nonce":1619566025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6815","nonce":1619566025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6813","nonce":1619566025}]},"public_addr":"172.21.15.2:6809/1619566025","cluster_addr":"172.21.15.2:6811/1619566025","heartbeat_back_addr":"172.21.15.2:6815/1619566025","heartbeat_front_addr":"172.21.15.2:6813/1619566025","state":["exists","up"]},{"osd":2,"uuid":"3835f5ab-ed3a-4f46-ae6c-f0edf21708d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6801","nonce":3992427579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6803","nonce":3992427579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6807","nonce":3992427579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6805","nonce":3992427579}]},"public_addr":"172.21.15.2:6801/3992427579","cluster_addr":"172.21.15.2:6803/3992427579","heartbeat_back_addr":"172.21.15.2:6807/3992427579","heartbeat_front_addr":"172.21.15.2:6805/3992427579","state":["exists","up"]},{"osd":3,"uuid":"add6ad27-b411-4a82-9622-b0c1c1782cf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6817","nonce":1270626884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6819","nonce":1270626884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6827","nonce":1270626884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6824","nonce":1270626884}]},"public_addr":"172.21.15.2:6817/1270626884","cluster_addr":"172.21.15.2:6819/1270626884","heartbeat_back_addr":"172.21.15.2:6827/1270626884","heartbeat_front_addr":"172.21.15.2:6824/1270626884","state":["exists","up"]},{"osd":4,"uuid":"c7b642f4-8bd2-4262-9a82-ee1061cfab7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6803","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6806","nonce":553254873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6813","nonce":553254873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6822","nonce":553254873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6819","nonce":553254873}]},"public_addr":"172.21.15.155:6806/553254873","cluster_addr":"172.21.15.155:6813/553254873","heartbeat_back_addr":"172.21.15.155:6822/553254873","heartbeat_front_addr":"172.21.15.155:6819/553254873","state":["exists","up"]},{"osd":5,"uuid":"fb53289a-419f-46d8-9e3a-384ac529dc57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6805","nonce":2107688472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6811","nonce":2107688472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6823","nonce":2107688472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6817","nonce":2107688472}]},"public_addr":"172.21.15.155:6805/2107688472","cluster_addr":"172.21.15.155:6811/2107688472","heartbeat_back_addr":"172.21.15.155:6823/2107688472","heartbeat_front_addr":"172.21.15.155:6817/2107688472","state":["exists","up"]},{"osd":6,"uuid":"3f9ddd54-ede4-4565-aff6-ae1c07e7c678","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6825","nonce":944542383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6827","nonce":944542383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6831","nonce":944542383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6829","nonce":944542383}]},"public_addr":"172.21.15.155:6825/944542383","cluster_addr":"172.21.15.155:6827/944542383","heartbeat_back_addr":"172.21.15.155:6831/944542383","heartbeat_front_addr":"172.21.15.155:6829/944542383","state":["exists","up"]},{"osd":7,"uuid":"328d0681-eef4-4556-94e1-9745bd4adbe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6801","nonce":2220093913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6807","nonce":2220093913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6818","nonce":2220093913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6812","nonce":2220093913}]},"public_addr":"172.21.15.155:6801/2220093913","cluster_addr":"172.21.15.155:6807/2220093913","heartbeat_back_addr":"172.21.15.155:6818/2220093913","heartbeat_front_addr":"172.21.15.155:6812/2220093913","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.052980+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.104550+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.025661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:35.784354+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:35.863363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.322312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.100890+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:35.763584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:47:54.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.815+0000 7f2aaa800640 1 -- 172.21.15.2:0/926546065 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f2a8406be30 msgr2=0x7f2a8406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:54.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.815+0000 7f2aaa800640 1 --2- 172.21.15.2:0/926546065 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f2a8406be30 0x7f2a8406e2f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2a94001780 tx=0x7f2a94009040 comp rx=0 tx=0).stop 2024-09-10T08:47:54.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.815+0000 7f2aaa800640 1 -- 172.21.15.2:0/926546065 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2aa40b41e0 msgr2=0x7f2aa4157bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:54.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.815+0000 7f2aaa800640 1 --2- 172.21.15.2:0/926546065 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2aa40b41e0 0x7f2aa4157bf0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c009f70 tx=0x7f2a9c004a40 comp rx=0 tx=0).stop 2024-09-10T08:47:54.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.815+0000 7f2aaa800640 1 -- 172.21.15.2:0/926546065 shutdown_connections 2024-09-10T08:47:54.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.815+0000 7f2aaa800640 1 --2- 172.21.15.2:0/926546065 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2aa40b41e0 0x7f2aa4157bf0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:54.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.815+0000 7f2aaa800640 1 --2- 172.21.15.2:0/926546065 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f2a8406be30 0x7f2a8406e2f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:54.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.815+0000 7f2aaa800640 1 --2- 172.21.15.2:0/926546065 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2aa4067d30 0x7f2aa41590b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:54.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.815+0000 7f2aaa800640 1 --2- 172.21.15.2:0/926546065 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2aa4067950 0x7f2aa4140df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:54.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.815+0000 7f2aaa800640 1 -- 172.21.15.2:0/926546065 >> 172.21.15.2:0/926546065 conn(0x7f2aa40735e0 msgr2=0x7f2aa406ca70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:54.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.815+0000 7f2aaa800640 1 -- 172.21.15.2:0/926546065 shutdown_connections 2024-09-10T08:47:54.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.815+0000 7f2aaa800640 1 -- 172.21.15.2:0/926546065 wait complete. 2024-09-10T08:47:54.832 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-10T08:47:54.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.991+0000 7f9a7c800640 1 Processor -- start 2024-09-10T08:47:54.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.991+0000 7f9a7c800640 1 -- start start 2024-09-10T08:47:54.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.992+0000 7f9a7c800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a7415b4c0 0x7f9a740cf6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:54.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.992+0000 7f9a7c800640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9a740af590 0x7f9a7406f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:54.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.992+0000 7f9a7c800640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a740af160 con 0x7f9a7406f5a0 2024-09-10T08:47:54.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.992+0000 7f9a7c800640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f9a740d1130 con 0x7f9a740af590 2024-09-10T08:47:54.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.992+0000 7f9a7c800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9a740ad140 con 0x7f9a7415b4c0 2024-09-10T08:47:54.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.992+0000 7f9a7a800640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f9a7406f5a0 0x7f9a740ce5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:52052/0 (socket says 172.21.15.2:52052) 2024-09-10T08:47:54.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.992+0000 7f9a7a800640 1 -- 172.21.15.2:0/4142532652 learned_addr learned my addr 172.21.15.2:0/4142532652 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:47:54.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.992+0000 7f9a79e00640 1 --2- 172.21.15.2:0/4142532652 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a7415b4c0 0x7f9a740cf6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:54.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.992+0000 7f9a79400640 1 --2- 172.21.15.2:0/4142532652 >> v2:172.21.15.155:3300/0 conn(0x7f9a740af590 0x7f9a7406f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:54.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.993+0000 7f9a78a00640 1 -- 172.21.15.2:0/4142532652 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1655444224 0 0) 0x7f9a740af160 con 0x7f9a7406f5a0 2024-09-10T08:47:54.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.993+0000 7f9a78a00640 1 -- 172.21.15.2:0/4142532652 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a5c003520 con 0x7f9a7406f5a0 2024-09-10T08:47:54.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.993+0000 7f9a79e00640 1 -- 172.21.15.2:0/4142532652 >> v2:172.21.15.155:3300/0 conn(0x7f9a740af590 msgr2=0x7f9a7406f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:54.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.993+0000 7f9a79e00640 1 --2- 172.21.15.2:0/4142532652 >> v2:172.21.15.155:3300/0 conn(0x7f9a740af590 0x7f9a7406f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:54.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.993+0000 7f9a79e00640 1 -- 172.21.15.2:0/4142532652 >> v1:172.21.15.2:6789/0 conn(0x7f9a7406f5a0 legacy=0x7f9a740ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:54.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.993+0000 7f9a79e00640 1 -- 172.21.15.2:0/4142532652 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a740ad390 con 0x7f9a7415b4c0 2024-09-10T08:47:54.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.994+0000 7f9a79e00640 1 --2- 172.21.15.2:0/4142532652 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a7415b4c0 0x7f9a740cf6d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9a6800b850 tx=0x7f9a6802a5a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c2d7dea8c98a67 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:54.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.994+0000 7f9a78a00640 1 -- 172.21.15.2:0/4142532652 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a6802f710 con 0x7f9a7415b4c0 2024-09-10T08:47:54.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.994+0000 7f9a78a00640 1 -- 172.21.15.2:0/4142532652 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a6802f8b0 con 0x7f9a7415b4c0 2024-09-10T08:47:54.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.994+0000 7f9a78a00640 1 -- 172.21.15.2:0/4142532652 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a6802fc60 con 0x7f9a7415b4c0 2024-09-10T08:47:54.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.995+0000 7f9a7c800640 1 -- 172.21.15.2:0/4142532652 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a7415b4c0 msgr2=0x7f9a740cf6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:54.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.995+0000 7f9a7c800640 1 --2- 172.21.15.2:0/4142532652 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a7415b4c0 0x7f9a740cf6d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9a6800b850 tx=0x7f9a6802a5a0 comp rx=0 tx=0).stop 2024-09-10T08:47:54.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.995+0000 7f9a7c800640 1 -- 172.21.15.2:0/4142532652 shutdown_connections 2024-09-10T08:47:54.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.995+0000 7f9a7c800640 1 --2- 172.21.15.2:0/4142532652 >> v2:172.21.15.155:3300/0 conn(0x7f9a740af590 0x7f9a7406f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:54.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.995+0000 7f9a7c800640 1 --2- 172.21.15.2:0/4142532652 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a7415b4c0 0x7f9a740cf6d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:54.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.995+0000 7f9a7c800640 1 -- 172.21.15.2:0/4142532652 >> 172.21.15.2:0/4142532652 conn(0x7f9a740d02c0 msgr2=0x7f9a740d06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:54.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.995+0000 7f9a7c800640 1 -- 172.21.15.2:0/4142532652 shutdown_connections 2024-09-10T08:47:54.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.995+0000 7f9a7c800640 1 -- 172.21.15.2:0/4142532652 wait complete. 2024-09-10T08:47:54.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.996+0000 7f9a7c800640 1 Processor -- start 2024-09-10T08:47:54.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.997+0000 7f9a7c800640 1 -- start start 2024-09-10T08:47:54.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.997+0000 7f9a7c800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a7406f5a0 0x7f9a74149860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:54.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.997+0000 7f9a7c800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a740af590 0x7f9a741f0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:54.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.997+0000 7f9a7c800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a7415b4c0 0x7f9a740ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:54.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.997+0000 7f9a7c800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9a740ad950 con 0x7f9a7415b4c0 2024-09-10T08:47:54.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.998+0000 7f9a7c800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9a740af9d0 con 0x7f9a740af590 2024-09-10T08:47:54.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.998+0000 7f9a7c800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9a740adc30 con 0x7f9a7406f5a0 2024-09-10T08:47:54.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.998+0000 7f9a7a800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a7415b4c0 0x7f9a740ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:54.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.998+0000 7f9a79e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a7406f5a0 0x7f9a74149860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:54.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.998+0000 7f9a79400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a740af590 0x7f9a741f0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:54.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.998+0000 7f9a7a800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a7415b4c0 0x7f9a740ce5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35832/0 (socket says 172.21.15.2:35832) 2024-09-10T08:47:54.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.998+0000 7f9a7a800640 1 -- 172.21.15.2:0/4089320865 learned_addr learned my addr 172.21.15.2:0/4089320865 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:54.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.998+0000 7f9a7a800640 1 -- 172.21.15.2:0/4089320865 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a7406f5a0 msgr2=0x7f9a74149860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:54.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.998+0000 7f9a7a800640 1 --2- 172.21.15.2:0/4089320865 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a7406f5a0 0x7f9a74149860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:54.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.998+0000 7f9a7a800640 1 -- 172.21.15.2:0/4089320865 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a740af590 msgr2=0x7f9a741f0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:55.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.998+0000 7f9a7a800640 1 --2- 172.21.15.2:0/4089320865 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a740af590 0x7f9a741f0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:55.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.998+0000 7f9a7a800640 1 -- 172.21.15.2:0/4089320865 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a741f0f40 con 0x7f9a7415b4c0 2024-09-10T08:47:55.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.999+0000 7f9a7a800640 1 --2- 172.21.15.2:0/4089320865 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a7415b4c0 0x7f9a740ce5a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9a7000cb70 tx=0x7f9a7000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:55.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.999+0000 7f9a6e000640 1 -- 172.21.15.2:0/4089320865 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a70017070 con 0x7f9a7415b4c0 2024-09-10T08:47:55.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.999+0000 7f9a6e000640 1 -- 172.21.15.2:0/4089320865 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a7000ace0 con 0x7f9a7415b4c0 2024-09-10T08:47:55.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.999+0000 7f9a6e000640 1 -- 172.21.15.2:0/4089320865 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a70012620 con 0x7f9a7415b4c0 2024-09-10T08:47:55.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.999+0000 7f9a7c800640 1 -- 172.21.15.2:0/4089320865 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a741493c0 con 0x7f9a7415b4c0 2024-09-10T08:47:55.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:54.999+0000 7f9a7c800640 1 -- 172.21.15.2:0/4089320865 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a741488e0 con 0x7f9a7415b4c0 2024-09-10T08:47:55.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:55.000+0000 7f9a7c800640 1 -- 172.21.15.2:0/4089320865 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a74071ef0 con 0x7f9a7415b4c0 2024-09-10T08:47:55.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:55.001+0000 7f9a6e000640 1 -- 172.21.15.2:0/4089320865 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9a7001a070 con 0x7f9a7415b4c0 2024-09-10T08:47:55.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:55.002+0000 7f9a6e000640 1 --2- 172.21.15.2:0/4089320865 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f9a5806be60 0x7f9a5806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:55.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:55.003+0000 7f9a6e000640 1 -- 172.21.15.2:0/4089320865 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6101+0+0 (secure 0 0 0) 0x7f9a7008ad20 con 0x7f9a7415b4c0 2024-09-10T08:47:55.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:55.003+0000 7f9a79e00640 1 --2- 172.21.15.2:0/4089320865 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f9a5806be60 0x7f9a5806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:55.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:55.004+0000 7f9a79e00640 1 --2- 172.21.15.2:0/4089320865 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f9a5806be60 0x7f9a5806e320 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9a68034000 tx=0x7f9a6802f000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:55.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:55.007+0000 7f9a6e000640 1 -- 172.21.15.2:0/4089320865 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9a741f0f40 con 0x7f9a7415b4c0 2024-09-10T08:47:55.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:55.235+0000 7f9a7c800640 1 -- 172.21.15.2:0/4089320865 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f9a7415ec70 con 0x7f9a7415b4c0 2024-09-10T08:47:56.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.037+0000 7f9a6e000640 1 -- 172.21.15.2:0/4089320865 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7f9a70058ee0 con 0x7f9a7415b4c0 2024-09-10T08:47:56.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.040+0000 7f9a7c800640 1 -- 172.21.15.2:0/4089320865 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f9a5806be60 msgr2=0x7f9a5806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:56.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.040+0000 7f9a7c800640 1 --2- 172.21.15.2:0/4089320865 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f9a5806be60 0x7f9a5806e320 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9a68034000 tx=0x7f9a6802f000 comp rx=0 tx=0).stop 2024-09-10T08:47:56.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.040+0000 7f9a7c800640 1 -- 172.21.15.2:0/4089320865 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a7415b4c0 msgr2=0x7f9a740ce5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:56.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.040+0000 7f9a7c800640 1 --2- 172.21.15.2:0/4089320865 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a7415b4c0 0x7f9a740ce5a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9a7000cb70 tx=0x7f9a7000a430 comp rx=0 tx=0).stop 2024-09-10T08:47:56.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.040+0000 7f9a7c800640 1 -- 172.21.15.2:0/4089320865 shutdown_connections 2024-09-10T08:47:56.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.040+0000 7f9a7c800640 1 --2- 172.21.15.2:0/4089320865 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9a7415b4c0 0x7f9a740ce5a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:56.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.040+0000 7f9a7c800640 1 --2- 172.21.15.2:0/4089320865 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a740af590 0x7f9a741f0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:56.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.040+0000 7f9a7c800640 1 --2- 172.21.15.2:0/4089320865 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f9a5806be60 0x7f9a5806e320 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:56.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.040+0000 7f9a7c800640 1 --2- 172.21.15.2:0/4089320865 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9a7406f5a0 0x7f9a74149860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:56.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.040+0000 7f9a7c800640 1 -- 172.21.15.2:0/4089320865 >> 172.21.15.2:0/4089320865 conn(0x7f9a740d02c0 msgr2=0x7f9a7406e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:56.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.040+0000 7f9a7c800640 1 -- 172.21.15.2:0/4089320865 shutdown_connections 2024-09-10T08:47:56.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.040+0000 7f9a7c800640 1 -- 172.21.15.2:0/4089320865 wait complete. 2024-09-10T08:47:56.060 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-10T08:47:56.060 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-10T08:47:56.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.222+0000 7f4f85000640 1 Processor -- start 2024-09-10T08:47:56.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.222+0000 7f4f85000640 1 -- start start 2024-09-10T08:47:56.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.223+0000 7f4f85000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f8006eb00 0x7f4f8009aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:56.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.223+0000 7f4f85000640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4f800cd4b0 0x7f4f8009af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:56.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.223+0000 7f4f85000640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f800d08f0 con 0x7f4f8015e6a0 2024-09-10T08:47:56.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.223+0000 7f4f85000640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f4f800ce630 con 0x7f4f800cd4b0 2024-09-10T08:47:56.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.223+0000 7f4f85000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4f800cda20 con 0x7f4f8006eb00 2024-09-10T08:47:56.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.223+0000 7f4f7d400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f8006eb00 0x7f4f8009aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:56.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.223+0000 7f4f7d400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f8006eb00 0x7f4f8009aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.2:40342/0 (socket says 172.21.15.2:40342) 2024-09-10T08:47:56.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.223+0000 7f4f7de00640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f4f8015e6a0 0x7f4f800d01e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.2:39386/0 (socket says 172.21.15.2:39386) 2024-09-10T08:47:56.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.224+0000 7f4f7de00640 1 -- 172.21.15.2:0/825494650 learned_addr learned my addr 172.21.15.2:0/825494650 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:47:56.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.224+0000 7f4f7e800640 1 --2- 172.21.15.2:0/825494650 >> v2:172.21.15.155:3300/0 conn(0x7f4f800cd4b0 0x7f4f8009af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:56.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.224+0000 7f4f7ca00640 1 -- 172.21.15.2:0/825494650 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1080105488 0 0) 0x7f4f800d08f0 con 0x7f4f8015e6a0 2024-09-10T08:47:56.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.224+0000 7f4f7ca00640 1 -- 172.21.15.2:0/825494650 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f64003520 con 0x7f4f8015e6a0 2024-09-10T08:47:56.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.224+0000 7f4f7e800640 1 -- 172.21.15.2:0/825494650 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f8006eb00 msgr2=0x7f4f8009aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:56.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.224+0000 7f4f7e800640 1 --2- 172.21.15.2:0/825494650 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f8006eb00 0x7f4f8009aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:56.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.224+0000 7f4f7e800640 1 -- 172.21.15.2:0/825494650 >> v1:172.21.15.155:6789/0 conn(0x7f4f8015e6a0 legacy=0x7f4f800d01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:56.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.224+0000 7f4f7e800640 1 -- 172.21.15.2:0/825494650 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f800cdd00 con 0x7f4f800cd4b0 2024-09-10T08:47:56.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.225+0000 7f4f7e800640 1 --2- 172.21.15.2:0/825494650 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f800cd4b0 0x7f4f8009af80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4f78009d90 tx=0x7f4f7802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=106a1dae0bdcf0c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:56.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.226+0000 7f4f7ca00640 1 -- 172.21.15.2:0/825494650 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f78007740 con 0x7f4f800cd4b0 2024-09-10T08:47:56.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.226+0000 7f4f7ca00640 1 -- 172.21.15.2:0/825494650 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f780078e0 con 0x7f4f800cd4b0 2024-09-10T08:47:56.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.226+0000 7f4f7ca00640 1 -- 172.21.15.2:0/825494650 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f78007cb0 con 0x7f4f800cd4b0 2024-09-10T08:47:56.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.226+0000 7f4f85000640 1 -- 172.21.15.2:0/825494650 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f800cd4b0 msgr2=0x7f4f8009af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:56.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.226+0000 7f4f85000640 1 --2- 172.21.15.2:0/825494650 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f800cd4b0 0x7f4f8009af80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4f78009d90 tx=0x7f4f7802a660 comp rx=0 tx=0).stop 2024-09-10T08:47:56.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.226+0000 7f4f85000640 1 -- 172.21.15.2:0/825494650 shutdown_connections 2024-09-10T08:47:56.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.226+0000 7f4f85000640 1 --2- 172.21.15.2:0/825494650 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f800cd4b0 0x7f4f8009af80 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:56.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.226+0000 7f4f85000640 1 --2- 172.21.15.2:0/825494650 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f8006eb00 0x7f4f8009aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:56.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.226+0000 7f4f85000640 1 -- 172.21.15.2:0/825494650 >> 172.21.15.2:0/825494650 conn(0x7f4f800b3ed0 msgr2=0x7f4f800b42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:56.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.226+0000 7f4f85000640 1 -- 172.21.15.2:0/825494650 shutdown_connections 2024-09-10T08:47:56.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.226+0000 7f4f85000640 1 -- 172.21.15.2:0/825494650 wait complete. 2024-09-10T08:47:56.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.228+0000 7f4f85000640 1 Processor -- start 2024-09-10T08:47:56.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.228+0000 7f4f85000640 1 -- start start 2024-09-10T08:47:56.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.229+0000 7f4f85000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f8006eb00 0x7f4f8015b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:56.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.229+0000 7f4f85000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f800cd4b0 0x7f4f8015f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:56.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.229+0000 7f4f85000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f8015e6a0 0x7f4f8009ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:56.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.229+0000 7f4f85000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4f8015ea80 con 0x7f4f8015e6a0 2024-09-10T08:47:56.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.229+0000 7f4f85000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4f800ce2c0 con 0x7f4f800cd4b0 2024-09-10T08:47:56.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.229+0000 7f4f85000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4f80168510 con 0x7f4f8006eb00 2024-09-10T08:47:56.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.229+0000 7f4f7e800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f8015e6a0 0x7f4f8009ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:56.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.229+0000 7f4f7d400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f800cd4b0 0x7f4f8015f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:56.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.229+0000 7f4f7de00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f8006eb00 0x7f4f8015b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:56.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.229+0000 7f4f7d400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f800cd4b0 0x7f4f8015f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.2:47428/0 (socket says 172.21.15.2:47428) 2024-09-10T08:47:56.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.229+0000 7f4f7d400640 1 -- 172.21.15.2:0/3161773556 learned_addr learned my addr 172.21.15.2:0/3161773556 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:56.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.229+0000 7f4f7d400640 1 -- 172.21.15.2:0/3161773556 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f8006eb00 msgr2=0x7f4f8015b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:56.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.229+0000 7f4f7d400640 1 --2- 172.21.15.2:0/3161773556 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f8006eb00 0x7f4f8015b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:56.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.229+0000 7f4f7d400640 1 -- 172.21.15.2:0/3161773556 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f8015e6a0 msgr2=0x7f4f8009ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:56.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.230+0000 7f4f7d400640 1 --2- 172.21.15.2:0/3161773556 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f8015e6a0 0x7f4f8009ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:56.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.230+0000 7f4f7d400640 1 -- 172.21.15.2:0/3161773556 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f8015b740 con 0x7f4f800cd4b0 2024-09-10T08:47:56.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.230+0000 7f4f7d400640 1 --2- 172.21.15.2:0/3161773556 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f800cd4b0 0x7f4f8015f490 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c00e8a0 tx=0x7f4f6c00ed60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:56.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.230+0000 7f4f76000640 1 -- 172.21.15.2:0/3161773556 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f6c017070 con 0x7f4f800cd4b0 2024-09-10T08:47:56.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.230+0000 7f4f76000640 1 -- 172.21.15.2:0/3161773556 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f6c00c940 con 0x7f4f800cd4b0 2024-09-10T08:47:56.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.230+0000 7f4f85000640 1 -- 172.21.15.2:0/3161773556 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f800ca750 con 0x7f4f800cd4b0 2024-09-10T08:47:56.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.230+0000 7f4f76000640 1 -- 172.21.15.2:0/3161773556 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f6c00cd30 con 0x7f4f800cd4b0 2024-09-10T08:47:56.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.230+0000 7f4f85000640 1 -- 172.21.15.2:0/3161773556 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f800cad10 con 0x7f4f800cd4b0 2024-09-10T08:47:56.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.231+0000 7f4f85000640 1 -- 172.21.15.2:0/3161773556 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f800d01e0 con 0x7f4f800cd4b0 2024-09-10T08:47:56.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.232+0000 7f4f76000640 1 -- 172.21.15.2:0/3161773556 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4f6c01a070 con 0x7f4f800cd4b0 2024-09-10T08:47:56.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.233+0000 7f4f76000640 1 --2- 172.21.15.2:0/3161773556 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f4f6006be60 0x7f4f6006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:56.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.233+0000 7f4f76000640 1 -- 172.21.15.2:0/3161773556 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f4f6c08aef0 con 0x7f4f800cd4b0 2024-09-10T08:47:56.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.234+0000 7f4f7de00640 1 --2- 172.21.15.2:0/3161773556 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f4f6006be60 0x7f4f6006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:56.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.234+0000 7f4f7de00640 1 --2- 172.21.15.2:0/3161773556 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f4f6006be60 0x7f4f6006e320 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4f70005880 tx=0x7f4f70009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:56.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.238+0000 7f4f76000640 1 -- 172.21.15.2:0/3161773556 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4f6c0590a0 con 0x7f4f800cd4b0 2024-09-10T08:47:56.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:56.459+0000 7f4f85000640 1 -- 172.21.15.2:0/3161773556 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f4f8006de30 con 0x7f4f800cd4b0 2024-09-10T08:47:57.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.042+0000 7f4f76000640 1 -- 172.21.15.2:0/3161773556 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v18) ==== 122+0+0 (secure 0 0 0) 0x7f4f6c05d3a0 con 0x7f4f800cd4b0 2024-09-10T08:47:57.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.044+0000 7f4f85000640 1 -- 172.21.15.2:0/3161773556 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f4f6006be60 msgr2=0x7f4f6006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:57.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.044+0000 7f4f85000640 1 --2- 172.21.15.2:0/3161773556 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f4f6006be60 0x7f4f6006e320 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4f70005880 tx=0x7f4f70009040 comp rx=0 tx=0).stop 2024-09-10T08:47:57.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.044+0000 7f4f85000640 1 -- 172.21.15.2:0/3161773556 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f800cd4b0 msgr2=0x7f4f8015f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:57.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.044+0000 7f4f85000640 1 --2- 172.21.15.2:0/3161773556 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f800cd4b0 0x7f4f8015f490 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c00e8a0 tx=0x7f4f6c00ed60 comp rx=0 tx=0).stop 2024-09-10T08:47:57.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.045+0000 7f4f85000640 1 -- 172.21.15.2:0/3161773556 shutdown_connections 2024-09-10T08:47:57.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.045+0000 7f4f85000640 1 --2- 172.21.15.2:0/3161773556 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4f8015e6a0 0x7f4f8009ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:57.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.045+0000 7f4f85000640 1 --2- 172.21.15.2:0/3161773556 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f800cd4b0 0x7f4f8015f490 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:57.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.045+0000 7f4f85000640 1 --2- 172.21.15.2:0/3161773556 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f4f6006be60 0x7f4f6006e320 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:57.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.045+0000 7f4f85000640 1 --2- 172.21.15.2:0/3161773556 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f8006eb00 0x7f4f8015b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:57.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.045+0000 7f4f85000640 1 -- 172.21.15.2:0/3161773556 >> 172.21.15.2:0/3161773556 conn(0x7f4f800b3ed0 msgr2=0x7f4f8006ca60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:57.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.045+0000 7f4f85000640 1 -- 172.21.15.2:0/3161773556 shutdown_connections 2024-09-10T08:47:57.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.045+0000 7f4f85000640 1 -- 172.21.15.2:0/3161773556 wait complete. 2024-09-10T08:47:57.065 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-10T08:47:57.065 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:47:57.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.223+0000 7f21cb800640 1 Processor -- start 2024-09-10T08:47:57.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.223+0000 7f21cb800640 1 -- start start 2024-09-10T08:47:57.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.225+0000 7f21cb800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f21c4145d20 0x7f21c415c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:57.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.225+0000 7f21cb800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21c406df80 0x7f21c4160980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:57.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.225+0000 7f21cb800640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21c406e4d0 con 0x7f21c40ccd50 2024-09-10T08:47:57.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.225+0000 7f21cb800640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f21c4146100 con 0x7f21c4145d20 2024-09-10T08:47:57.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.225+0000 7f21cb800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f21c4160ec0 con 0x7f21c406df80 2024-09-10T08:47:57.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.225+0000 7f21c9800640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f21c40ccd50 0x7f21c40ceb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:40960/0 (socket says 172.21.15.2:40960) 2024-09-10T08:47:57.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.225+0000 7f21c8e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f21c4145d20 0x7f21c415c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:57.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.225+0000 7f21c9800640 1 -- 172.21.15.2:0/1336898573 learned_addr learned my addr 172.21.15.2:0/1336898573 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:47:57.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.225+0000 7f21c3e00640 1 --2- 172.21.15.2:0/1336898573 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21c406df80 0x7f21c4160980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:57.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.225+0000 7f21c8e00640 1 -- 172.21.15.2:0/1336898573 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21c406df80 msgr2=0x7f21c4160980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:57.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.225+0000 7f21c8e00640 1 --2- 172.21.15.2:0/1336898573 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21c406df80 0x7f21c4160980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:57.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.225+0000 7f21c8e00640 1 -- 172.21.15.2:0/1336898573 >> v1:172.21.15.2:6789/0 conn(0x7f21c40ccd50 legacy=0x7f21c40ceb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:57.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.225+0000 7f21c8e00640 1 -- 172.21.15.2:0/1336898573 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21c406e7b0 con 0x7f21c4145d20 2024-09-10T08:47:57.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.225+0000 7f21c3400640 1 -- 172.21.15.2:0/1336898573 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3459344298 0 0) 0x7f21c406e4d0 con 0x7f21c40ccd50 2024-09-10T08:47:57.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.227+0000 7f21c8e00640 1 --2- 172.21.15.2:0/1336898573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21c4145d20 0x7f21c415c9e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f21b80097a0 tx=0x7f21b802a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a27184db0bcf2c1f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:57.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.227+0000 7f21c3400640 1 -- 172.21.15.2:0/1336898573 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21b8037070 con 0x7f21c4145d20 2024-09-10T08:47:57.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.227+0000 7f21c3400640 1 -- 172.21.15.2:0/1336898573 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21b802adb0 con 0x7f21c4145d20 2024-09-10T08:47:57.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.227+0000 7f21c3400640 1 -- 172.21.15.2:0/1336898573 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21b8032660 con 0x7f21c4145d20 2024-09-10T08:47:57.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.227+0000 7f21cb800640 1 -- 172.21.15.2:0/1336898573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21c4145d20 msgr2=0x7f21c415c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:57.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.227+0000 7f21cb800640 1 --2- 172.21.15.2:0/1336898573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21c4145d20 0x7f21c415c9e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f21b80097a0 tx=0x7f21b802a060 comp rx=0 tx=0).stop 2024-09-10T08:47:57.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.228+0000 7f21cb800640 1 -- 172.21.15.2:0/1336898573 shutdown_connections 2024-09-10T08:47:57.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.228+0000 7f21cb800640 1 --2- 172.21.15.2:0/1336898573 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21c406df80 0x7f21c4160980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:57.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.228+0000 7f21cb800640 1 --2- 172.21.15.2:0/1336898573 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21c4145d20 0x7f21c415c9e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:57.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.228+0000 7f21cb800640 1 -- 172.21.15.2:0/1336898573 >> 172.21.15.2:0/1336898573 conn(0x7f21c406bc10 msgr2=0x7f21c406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:57.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.228+0000 7f21cb800640 1 -- 172.21.15.2:0/1336898573 shutdown_connections 2024-09-10T08:47:57.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.228+0000 7f21cb800640 1 -- 172.21.15.2:0/1336898573 wait complete. 2024-09-10T08:47:57.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.229+0000 7f21cb800640 1 Processor -- start 2024-09-10T08:47:57.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.229+0000 7f21cb800640 1 -- start start 2024-09-10T08:47:57.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.230+0000 7f21cb800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21c406df80 0x7f21c41f2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:57.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.230+0000 7f21cb800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21c40ccd50 0x7f21c413da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:57.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.230+0000 7f21cb800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21c4145d20 0x7f21c413f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:57.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.230+0000 7f21cb800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f21c406ed70 con 0x7f21c40ccd50 2024-09-10T08:47:57.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.230+0000 7f21cb800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f21c40ce6b0 con 0x7f21c4145d20 2024-09-10T08:47:57.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.230+0000 7f21cb800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f21c40cd1e0 con 0x7f21c406df80 2024-09-10T08:47:57.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.230+0000 7f21c3e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21c40ccd50 0x7f21c413da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:57.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.230+0000 7f21c3e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21c40ccd50 0x7f21c413da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55608/0 (socket says 172.21.15.2:55608) 2024-09-10T08:47:57.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.230+0000 7f21c3e00640 1 -- 172.21.15.2:0/2556342914 learned_addr learned my addr 172.21.15.2:0/2556342914 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:57.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.231+0000 7f21c3e00640 1 -- 172.21.15.2:0/2556342914 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21c406df80 msgr2=0x7f21c41f2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:57.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.231+0000 7f21c3e00640 1 --2- 172.21.15.2:0/2556342914 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21c406df80 0x7f21c41f2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:57.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.231+0000 7f21c3e00640 1 -- 172.21.15.2:0/2556342914 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21c4145d20 msgr2=0x7f21c413f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:57.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.231+0000 7f21c9800640 1 --2- 172.21.15.2:0/2556342914 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21c4145d20 0x7f21c413f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:57.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.231+0000 7f21c3e00640 1 --2- 172.21.15.2:0/2556342914 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21c4145d20 0x7f21c413f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:57.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.231+0000 7f21c3e00640 1 -- 172.21.15.2:0/2556342914 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21c413e4d0 con 0x7f21c40ccd50 2024-09-10T08:47:57.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.231+0000 7f21c9800640 1 --2- 172.21.15.2:0/2556342914 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21c4145d20 0x7f21c413f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:47:57.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.231+0000 7f21c3e00640 1 --2- 172.21.15.2:0/2556342914 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21c40ccd50 0x7f21c413da90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f21b000e9e0 tx=0x7f21b000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:57.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.231+0000 7f21c0c00640 1 -- 172.21.15.2:0/2556342914 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21b0017070 con 0x7f21c40ccd50 2024-09-10T08:47:57.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.231+0000 7f21c0c00640 1 -- 172.21.15.2:0/2556342914 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21b000c9d0 con 0x7f21c40ccd50 2024-09-10T08:47:57.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.231+0000 7f21c0c00640 1 -- 172.21.15.2:0/2556342914 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21b000cdc0 con 0x7f21c40ccd50 2024-09-10T08:47:57.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.231+0000 7f21cb800640 1 -- 172.21.15.2:0/2556342914 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21c413e770 con 0x7f21c40ccd50 2024-09-10T08:47:57.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.232+0000 7f21cb800640 1 -- 172.21.15.2:0/2556342914 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21c413ed30 con 0x7f21c40ccd50 2024-09-10T08:47:57.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.233+0000 7f21cb800640 1 -- 172.21.15.2:0/2556342914 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21c40cd610 con 0x7f21c40ccd50 2024-09-10T08:47:57.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.234+0000 7f21c0c00640 1 -- 172.21.15.2:0/2556342914 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f21b001a070 con 0x7f21c40ccd50 2024-09-10T08:47:57.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.234+0000 7f21c0c00640 1 --2- 172.21.15.2:0/2556342914 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f21a406be30 0x7f21a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:57.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.234+0000 7f21c0c00640 1 -- 172.21.15.2:0/2556342914 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f21b008b460 con 0x7f21c40ccd50 2024-09-10T08:47:57.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.235+0000 7f21c8e00640 1 --2- 172.21.15.2:0/2556342914 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f21a406be30 0x7f21a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:57.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.236+0000 7f21c8e00640 1 --2- 172.21.15.2:0/2556342914 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f21a406be30 0x7f21a406e2f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f21b8034000 tx=0x7f21b802c000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:57.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.239+0000 7f21c0c00640 1 -- 172.21.15.2:0/2556342914 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f21b0059be0 con 0x7f21c40ccd50 2024-09-10T08:47:57.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.461+0000 7f21cb800640 1 -- 172.21.15.2:0/2556342914 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f21c415fdd0 con 0x7f21c40ccd50 2024-09-10T08:47:57.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.461+0000 7f21c0c00640 1 -- 172.21.15.2:0/2556342914 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5217 (secure 0 0 0) 0x7f21b00594e0 con 0x7f21c40ccd50 2024-09-10T08:47:57.463 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:47:57.463 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":18,"btime":"2024-09-10T08:47:57:038981+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4634,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3082437117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3082437117},{"type":"v1","addr":"172.21.15.155:6837","nonce":3082437117}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4816,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/3193521843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3193521843},{"type":"v1","addr":"172.21.15.2:6834","nonce":3193521843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4822,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/164428463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":164428463},{"type":"v1","addr":"172.21.15.155:6836","nonce":164428463}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:47:53.446893+0000","modified":"2024-09-10T08:47:56.462174+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4824},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4824":{"gid":4824,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6835/464022930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":464022930},{"type":"v1","addr":"172.21.15.2:6835","nonce":464022930}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4824,"qdb_cluster":[4824]},"id":2}]} 2024-09-10T08:47:57.463 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 18 2024-09-10T08:47:57.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.463+0000 7f21cb800640 1 -- 172.21.15.2:0/2556342914 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f21a406be30 msgr2=0x7f21a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:57.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.463+0000 7f21cb800640 1 --2- 172.21.15.2:0/2556342914 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f21a406be30 0x7f21a406e2f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f21b8034000 tx=0x7f21b802c000 comp rx=0 tx=0).stop 2024-09-10T08:47:57.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.463+0000 7f21cb800640 1 -- 172.21.15.2:0/2556342914 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21c40ccd50 msgr2=0x7f21c413da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:57.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.463+0000 7f21cb800640 1 --2- 172.21.15.2:0/2556342914 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21c40ccd50 0x7f21c413da90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f21b000e9e0 tx=0x7f21b000eea0 comp rx=0 tx=0).stop 2024-09-10T08:47:57.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.463+0000 7f21cb800640 1 -- 172.21.15.2:0/2556342914 shutdown_connections 2024-09-10T08:47:57.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.463+0000 7f21cb800640 1 --2- 172.21.15.2:0/2556342914 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21c4145d20 0x7f21c413f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:57.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.463+0000 7f21cb800640 1 --2- 172.21.15.2:0/2556342914 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f21c40ccd50 0x7f21c413da90 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:57.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.463+0000 7f21cb800640 1 --2- 172.21.15.2:0/2556342914 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f21a406be30 0x7f21a406e2f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:57.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.463+0000 7f21cb800640 1 --2- 172.21.15.2:0/2556342914 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21c406df80 0x7f21c41f2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:57.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.463+0000 7f21cb800640 1 -- 172.21.15.2:0/2556342914 >> 172.21.15.2:0/2556342914 conn(0x7f21c406bc10 msgr2=0x7f21c41605d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:57.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.463+0000 7f21cb800640 1 -- 172.21.15.2:0/2556342914 shutdown_connections 2024-09-10T08:47:57.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.464+0000 7f21cb800640 1 -- 172.21.15.2:0/2556342914 wait complete. 2024-09-10T08:47:57.481 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:47:57.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.636+0000 7fa201400640 1 Processor -- start 2024-09-10T08:47:57.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.636+0000 7fa201400640 1 -- start start 2024-09-10T08:47:57.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.637+0000 7fa201400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa1fc144250 0x7fa1fc0cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:57.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.637+0000 7fa201400640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa1fc0cd480 0x7fa1fc0ce420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:57.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.637+0000 7fa201400640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1fc06f540 con 0x7fa1fc144c90 2024-09-10T08:47:57.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.637+0000 7fa201400640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fa1fc06f820 con 0x7fa1fc0cd480 2024-09-10T08:47:57.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.638+0000 7fa201400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa1fc06fb00 con 0x7fa1fc144250 2024-09-10T08:47:57.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.638+0000 7fa1fa800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa1fc144250 0x7fa1fc0cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:57.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.638+0000 7fa1fa800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa1fc144250 0x7fa1fc0cf8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.2:40382/0 (socket says 172.21.15.2:40382) 2024-09-10T08:47:57.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.638+0000 7fa1f9e00640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fa1fc144c90 0x7fa1fc0ccd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.2:39400/0 (socket says 172.21.15.2:39400) 2024-09-10T08:47:57.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.638+0000 7fa1f9e00640 1 -- 172.21.15.2:0/961570795 learned_addr learned my addr 172.21.15.2:0/961570795 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:47:57.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.638+0000 7fa1fb200640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa1fc0cd480 0x7fa1fc0ce420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:57.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.639+0000 7fa1fa800640 1 -- 172.21.15.2:0/961570795 >> v2:172.21.15.155:3300/0 conn(0x7fa1fc0cd480 msgr2=0x7fa1fc0ce420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:47:57.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.639+0000 7fa1fa800640 1 --2- 172.21.15.2:0/961570795 >> v2:172.21.15.155:3300/0 conn(0x7fa1fc0cd480 0x7fa1fc0ce420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:57.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.639+0000 7fa1fa800640 1 -- 172.21.15.2:0/961570795 >> v1:172.21.15.155:6789/0 conn(0x7fa1fc144c90 legacy=0x7fa1fc0ccd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:57.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.639+0000 7fa1fa800640 1 -- 172.21.15.2:0/961570795 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1fc06fde0 con 0x7fa1fc144250 2024-09-10T08:47:57.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.639+0000 7fa1fb200640 1 --2- 172.21.15.2:0/961570795 >> v2:172.21.15.155:3300/0 conn(0x7fa1fc0cd480 0x7fa1fc0ce420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:47:57.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.640+0000 7fa1fa800640 1 --2- 172.21.15.2:0/961570795 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa1fc144250 0x7fa1fc0cf8d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec0097a0 tx=0x7fa1ec02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b59dc343ba890524 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:57.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.640+0000 7fa1f9400640 1 -- 172.21.15.2:0/961570795 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec037070 con 0x7fa1fc144250 2024-09-10T08:47:57.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.640+0000 7fa1f9400640 1 -- 172.21.15.2:0/961570795 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1ec032440 con 0x7fa1fc144250 2024-09-10T08:47:57.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.640+0000 7fa1f9400640 1 -- 172.21.15.2:0/961570795 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec032810 con 0x7fa1fc144250 2024-09-10T08:47:57.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.641+0000 7fa201400640 1 -- 172.21.15.2:0/961570795 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa1fc144250 msgr2=0x7fa1fc0cf8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:57.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.641+0000 7fa201400640 1 --2- 172.21.15.2:0/961570795 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa1fc144250 0x7fa1fc0cf8d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec0097a0 tx=0x7fa1ec02a180 comp rx=0 tx=0).stop 2024-09-10T08:47:57.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.641+0000 7fa201400640 1 -- 172.21.15.2:0/961570795 shutdown_connections 2024-09-10T08:47:57.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.641+0000 7fa201400640 1 --2- 172.21.15.2:0/961570795 >> v2:172.21.15.155:3300/0 conn(0x7fa1fc0cd480 0x7fa1fc0ce420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:57.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.641+0000 7fa201400640 1 --2- 172.21.15.2:0/961570795 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa1fc144250 0x7fa1fc0cf8d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:57.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.641+0000 7fa201400640 1 -- 172.21.15.2:0/961570795 >> 172.21.15.2:0/961570795 conn(0x7fa1fc06bc10 msgr2=0x7fa1fc06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:57.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.641+0000 7fa201400640 1 -- 172.21.15.2:0/961570795 shutdown_connections 2024-09-10T08:47:57.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.641+0000 7fa201400640 1 -- 172.21.15.2:0/961570795 wait complete. 2024-09-10T08:47:57.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.642+0000 7fa201400640 1 Processor -- start 2024-09-10T08:47:57.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.643+0000 7fa201400640 1 -- start start 2024-09-10T08:47:57.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.643+0000 7fa201400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa1fc0cd480 0x7fa1fc15e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:57.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.644+0000 7fa201400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1fc144250 0x7fa1fc15af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:57.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.644+0000 7fa201400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1fc144c90 0x7fa1fc15caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:57.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.644+0000 7fa201400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa1fc0b3390 con 0x7fa1fc144c90 2024-09-10T08:47:57.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.644+0000 7fa201400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa1fc0cfe10 con 0x7fa1fc144250 2024-09-10T08:47:57.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.644+0000 7fa201400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa1fc0ce960 con 0x7fa1fc0cd480 2024-09-10T08:47:57.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.644+0000 7fa1fb200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1fc144c90 0x7fa1fc15caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:57.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.644+0000 7fa1fb200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1fc144c90 0x7fa1fc15caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55614/0 (socket says 172.21.15.2:55614) 2024-09-10T08:47:57.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.644+0000 7fa1fb200640 1 -- 172.21.15.2:0/3845788314 learned_addr learned my addr 172.21.15.2:0/3845788314 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:57.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.644+0000 7fa1f9e00640 1 --2- 172.21.15.2:0/3845788314 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1fc144250 0x7fa1fc15af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:57.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.644+0000 7fa1fa800640 1 --2- 172.21.15.2:0/3845788314 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa1fc0cd480 0x7fa1fc15e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:57.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.644+0000 7fa1fb200640 1 -- 172.21.15.2:0/3845788314 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa1fc0cd480 msgr2=0x7fa1fc15e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:57.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.644+0000 7fa1fb200640 1 --2- 172.21.15.2:0/3845788314 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa1fc0cd480 0x7fa1fc15e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:57.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.644+0000 7fa1fb200640 1 -- 172.21.15.2:0/3845788314 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1fc144250 msgr2=0x7fa1fc15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:57.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.644+0000 7fa1fb200640 1 --2- 172.21.15.2:0/3845788314 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1fc144250 0x7fa1fc15af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:57.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.644+0000 7fa1fb200640 1 -- 172.21.15.2:0/3845788314 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1fc15d460 con 0x7fa1fc144c90 2024-09-10T08:47:57.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.645+0000 7fa1fb200640 1 --2- 172.21.15.2:0/3845788314 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1fc144c90 0x7fa1fc15caa0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa1f400ef90 tx=0x7fa1f4009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:57.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.645+0000 7fa1f2a00640 1 -- 172.21.15.2:0/3845788314 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f4018020 con 0x7fa1fc144c90 2024-09-10T08:47:57.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.645+0000 7fa1f2a00640 1 -- 172.21.15.2:0/3845788314 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1f4014480 con 0x7fa1fc144c90 2024-09-10T08:47:57.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.645+0000 7fa1f2a00640 1 -- 172.21.15.2:0/3845788314 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f4014870 con 0x7fa1fc144c90 2024-09-10T08:47:57.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.645+0000 7fa201400640 1 -- 172.21.15.2:0/3845788314 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1fc15d740 con 0x7fa1fc144c90 2024-09-10T08:47:57.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.645+0000 7fa201400640 1 -- 172.21.15.2:0/3845788314 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1fc15dd00 con 0x7fa1fc144c90 2024-09-10T08:47:57.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.646+0000 7fa201400640 1 -- 172.21.15.2:0/3845788314 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1fc0ce420 con 0x7fa1fc144c90 2024-09-10T08:47:57.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.647+0000 7fa1f2a00640 1 -- 172.21.15.2:0/3845788314 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa1f401b020 con 0x7fa1fc144c90 2024-09-10T08:47:57.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.648+0000 7fa1f2a00640 1 --2- 172.21.15.2:0/3845788314 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fa1dc06be30 0x7fa1dc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:57.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.648+0000 7fa1f2a00640 1 -- 172.21.15.2:0/3845788314 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7fa1f408bd40 con 0x7fa1fc144c90 2024-09-10T08:47:57.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.649+0000 7fa1fa800640 1 --2- 172.21.15.2:0/3845788314 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fa1dc06be30 0x7fa1dc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:57.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.649+0000 7fa1fa800640 1 --2- 172.21.15.2:0/3845788314 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fa1dc06be30 0x7fa1dc06e2f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec034000 tx=0x7fa1ec02e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:57.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.652+0000 7fa1f2a00640 1 -- 172.21.15.2:0/3845788314 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa1f4022020 con 0x7fa1fc144c90 2024-09-10T08:47:57.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.835+0000 7fa201400640 1 -- 172.21.15.2:0/3845788314 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa1fc15b440 con 0x7fa1fc144c90 2024-09-10T08:47:57.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.837+0000 7fa1f2a00640 1 -- 172.21.15.2:0/3845788314 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+16942 (secure 0 0 0) 0x7fa1f4010040 con 0x7fa1fc144c90 2024-09-10T08:47:57.838 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:47:57.838 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":38,"fsid":"f20a15a7-d363-4d44-98cb-4f4f466b52b8","created":"2024-09-10T08:46:26.481619+0000","modified":"2024-09-10T08:47:55.027744+0000","last_up_change":"2024-09-10T08:46:39.323912+0000","last_in_change":"2024-09-10T08:46:29.499894+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:46:39.426180+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:47:51.804125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-10T08:47:52.436532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c90be333-506b-46d1-b00a-10d089a84776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6822","nonce":298678486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6823","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6826","nonce":298678486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6831","nonce":298678486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6829","nonce":298678486}]},"public_addr":"172.21.15.2:6822/298678486","cluster_addr":"172.21.15.2:6826/298678486","heartbeat_back_addr":"172.21.15.2:6831/298678486","heartbeat_front_addr":"172.21.15.2:6829/298678486","state":["exists","up"]},{"osd":1,"uuid":"3f8bdde8-6cd3-4112-8939-a876191c7368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6809","nonce":1619566025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6811","nonce":1619566025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6815","nonce":1619566025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6813","nonce":1619566025}]},"public_addr":"172.21.15.2:6809/1619566025","cluster_addr":"172.21.15.2:6811/1619566025","heartbeat_back_addr":"172.21.15.2:6815/1619566025","heartbeat_front_addr":"172.21.15.2:6813/1619566025","state":["exists","up"]},{"osd":2,"uuid":"3835f5ab-ed3a-4f46-ae6c-f0edf21708d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6801","nonce":3992427579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6803","nonce":3992427579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6807","nonce":3992427579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6805","nonce":3992427579}]},"public_addr":"172.21.15.2:6801/3992427579","cluster_addr":"172.21.15.2:6803/3992427579","heartbeat_back_addr":"172.21.15.2:6807/3992427579","heartbeat_front_addr":"172.21.15.2:6805/3992427579","state":["exists","up"]},{"osd":3,"uuid":"add6ad27-b411-4a82-9622-b0c1c1782cf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6817","nonce":1270626884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6819","nonce":1270626884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6827","nonce":1270626884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6824","nonce":1270626884}]},"public_addr":"172.21.15.2:6817/1270626884","cluster_addr":"172.21.15.2:6819/1270626884","heartbeat_back_addr":"172.21.15.2:6827/1270626884","heartbeat_front_addr":"172.21.15.2:6824/1270626884","state":["exists","up"]},{"osd":4,"uuid":"c7b642f4-8bd2-4262-9a82-ee1061cfab7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6803","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6806","nonce":553254873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6813","nonce":553254873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6822","nonce":553254873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6819","nonce":553254873}]},"public_addr":"172.21.15.155:6806/553254873","cluster_addr":"172.21.15.155:6813/553254873","heartbeat_back_addr":"172.21.15.155:6822/553254873","heartbeat_front_addr":"172.21.15.155:6819/553254873","state":["exists","up"]},{"osd":5,"uuid":"fb53289a-419f-46d8-9e3a-384ac529dc57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6805","nonce":2107688472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6811","nonce":2107688472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6823","nonce":2107688472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6817","nonce":2107688472}]},"public_addr":"172.21.15.155:6805/2107688472","cluster_addr":"172.21.15.155:6811/2107688472","heartbeat_back_addr":"172.21.15.155:6823/2107688472","heartbeat_front_addr":"172.21.15.155:6817/2107688472","state":["exists","up"]},{"osd":6,"uuid":"3f9ddd54-ede4-4565-aff6-ae1c07e7c678","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6825","nonce":944542383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6827","nonce":944542383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6831","nonce":944542383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6829","nonce":944542383}]},"public_addr":"172.21.15.155:6825/944542383","cluster_addr":"172.21.15.155:6827/944542383","heartbeat_back_addr":"172.21.15.155:6831/944542383","heartbeat_front_addr":"172.21.15.155:6829/944542383","state":["exists","up"]},{"osd":7,"uuid":"328d0681-eef4-4556-94e1-9745bd4adbe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6801","nonce":2220093913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6807","nonce":2220093913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6818","nonce":2220093913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6812","nonce":2220093913}]},"public_addr":"172.21.15.155:6801/2220093913","cluster_addr":"172.21.15.155:6807/2220093913","heartbeat_back_addr":"172.21.15.155:6818/2220093913","heartbeat_front_addr":"172.21.15.155:6812/2220093913","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.052980+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.104550+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.025661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:35.784354+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:35.863363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.322312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.100890+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:35.763584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:47:57.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.839+0000 7fa201400640 1 -- 172.21.15.2:0/3845788314 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fa1dc06be30 msgr2=0x7fa1dc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:57.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.839+0000 7fa201400640 1 --2- 172.21.15.2:0/3845788314 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fa1dc06be30 0x7fa1dc06e2f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec034000 tx=0x7fa1ec02e000 comp rx=0 tx=0).stop 2024-09-10T08:47:57.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.839+0000 7fa201400640 1 -- 172.21.15.2:0/3845788314 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1fc144c90 msgr2=0x7fa1fc15caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:57.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.839+0000 7fa201400640 1 --2- 172.21.15.2:0/3845788314 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1fc144c90 0x7fa1fc15caa0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa1f400ef90 tx=0x7fa1f4009f90 comp rx=0 tx=0).stop 2024-09-10T08:47:57.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.839+0000 7fa201400640 1 -- 172.21.15.2:0/3845788314 shutdown_connections 2024-09-10T08:47:57.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.839+0000 7fa201400640 1 --2- 172.21.15.2:0/3845788314 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa1fc144c90 0x7fa1fc15caa0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:57.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.839+0000 7fa201400640 1 --2- 172.21.15.2:0/3845788314 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa1fc144250 0x7fa1fc15af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:57.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.839+0000 7fa201400640 1 --2- 172.21.15.2:0/3845788314 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fa1dc06be30 0x7fa1dc06e2f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:57.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.839+0000 7fa201400640 1 --2- 172.21.15.2:0/3845788314 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa1fc0cd480 0x7fa1fc15e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:57.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.839+0000 7fa201400640 1 -- 172.21.15.2:0/3845788314 >> 172.21.15.2:0/3845788314 conn(0x7fa1fc06bc10 msgr2=0x7fa1fc141e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:57.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.839+0000 7fa201400640 1 -- 172.21.15.2:0/3845788314 shutdown_connections 2024-09-10T08:47:57.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:57.839+0000 7fa201400640 1 -- 172.21.15.2:0/3845788314 wait complete. 2024-09-10T08:47:57.857 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T08:47:57.857 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:47:58.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.011+0000 7f1ffbc00640 1 Processor -- start 2024-09-10T08:47:58.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.011+0000 7f1ffbc00640 1 -- start start 2024-09-10T08:47:58.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.012+0000 7f1ffbc00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f1ff40cd460 0x7f1ff415c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:58.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.013+0000 7f1ffbc00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ff406e4d0 con 0x7f1ff4145d20 2024-09-10T08:47:58.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.013+0000 7f1ffbc00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ff406e7b0 con 0x7f1ff406df80 2024-09-10T08:47:58.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.013+0000 7f1ffbc00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f1ff4146100 con 0x7f1ff40cd460 2024-09-10T08:47:58.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.013+0000 7f1ff9200640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f1ff4145d20 0x7f1ff40ccd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:40968/0 (socket says 172.21.15.2:40968) 2024-09-10T08:47:58.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.013+0000 7f1ff9200640 1 -- 172.21.15.2:0/1638155806 learned_addr learned my addr 172.21.15.2:0/1638155806 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:47:58.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.013+0000 7f1ff3e00640 1 --2- 172.21.15.2:0/1638155806 >> v2:172.21.15.155:3300/0 conn(0x7f1ff40cd460 0x7f1ff415c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:58.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.013+0000 7f1ff3400640 1 -- 172.21.15.2:0/1638155806 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3474803342 0 0) 0x7f1ff406e4d0 con 0x7f1ff4145d20 2024-09-10T08:47:58.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.013+0000 7f1ff3400640 1 -- 172.21.15.2:0/1638155806 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1fdc003520 con 0x7f1ff4145d20 2024-09-10T08:47:58.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.013+0000 7f1ff3400640 1 -- 172.21.15.2:0/1638155806 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2023130172 0 0) 0x7f1ff406e7b0 con 0x7f1ff406df80 2024-09-10T08:47:58.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.013+0000 7f1ff3400640 1 -- 172.21.15.2:0/1638155806 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1ff406e4d0 con 0x7f1ff406df80 2024-09-10T08:47:58.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.014+0000 7f1ff3e00640 1 -- 172.21.15.2:0/1638155806 >> v1:172.21.15.155:6789/0 conn(0x7f1ff406df80 legacy=0x7f1ff40ceb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:58.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.014+0000 7f1ff3e00640 1 -- 172.21.15.2:0/1638155806 >> v1:172.21.15.2:6789/0 conn(0x7f1ff4145d20 legacy=0x7f1ff40ccd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:58.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.014+0000 7f1ff3e00640 1 -- 172.21.15.2:0/1638155806 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ff406ea90 con 0x7f1ff40cd460 2024-09-10T08:47:58.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.015+0000 7f1ff3e00640 1 --2- 172.21.15.2:0/1638155806 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ff40cd460 0x7f1ff415c9e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1fe00097a0 tx=0x7f1fe002a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb3b6656048c641a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:58.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.015+0000 7f1ff3400640 1 -- 172.21.15.2:0/1638155806 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe0037070 con 0x7f1ff40cd460 2024-09-10T08:47:58.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.015+0000 7f1ff3400640 1 -- 172.21.15.2:0/1638155806 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fe0032440 con 0x7f1ff40cd460 2024-09-10T08:47:58.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.015+0000 7f1ff3400640 1 -- 172.21.15.2:0/1638155806 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe002ae60 con 0x7f1ff40cd460 2024-09-10T08:47:58.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.015+0000 7f1ffbc00640 1 -- 172.21.15.2:0/1638155806 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ff40cd460 msgr2=0x7f1ff415c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:58.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.015+0000 7f1ffbc00640 1 --2- 172.21.15.2:0/1638155806 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ff40cd460 0x7f1ff415c9e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1fe00097a0 tx=0x7f1fe002a110 comp rx=0 tx=0).stop 2024-09-10T08:47:58.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.016+0000 7f1ffbc00640 1 -- 172.21.15.2:0/1638155806 shutdown_connections 2024-09-10T08:47:58.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.016+0000 7f1ffbc00640 1 --2- 172.21.15.2:0/1638155806 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ff40cd460 0x7f1ff415c9e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:58.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.016+0000 7f1ffbc00640 1 -- 172.21.15.2:0/1638155806 >> 172.21.15.2:0/1638155806 conn(0x7f1ff406bc10 msgr2=0x7f1ff406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:58.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.016+0000 7f1ffbc00640 1 -- 172.21.15.2:0/1638155806 shutdown_connections 2024-09-10T08:47:58.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.016+0000 7f1ffbc00640 1 -- 172.21.15.2:0/1638155806 wait complete. 2024-09-10T08:47:58.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.017+0000 7f1ffbc00640 1 Processor -- start 2024-09-10T08:47:58.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.018+0000 7f1ffbc00640 1 -- start start 2024-09-10T08:47:58.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.018+0000 7f1ffbc00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ff406df80 0x7f1ff413c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:58.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.018+0000 7f1ffbc00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ff40cd460 0x7f1ff40b1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:58.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.018+0000 7f1ffbc00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ff4145d20 0x7f1ff413bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:58.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.018+0000 7f1ffbc00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1ff4160980 con 0x7f1ff4145d20 2024-09-10T08:47:58.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.018+0000 7f1ffbc00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1ff40ce6b0 con 0x7f1ff40cd460 2024-09-10T08:47:58.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.018+0000 7f1ffbc00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1ff4160b00 con 0x7f1ff406df80 2024-09-10T08:47:58.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.019+0000 7f1ff9c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ff4145d20 0x7f1ff413bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:58.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.019+0000 7f1ff9c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ff4145d20 0x7f1ff413bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55626/0 (socket says 172.21.15.2:55626) 2024-09-10T08:47:58.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.019+0000 7f1ff9c00640 1 -- 172.21.15.2:0/2811178697 learned_addr learned my addr 172.21.15.2:0/2811178697 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:58.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.019+0000 7f1ff9200640 1 --2- 172.21.15.2:0/2811178697 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ff406df80 0x7f1ff413c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:58.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.019+0000 7f1ff3e00640 1 --2- 172.21.15.2:0/2811178697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ff40cd460 0x7f1ff40b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:58.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.019+0000 7f1ff9c00640 1 -- 172.21.15.2:0/2811178697 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ff406df80 msgr2=0x7f1ff413c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:58.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.019+0000 7f1ff9c00640 1 --2- 172.21.15.2:0/2811178697 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ff406df80 0x7f1ff413c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:58.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.019+0000 7f1ff9c00640 1 -- 172.21.15.2:0/2811178697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ff40cd460 msgr2=0x7f1ff40b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:58.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.019+0000 7f1ff9c00640 1 --2- 172.21.15.2:0/2811178697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ff40cd460 0x7f1ff40b1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:58.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.019+0000 7f1ff9c00640 1 -- 172.21.15.2:0/2811178697 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ff40b17f0 con 0x7f1ff4145d20 2024-09-10T08:47:58.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.020+0000 7f1ff9c00640 1 --2- 172.21.15.2:0/2811178697 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ff4145d20 0x7f1ff413bfa0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1fec00c790 tx=0x7f1fec00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:58.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.020+0000 7f1ff0c00640 1 -- 172.21.15.2:0/2811178697 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fec003b70 con 0x7f1ff4145d20 2024-09-10T08:47:58.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.020+0000 7f1ff0c00640 1 -- 172.21.15.2:0/2811178697 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fec003d10 con 0x7f1ff4145d20 2024-09-10T08:47:58.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.020+0000 7f1ffbc00640 1 -- 172.21.15.2:0/2811178697 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ff40b1ad0 con 0x7f1ff4145d20 2024-09-10T08:47:58.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.020+0000 7f1ff0c00640 1 -- 172.21.15.2:0/2811178697 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fec00aa50 con 0x7f1ff4145d20 2024-09-10T08:47:58.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.020+0000 7f1ffbc00640 1 -- 172.21.15.2:0/2811178697 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ff40b2090 con 0x7f1ff4145d20 2024-09-10T08:47:58.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.021+0000 7f1ffbc00640 1 -- 172.21.15.2:0/2811178697 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ff415c9e0 con 0x7f1ff4145d20 2024-09-10T08:47:58.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.022+0000 7f1ff0c00640 1 -- 172.21.15.2:0/2811178697 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1fec00abf0 con 0x7f1ff4145d20 2024-09-10T08:47:58.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.023+0000 7f1ff0c00640 1 --2- 172.21.15.2:0/2811178697 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f1fd406be30 0x7f1fd406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:58.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.023+0000 7f1ff0c00640 1 -- 172.21.15.2:0/2811178697 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f1fec08b090 con 0x7f1ff4145d20 2024-09-10T08:47:58.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.023+0000 7f1ff9200640 1 --2- 172.21.15.2:0/2811178697 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f1fd406be30 0x7f1fd406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:58.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.024+0000 7f1ff9200640 1 --2- 172.21.15.2:0/2811178697 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f1fd406be30 0x7f1fd406e2f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1fe80011e0 tx=0x7f1fe8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:58.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.027+0000 7f1ff0c00640 1 -- 172.21.15.2:0/2811178697 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1fec059810 con 0x7f1ff4145d20 2024-09-10T08:47:58.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.210+0000 7f1ffbc00640 1 -- 172.21.15.2:0/2811178697 --> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1ff40af600 con 0x7f1fd406be30 2024-09-10T08:47:58.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.218+0000 7f1ff0c00640 1 -- 172.21.15.2:0/2811178697 <== mgr.4099 v2:172.21.15.155:6832/2611418382 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251888 (secure 0 0 0) 0x7f1ff40af600 con 0x7f1fd406be30 2024-09-10T08:47:58.222 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:47:58.223 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-10T08:47:58.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.222+0000 7f1ffbc00640 1 -- 172.21.15.2:0/2811178697 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f1fd406be30 msgr2=0x7f1fd406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:58.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.222+0000 7f1ffbc00640 1 --2- 172.21.15.2:0/2811178697 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f1fd406be30 0x7f1fd406e2f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1fe80011e0 tx=0x7f1fe8009040 comp rx=0 tx=0).stop 2024-09-10T08:47:58.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.222+0000 7f1ffbc00640 1 -- 172.21.15.2:0/2811178697 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ff4145d20 msgr2=0x7f1ff413bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:58.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.222+0000 7f1ffbc00640 1 --2- 172.21.15.2:0/2811178697 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ff4145d20 0x7f1ff413bfa0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1fec00c790 tx=0x7f1fec00cc50 comp rx=0 tx=0).stop 2024-09-10T08:47:58.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.222+0000 7f1ffbc00640 1 -- 172.21.15.2:0/2811178697 shutdown_connections 2024-09-10T08:47:58.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.222+0000 7f1ffbc00640 1 --2- 172.21.15.2:0/2811178697 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1ff4145d20 0x7f1ff413bfa0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:58.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.222+0000 7f1ffbc00640 1 --2- 172.21.15.2:0/2811178697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ff40cd460 0x7f1ff40b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:58.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.222+0000 7f1ffbc00640 1 --2- 172.21.15.2:0/2811178697 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f1fd406be30 0x7f1fd406e2f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:58.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.222+0000 7f1ffbc00640 1 --2- 172.21.15.2:0/2811178697 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1ff406df80 0x7f1ff413c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:58.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.222+0000 7f1ffbc00640 1 -- 172.21.15.2:0/2811178697 >> 172.21.15.2:0/2811178697 conn(0x7f1ff406bc10 msgr2=0x7f1ff40b4ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:58.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.222+0000 7f1ffbc00640 1 -- 172.21.15.2:0/2811178697 shutdown_connections 2024-09-10T08:47:58.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.222+0000 7f1ffbc00640 1 -- 172.21.15.2:0/2811178697 wait complete. 2024-09-10T08:47:58.238 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2024-09-10T08:47:57.388204+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":99,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237364,"kb_used_data":4480,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737356,"statfs":{"total":773094113280,"available":772851052544,"internally_reserved":0,"allocated":4587520,"data_stored":2628685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.378842"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.069596+0000","last_change":"2024-09-10T08:47:54.066656+0000","last_active":"2024-09-10T08:47:54.069596+0000","last_peered":"2024-09-10T08:47:54.069596+0000","last_clean":"2024-09-10T08:47:54.069596+0000","last_became_active":"2024-09-10T08:47:54.066421+0000","last_became_peered":"2024-09-10T08:47:54.066421+0000","last_unstale":"2024-09-10T08:47:54.069596+0000","last_undegraded":"2024-09-10T08:47:54.069596+0000","last_fullsized":"2024-09-10T08:47:54.069596+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:33:33.440487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.063302+0000","last_change":"2024-09-10T08:47:54.055089+0000","last_active":"2024-09-10T08:47:54.063302+0000","last_peered":"2024-09-10T08:47:54.063302+0000","last_clean":"2024-09-10T08:47:54.063302+0000","last_became_active":"2024-09-10T08:47:54.054551+0000","last_became_peered":"2024-09-10T08:47:54.054551+0000","last_unstale":"2024-09-10T08:47:54.063302+0000","last_undegraded":"2024-09-10T08:47:54.063302+0000","last_fullsized":"2024-09-10T08:47:54.063302+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:36:08.249489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.049534+0000","last_change":"2024-09-10T08:47:54.044420+0000","last_active":"2024-09-10T08:47:54.049534+0000","last_peered":"2024-09-10T08:47:54.049534+0000","last_clean":"2024-09-10T08:47:54.049534+0000","last_became_active":"2024-09-10T08:47:54.044152+0000","last_became_peered":"2024-09-10T08:47:54.044152+0000","last_unstale":"2024-09-10T08:47:54.049534+0000","last_undegraded":"2024-09-10T08:47:54.049534+0000","last_fullsized":"2024-09-10T08:47:54.049534+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:36:25.270876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.037946+0000","last_change":"2024-09-10T08:47:54.034781+0000","last_active":"2024-09-10T08:47:54.037946+0000","last_peered":"2024-09-10T08:47:54.037946+0000","last_clean":"2024-09-10T08:47:54.037946+0000","last_became_active":"2024-09-10T08:47:54.034454+0000","last_became_peered":"2024-09-10T08:47:54.034454+0000","last_unstale":"2024-09-10T08:47:54.037946+0000","last_undegraded":"2024-09-10T08:47:54.037946+0000","last_fullsized":"2024-09-10T08:47:54.037946+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:38:32.853167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.036152+0000","last_change":"2024-09-10T08:47:54.032474+0000","last_active":"2024-09-10T08:47:54.036152+0000","last_peered":"2024-09-10T08:47:54.036152+0000","last_clean":"2024-09-10T08:47:54.036152+0000","last_became_active":"2024-09-10T08:47:54.032188+0000","last_became_peered":"2024-09-10T08:47:54.032188+0000","last_unstale":"2024-09-10T08:47:54.036152+0000","last_undegraded":"2024-09-10T08:47:54.036152+0000","last_fullsized":"2024-09-10T08:47:54.036152+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:29:16.902647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.071457+0000","last_change":"2024-09-10T08:47:54.069513+0000","last_active":"2024-09-10T08:47:54.071457+0000","last_peered":"2024-09-10T08:47:54.071457+0000","last_clean":"2024-09-10T08:47:54.071457+0000","last_became_active":"2024-09-10T08:47:54.069238+0000","last_became_peered":"2024-09-10T08:47:54.069238+0000","last_unstale":"2024-09-10T08:47:54.071457+0000","last_undegraded":"2024-09-10T08:47:54.071457+0000","last_fullsized":"2024-09-10T08:47:54.071457+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:36:44.497603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.068499+0000","last_change":"2024-09-10T08:47:54.067161+0000","last_active":"2024-09-10T08:47:54.068499+0000","last_peered":"2024-09-10T08:47:54.068499+0000","last_clean":"2024-09-10T08:47:54.068499+0000","last_became_active":"2024-09-10T08:47:54.066912+0000","last_became_peered":"2024-09-10T08:47:54.066912+0000","last_unstale":"2024-09-10T08:47:54.068499+0000","last_undegraded":"2024-09-10T08:47:54.068499+0000","last_fullsized":"2024-09-10T08:47:54.068499+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:54:47.827173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.071109+0000","last_change":"2024-09-10T08:47:54.069342+0000","last_active":"2024-09-10T08:47:54.071109+0000","last_peered":"2024-09-10T08:47:54.071109+0000","last_clean":"2024-09-10T08:47:54.071109+0000","last_became_active":"2024-09-10T08:47:54.068952+0000","last_became_peered":"2024-09-10T08:47:54.068952+0000","last_unstale":"2024-09-10T08:47:54.071109+0000","last_undegraded":"2024-09-10T08:47:54.071109+0000","last_fullsized":"2024-09-10T08:47:54.071109+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:42:06.509817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.049575+0000","last_change":"2024-09-10T08:47:54.045957+0000","last_active":"2024-09-10T08:47:54.049575+0000","last_peered":"2024-09-10T08:47:54.049575+0000","last_clean":"2024-09-10T08:47:54.049575+0000","last_became_active":"2024-09-10T08:47:54.045652+0000","last_became_peered":"2024-09-10T08:47:54.045652+0000","last_unstale":"2024-09-10T08:47:54.049575+0000","last_undegraded":"2024-09-10T08:47:54.049575+0000","last_fullsized":"2024-09-10T08:47:54.049575+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:17.824086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.060725+0000","last_change":"2024-09-10T08:47:54.056475+0000","last_active":"2024-09-10T08:47:54.060725+0000","last_peered":"2024-09-10T08:47:54.060725+0000","last_clean":"2024-09-10T08:47:54.060725+0000","last_became_active":"2024-09-10T08:47:54.055492+0000","last_became_peered":"2024-09-10T08:47:54.055492+0000","last_unstale":"2024-09-10T08:47:54.060725+0000","last_undegraded":"2024-09-10T08:47:54.060725+0000","last_fullsized":"2024-09-10T08:47:54.060725+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:19:16.826406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.053789+0000","last_change":"2024-09-10T08:47:54.049142+0000","last_active":"2024-09-10T08:47:54.053789+0000","last_peered":"2024-09-10T08:47:54.053789+0000","last_clean":"2024-09-10T08:47:54.053789+0000","last_became_active":"2024-09-10T08:47:54.047386+0000","last_became_peered":"2024-09-10T08:47:54.047386+0000","last_unstale":"2024-09-10T08:47:54.053789+0000","last_undegraded":"2024-09-10T08:47:54.053789+0000","last_fullsized":"2024-09-10T08:47:54.053789+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:18:52.134514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.049325+0000","last_change":"2024-09-10T08:47:54.045271+0000","last_active":"2024-09-10T08:47:54.049325+0000","last_peered":"2024-09-10T08:47:54.049325+0000","last_clean":"2024-09-10T08:47:54.049325+0000","last_became_active":"2024-09-10T08:47:54.042846+0000","last_became_peered":"2024-09-10T08:47:54.042846+0000","last_unstale":"2024-09-10T08:47:54.049325+0000","last_undegraded":"2024-09-10T08:47:54.049325+0000","last_fullsized":"2024-09-10T08:47:54.049325+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:36:44.497603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.059968+0000","last_change":"2024-09-10T08:47:54.053207+0000","last_active":"2024-09-10T08:47:54.059968+0000","last_peered":"2024-09-10T08:47:54.059968+0000","last_clean":"2024-09-10T08:47:54.059968+0000","last_became_active":"2024-09-10T08:47:54.052975+0000","last_became_peered":"2024-09-10T08:47:54.052975+0000","last_unstale":"2024-09-10T08:47:54.059968+0000","last_undegraded":"2024-09-10T08:47:54.059968+0000","last_fullsized":"2024-09-10T08:47:54.059968+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:10:07.359735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.050102+0000","last_change":"2024-09-10T08:47:54.042526+0000","last_active":"2024-09-10T08:47:54.050102+0000","last_peered":"2024-09-10T08:47:54.050102+0000","last_clean":"2024-09-10T08:47:54.050102+0000","last_became_active":"2024-09-10T08:47:54.042203+0000","last_became_peered":"2024-09-10T08:47:54.042203+0000","last_unstale":"2024-09-10T08:47:54.050102+0000","last_undegraded":"2024-09-10T08:47:54.050102+0000","last_fullsized":"2024-09-10T08:47:54.050102+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:48:20.676961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.052675+0000","last_change":"2024-09-10T08:47:54.046017+0000","last_active":"2024-09-10T08:47:54.052675+0000","last_peered":"2024-09-10T08:47:54.052675+0000","last_clean":"2024-09-10T08:47:54.052675+0000","last_became_active":"2024-09-10T08:47:54.044336+0000","last_became_peered":"2024-09-10T08:47:54.044336+0000","last_unstale":"2024-09-10T08:47:54.052675+0000","last_undegraded":"2024-09-10T08:47:54.052675+0000","last_fullsized":"2024-09-10T08:47:54.052675+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:10:58.984569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.054988+0000","last_change":"2024-09-10T08:47:54.046297+0000","last_active":"2024-09-10T08:47:54.054988+0000","last_peered":"2024-09-10T08:47:54.054988+0000","last_clean":"2024-09-10T08:47:54.054988+0000","last_became_active":"2024-09-10T08:47:54.044151+0000","last_became_peered":"2024-09-10T08:47:54.044151+0000","last_unstale":"2024-09-10T08:47:54.054988+0000","last_undegraded":"2024-09-10T08:47:54.054988+0000","last_fullsized":"2024-09-10T08:47:54.054988+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:32:59.447916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.053987+0000","last_change":"2024-09-10T08:47:54.048332+0000","last_active":"2024-09-10T08:47:54.053987+0000","last_peered":"2024-09-10T08:47:54.053987+0000","last_clean":"2024-09-10T08:47:54.053987+0000","last_became_active":"2024-09-10T08:47:54.047880+0000","last_became_peered":"2024-09-10T08:47:54.047880+0000","last_unstale":"2024-09-10T08:47:54.053987+0000","last_undegraded":"2024-09-10T08:47:54.053987+0000","last_fullsized":"2024-09-10T08:47:54.053987+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:36:08.249489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.039574+0000","last_change":"2024-09-10T08:47:54.033410+0000","last_active":"2024-09-10T08:47:54.039574+0000","last_peered":"2024-09-10T08:47:54.039574+0000","last_clean":"2024-09-10T08:47:54.039574+0000","last_became_active":"2024-09-10T08:47:54.033077+0000","last_became_peered":"2024-09-10T08:47:54.033077+0000","last_unstale":"2024-09-10T08:47:54.039574+0000","last_undegraded":"2024-09-10T08:47:54.039574+0000","last_fullsized":"2024-09-10T08:47:54.039574+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:25:48.167920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.035067+0000","last_change":"2024-09-10T08:47:54.031427+0000","last_active":"2024-09-10T08:47:54.035067+0000","last_peered":"2024-09-10T08:47:54.035067+0000","last_clean":"2024-09-10T08:47:54.035067+0000","last_became_active":"2024-09-10T08:47:54.031154+0000","last_became_peered":"2024-09-10T08:47:54.031154+0000","last_unstale":"2024-09-10T08:47:54.035067+0000","last_undegraded":"2024-09-10T08:47:54.035067+0000","last_fullsized":"2024-09-10T08:47:54.035067+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:32:08.278076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.039664+0000","last_change":"2024-09-10T08:47:54.034606+0000","last_active":"2024-09-10T08:47:54.039664+0000","last_peered":"2024-09-10T08:47:54.039664+0000","last_clean":"2024-09-10T08:47:54.039664+0000","last_became_active":"2024-09-10T08:47:54.034295+0000","last_became_peered":"2024-09-10T08:47:54.034295+0000","last_unstale":"2024-09-10T08:47:54.039664+0000","last_undegraded":"2024-09-10T08:47:54.039664+0000","last_fullsized":"2024-09-10T08:47:54.039664+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:51:45.693884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.048690+0000","last_change":"2024-09-10T08:47:54.042152+0000","last_active":"2024-09-10T08:47:54.048690+0000","last_peered":"2024-09-10T08:47:54.048690+0000","last_clean":"2024-09-10T08:47:54.048690+0000","last_became_active":"2024-09-10T08:47:54.041808+0000","last_became_peered":"2024-09-10T08:47:54.041808+0000","last_unstale":"2024-09-10T08:47:54.048690+0000","last_undegraded":"2024-09-10T08:47:54.048690+0000","last_fullsized":"2024-09-10T08:47:54.048690+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:32:59.447916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.044157+0000","last_change":"2024-09-10T08:47:54.036979+0000","last_active":"2024-09-10T08:47:54.044157+0000","last_peered":"2024-09-10T08:47:54.044157+0000","last_clean":"2024-09-10T08:47:54.044157+0000","last_became_active":"2024-09-10T08:47:54.036685+0000","last_became_peered":"2024-09-10T08:47:54.036685+0000","last_unstale":"2024-09-10T08:47:54.044157+0000","last_undegraded":"2024-09-10T08:47:54.044157+0000","last_fullsized":"2024-09-10T08:47:54.044157+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:24:55.439747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.051658+0000","last_change":"2024-09-10T08:47:54.044871+0000","last_active":"2024-09-10T08:47:54.051658+0000","last_peered":"2024-09-10T08:47:54.051658+0000","last_clean":"2024-09-10T08:47:54.051658+0000","last_became_active":"2024-09-10T08:47:54.044606+0000","last_became_peered":"2024-09-10T08:47:54.044606+0000","last_unstale":"2024-09-10T08:47:54.051658+0000","last_undegraded":"2024-09-10T08:47:54.051658+0000","last_fullsized":"2024-09-10T08:47:54.051658+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:17.824086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.052791+0000","last_change":"2024-09-10T08:47:54.050394+0000","last_active":"2024-09-10T08:47:54.052791+0000","last_peered":"2024-09-10T08:47:54.052791+0000","last_clean":"2024-09-10T08:47:54.052791+0000","last_became_active":"2024-09-10T08:47:54.049462+0000","last_became_peered":"2024-09-10T08:47:54.049462+0000","last_unstale":"2024-09-10T08:47:54.052791+0000","last_undegraded":"2024-09-10T08:47:54.052791+0000","last_fullsized":"2024-09-10T08:47:54.052791+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:00:14.660427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.043248+0000","last_change":"2024-09-10T08:47:54.039023+0000","last_active":"2024-09-10T08:47:54.043248+0000","last_peered":"2024-09-10T08:47:54.043248+0000","last_clean":"2024-09-10T08:47:54.043248+0000","last_became_active":"2024-09-10T08:47:54.038018+0000","last_became_peered":"2024-09-10T08:47:54.038018+0000","last_unstale":"2024-09-10T08:47:54.043248+0000","last_undegraded":"2024-09-10T08:47:54.043248+0000","last_fullsized":"2024-09-10T08:47:54.043248+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:24:55.439747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.054105+0000","last_change":"2024-09-10T08:47:54.041481+0000","last_active":"2024-09-10T08:47:54.054105+0000","last_peered":"2024-09-10T08:47:54.054105+0000","last_clean":"2024-09-10T08:47:54.054105+0000","last_became_active":"2024-09-10T08:47:54.041181+0000","last_became_peered":"2024-09-10T08:47:54.041181+0000","last_unstale":"2024-09-10T08:47:54.054105+0000","last_undegraded":"2024-09-10T08:47:54.054105+0000","last_fullsized":"2024-09-10T08:47:54.054105+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:48:20.676961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.046806+0000","last_change":"2024-09-10T08:47:54.039074+0000","last_active":"2024-09-10T08:47:54.046806+0000","last_peered":"2024-09-10T08:47:54.046806+0000","last_clean":"2024-09-10T08:47:54.046806+0000","last_became_active":"2024-09-10T08:47:54.037364+0000","last_became_peered":"2024-09-10T08:47:54.037364+0000","last_unstale":"2024-09-10T08:47:54.046806+0000","last_undegraded":"2024-09-10T08:47:54.046806+0000","last_fullsized":"2024-09-10T08:47:54.046806+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:56:47.991637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.063424+0000","last_change":"2024-09-10T08:47:54.058883+0000","last_active":"2024-09-10T08:47:54.063424+0000","last_peered":"2024-09-10T08:47:54.063424+0000","last_clean":"2024-09-10T08:47:54.063424+0000","last_became_active":"2024-09-10T08:47:54.058593+0000","last_became_peered":"2024-09-10T08:47:54.058593+0000","last_unstale":"2024-09-10T08:47:54.063424+0000","last_undegraded":"2024-09-10T08:47:54.063424+0000","last_fullsized":"2024-09-10T08:47:54.063424+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:35:09.428560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.037401+0000","last_change":"2024-09-10T08:47:54.031807+0000","last_active":"2024-09-10T08:47:54.037401+0000","last_peered":"2024-09-10T08:47:54.037401+0000","last_clean":"2024-09-10T08:47:54.037401+0000","last_became_active":"2024-09-10T08:47:54.031519+0000","last_became_peered":"2024-09-10T08:47:54.031519+0000","last_unstale":"2024-09-10T08:47:54.037401+0000","last_undegraded":"2024-09-10T08:47:54.037401+0000","last_fullsized":"2024-09-10T08:47:54.037401+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:35:47.818148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.065461+0000","last_change":"2024-09-10T08:47:54.062716+0000","last_active":"2024-09-10T08:47:54.065461+0000","last_peered":"2024-09-10T08:47:54.065461+0000","last_clean":"2024-09-10T08:47:54.065461+0000","last_became_active":"2024-09-10T08:47:54.062362+0000","last_became_peered":"2024-09-10T08:47:54.062362+0000","last_unstale":"2024-09-10T08:47:54.065461+0000","last_undegraded":"2024-09-10T08:47:54.065461+0000","last_fullsized":"2024-09-10T08:47:54.065461+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:29:21.218016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.056758+0000","last_change":"2024-09-10T08:47:54.051520+0000","last_active":"2024-09-10T08:47:54.056758+0000","last_peered":"2024-09-10T08:47:54.056758+0000","last_clean":"2024-09-10T08:47:54.056758+0000","last_became_active":"2024-09-10T08:47:54.051065+0000","last_became_peered":"2024-09-10T08:47:54.051065+0000","last_unstale":"2024-09-10T08:47:54.056758+0000","last_undegraded":"2024-09-10T08:47:54.056758+0000","last_fullsized":"2024-09-10T08:47:54.056758+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:56:00.614693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.051097+0000","last_change":"2024-09-10T08:47:54.038637+0000","last_active":"2024-09-10T08:47:54.051097+0000","last_peered":"2024-09-10T08:47:54.051097+0000","last_clean":"2024-09-10T08:47:54.051097+0000","last_became_active":"2024-09-10T08:47:54.038363+0000","last_became_peered":"2024-09-10T08:47:54.038363+0000","last_unstale":"2024-09-10T08:47:54.051097+0000","last_undegraded":"2024-09-10T08:47:54.051097+0000","last_fullsized":"2024-09-10T08:47:54.051097+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:56:47.991637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.058283+0000","last_change":"2024-09-10T08:47:54.052828+0000","last_active":"2024-09-10T08:47:54.058283+0000","last_peered":"2024-09-10T08:47:54.058283+0000","last_clean":"2024-09-10T08:47:54.058283+0000","last_became_active":"2024-09-10T08:47:54.052545+0000","last_became_peered":"2024-09-10T08:47:54.052545+0000","last_unstale":"2024-09-10T08:47:54.058283+0000","last_undegraded":"2024-09-10T08:47:54.058283+0000","last_fullsized":"2024-09-10T08:47:54.058283+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:10:58.984569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.063658+0000","last_change":"2024-09-10T08:47:53.028540+0000","last_active":"2024-09-10T08:47:54.063658+0000","last_peered":"2024-09-10T08:47:54.063658+0000","last_clean":"2024-09-10T08:47:54.063658+0000","last_became_active":"2024-09-10T08:47:53.028309+0000","last_became_peered":"2024-09-10T08:47:53.028309+0000","last_unstale":"2024-09-10T08:47:54.063658+0000","last_undegraded":"2024-09-10T08:47:54.063658+0000","last_fullsized":"2024-09-10T08:47:54.063658+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_clean_scrub_stamp":"2024-09-10T08:47:52.003048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:00:13.658014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.055231+0000","last_change":"2024-09-10T08:47:54.049068+0000","last_active":"2024-09-10T08:47:54.055231+0000","last_peered":"2024-09-10T08:47:54.055231+0000","last_clean":"2024-09-10T08:47:54.055231+0000","last_became_active":"2024-09-10T08:47:54.048780+0000","last_became_peered":"2024-09-10T08:47:54.048780+0000","last_unstale":"2024-09-10T08:47:54.055231+0000","last_undegraded":"2024-09-10T08:47:54.055231+0000","last_fullsized":"2024-09-10T08:47:54.055231+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:36:25.270876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.059039+0000","last_change":"2024-09-10T08:47:53.036088+0000","last_active":"2024-09-10T08:47:54.059039+0000","last_peered":"2024-09-10T08:47:54.059039+0000","last_clean":"2024-09-10T08:47:54.059039+0000","last_became_active":"2024-09-10T08:47:53.035686+0000","last_became_peered":"2024-09-10T08:47:53.035686+0000","last_unstale":"2024-09-10T08:47:54.059039+0000","last_undegraded":"2024-09-10T08:47:54.059039+0000","last_fullsized":"2024-09-10T08:47:54.059039+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_clean_scrub_stamp":"2024-09-10T08:47:52.003048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:56:46.989224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.049879+0000","last_change":"2024-09-10T08:47:54.045410+0000","last_active":"2024-09-10T08:47:54.049879+0000","last_peered":"2024-09-10T08:47:54.049879+0000","last_clean":"2024-09-10T08:47:54.049879+0000","last_became_active":"2024-09-10T08:47:54.042159+0000","last_became_peered":"2024-09-10T08:47:54.042159+0000","last_unstale":"2024-09-10T08:47:54.049879+0000","last_undegraded":"2024-09-10T08:47:54.049879+0000","last_fullsized":"2024-09-10T08:47:54.049879+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:36:25.270876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.064137+0000","last_change":"2024-09-10T08:47:53.039146+0000","last_active":"2024-09-10T08:47:54.064137+0000","last_peered":"2024-09-10T08:47:54.064137+0000","last_clean":"2024-09-10T08:47:54.064137+0000","last_became_active":"2024-09-10T08:47:53.038608+0000","last_became_peered":"2024-09-10T08:47:53.038608+0000","last_unstale":"2024-09-10T08:47:54.064137+0000","last_undegraded":"2024-09-10T08:47:54.064137+0000","last_fullsized":"2024-09-10T08:47:54.064137+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_clean_scrub_stamp":"2024-09-10T08:47:52.003048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:24:54.437335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.068613+0000","last_change":"2024-09-10T08:47:54.064405+0000","last_active":"2024-09-10T08:47:54.068613+0000","last_peered":"2024-09-10T08:47:54.068613+0000","last_clean":"2024-09-10T08:47:54.068613+0000","last_became_active":"2024-09-10T08:47:54.063914+0000","last_became_peered":"2024-09-10T08:47:54.063914+0000","last_unstale":"2024-09-10T08:47:54.068613+0000","last_undegraded":"2024-09-10T08:47:54.068613+0000","last_fullsized":"2024-09-10T08:47:54.068613+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:05:25.630297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.068950+0000","last_change":"2024-09-10T08:47:53.027692+0000","last_active":"2024-09-10T08:47:54.068950+0000","last_peered":"2024-09-10T08:47:54.068950+0000","last_clean":"2024-09-10T08:47:54.068950+0000","last_became_active":"2024-09-10T08:47:53.027432+0000","last_became_peered":"2024-09-10T08:47:53.027432+0000","last_unstale":"2024-09-10T08:47:54.068950+0000","last_undegraded":"2024-09-10T08:47:54.068950+0000","last_fullsized":"2024-09-10T08:47:54.068950+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_clean_scrub_stamp":"2024-09-10T08:47:52.003048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:25:47.165507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.046450+0000","last_change":"2024-09-10T08:47:54.040408+0000","last_active":"2024-09-10T08:47:54.046450+0000","last_peered":"2024-09-10T08:47:54.046450+0000","last_clean":"2024-09-10T08:47:54.046450+0000","last_became_active":"2024-09-10T08:47:54.040142+0000","last_became_peered":"2024-09-10T08:47:54.040142+0000","last_unstale":"2024-09-10T08:47:54.046450+0000","last_undegraded":"2024-09-10T08:47:54.046450+0000","last_fullsized":"2024-09-10T08:47:54.046450+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:08.518513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.057835+0000","last_change":"2024-09-10T08:47:53.035616+0000","last_active":"2024-09-10T08:47:54.057835+0000","last_peered":"2024-09-10T08:47:54.057835+0000","last_clean":"2024-09-10T08:47:54.057835+0000","last_became_active":"2024-09-10T08:47:53.032766+0000","last_became_peered":"2024-09-10T08:47:53.032766+0000","last_unstale":"2024-09-10T08:47:54.057835+0000","last_undegraded":"2024-09-10T08:47:54.057835+0000","last_fullsized":"2024-09-10T08:47:54.057835+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_clean_scrub_stamp":"2024-09-10T08:47:52.003048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:48:19.674548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.052651+0000","last_change":"2024-09-10T08:47:54.044623+0000","last_active":"2024-09-10T08:47:54.052651+0000","last_peered":"2024-09-10T08:47:54.052651+0000","last_clean":"2024-09-10T08:47:54.052651+0000","last_became_active":"2024-09-10T08:47:54.041751+0000","last_became_peered":"2024-09-10T08:47:54.041751+0000","last_unstale":"2024-09-10T08:47:54.052651+0000","last_undegraded":"2024-09-10T08:47:54.052651+0000","last_fullsized":"2024-09-10T08:47:54.052651+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:56:00.614693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.064112+0000","last_change":"2024-09-10T08:47:53.040358+0000","last_active":"2024-09-10T08:47:54.064112+0000","last_peered":"2024-09-10T08:47:54.064112+0000","last_clean":"2024-09-10T08:47:54.064112+0000","last_became_active":"2024-09-10T08:47:53.040061+0000","last_became_peered":"2024-09-10T08:47:53.040061+0000","last_unstale":"2024-09-10T08:47:54.064112+0000","last_undegraded":"2024-09-10T08:47:54.064112+0000","last_fullsized":"2024-09-10T08:47:54.064112+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_clean_scrub_stamp":"2024-09-10T08:47:52.003048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:07.516101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.044178+0000","last_change":"2024-09-10T08:47:54.037560+0000","last_active":"2024-09-10T08:47:54.044178+0000","last_peered":"2024-09-10T08:47:54.044178+0000","last_clean":"2024-09-10T08:47:54.044178+0000","last_became_active":"2024-09-10T08:47:54.035872+0000","last_became_peered":"2024-09-10T08:47:54.035872+0000","last_unstale":"2024-09-10T08:47:54.044178+0000","last_undegraded":"2024-09-10T08:47:54.044178+0000","last_fullsized":"2024-09-10T08:47:54.044178+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:56:47.991637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.027151+0000","last_change":"2024-09-10T08:47:53.035542+0000","last_active":"2024-09-10T08:47:54.027151+0000","last_peered":"2024-09-10T08:47:54.027151+0000","last_clean":"2024-09-10T08:47:54.027151+0000","last_became_active":"2024-09-10T08:47:53.034642+0000","last_became_peered":"2024-09-10T08:47:53.034642+0000","last_unstale":"2024-09-10T08:47:54.027151+0000","last_undegraded":"2024-09-10T08:47:54.027151+0000","last_fullsized":"2024-09-10T08:47:54.027151+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_clean_scrub_stamp":"2024-09-10T08:47:52.003048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:35:46.815735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.065536+0000","last_change":"2024-09-10T08:47:54.062225+0000","last_active":"2024-09-10T08:47:54.065536+0000","last_peered":"2024-09-10T08:47:54.065536+0000","last_clean":"2024-09-10T08:47:54.065536+0000","last_became_active":"2024-09-10T08:47:54.061136+0000","last_became_peered":"2024-09-10T08:47:54.061136+0000","last_unstale":"2024-09-10T08:47:54.065536+0000","last_undegraded":"2024-09-10T08:47:54.065536+0000","last_fullsized":"2024-09-10T08:47:54.065536+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:54:47.827173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.024289+0000","last_change":"2024-09-10T08:47:53.032046+0000","last_active":"2024-09-10T08:47:54.024289+0000","last_peered":"2024-09-10T08:47:54.024289+0000","last_clean":"2024-09-10T08:47:54.024289+0000","last_became_active":"2024-09-10T08:47:53.030327+0000","last_became_peered":"2024-09-10T08:47:53.030327+0000","last_unstale":"2024-09-10T08:47:54.024289+0000","last_undegraded":"2024-09-10T08:47:54.024289+0000","last_fullsized":"2024-09-10T08:47:54.024289+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_clean_scrub_stamp":"2024-09-10T08:47:52.003048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:04:10.828802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.038272+0000","last_change":"2024-09-10T08:47:54.036905+0000","last_active":"2024-09-10T08:47:54.038272+0000","last_peered":"2024-09-10T08:47:54.038272+0000","last_clean":"2024-09-10T08:47:54.038272+0000","last_became_active":"2024-09-10T08:47:54.034653+0000","last_became_peered":"2024-09-10T08:47:54.034653+0000","last_unstale":"2024-09-10T08:47:54.038272+0000","last_undegraded":"2024-09-10T08:47:54.038272+0000","last_fullsized":"2024-09-10T08:47:54.038272+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:41:30.292360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.059672+0000","last_change":"2024-09-10T08:47:53.028467+0000","last_active":"2024-09-10T08:47:54.059672+0000","last_peered":"2024-09-10T08:47:54.059672+0000","last_clean":"2024-09-10T08:47:54.059672+0000","last_became_active":"2024-09-10T08:47:53.028181+0000","last_became_peered":"2024-09-10T08:47:53.028181+0000","last_unstale":"2024-09-10T08:47:54.059672+0000","last_undegraded":"2024-09-10T08:47:54.059672+0000","last_fullsized":"2024-09-10T08:47:54.059672+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_clean_scrub_stamp":"2024-09-10T08:47:52.003048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:18:51.132102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.058935+0000","last_change":"2024-09-10T08:47:54.053361+0000","last_active":"2024-09-10T08:47:54.058935+0000","last_peered":"2024-09-10T08:47:54.058935+0000","last_clean":"2024-09-10T08:47:54.058935+0000","last_became_active":"2024-09-10T08:47:54.053087+0000","last_became_peered":"2024-09-10T08:47:54.053087+0000","last_unstale":"2024-09-10T08:47:54.058935+0000","last_undegraded":"2024-09-10T08:47:54.058935+0000","last_fullsized":"2024-09-10T08:47:54.058935+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:18:52.134514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.035438+0000","last_change":"2024-09-10T08:47:53.028949+0000","last_active":"2024-09-10T08:47:54.035438+0000","last_peered":"2024-09-10T08:47:54.035438+0000","last_clean":"2024-09-10T08:47:54.035438+0000","last_became_active":"2024-09-10T08:47:53.028649+0000","last_became_peered":"2024-09-10T08:47:53.028649+0000","last_unstale":"2024-09-10T08:47:54.035438+0000","last_undegraded":"2024-09-10T08:47:54.035438+0000","last_fullsized":"2024-09-10T08:47:54.035438+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_clean_scrub_stamp":"2024-09-10T08:47:52.003048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:07.516101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.050914+0000","last_change":"2024-09-10T08:47:54.048563+0000","last_active":"2024-09-10T08:47:54.050914+0000","last_peered":"2024-09-10T08:47:54.050914+0000","last_clean":"2024-09-10T08:47:54.050914+0000","last_became_active":"2024-09-10T08:47:54.048267+0000","last_became_peered":"2024-09-10T08:47:54.048267+0000","last_unstale":"2024-09-10T08:47:54.050914+0000","last_undegraded":"2024-09-10T08:47:54.050914+0000","last_fullsized":"2024-09-10T08:47:54.050914+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:32:59.447916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.060340+0000","last_change":"2024-09-10T08:47:53.035227+0000","last_active":"2024-09-10T08:47:54.060340+0000","last_peered":"2024-09-10T08:47:54.060340+0000","last_clean":"2024-09-10T08:47:54.060340+0000","last_became_active":"2024-09-10T08:47:53.034955+0000","last_became_peered":"2024-09-10T08:47:53.034955+0000","last_unstale":"2024-09-10T08:47:54.060340+0000","last_undegraded":"2024-09-10T08:47:54.060340+0000","last_fullsized":"2024-09-10T08:47:54.060340+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_clean_scrub_stamp":"2024-09-10T08:47:52.003048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:36:24.268464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.050543+0000","last_change":"2024-09-10T08:47:54.039407+0000","last_active":"2024-09-10T08:47:54.050543+0000","last_peered":"2024-09-10T08:47:54.050543+0000","last_clean":"2024-09-10T08:47:54.050543+0000","last_became_active":"2024-09-10T08:47:54.039090+0000","last_became_peered":"2024-09-10T08:47:54.039090+0000","last_unstale":"2024-09-10T08:47:54.050543+0000","last_undegraded":"2024-09-10T08:47:54.050543+0000","last_fullsized":"2024-09-10T08:47:54.050543+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:08.518513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.077413+0000","last_change":"2024-09-10T08:47:53.034880+0000","last_active":"2024-09-10T08:47:54.077413+0000","last_peered":"2024-09-10T08:47:54.077413+0000","last_clean":"2024-09-10T08:47:54.077413+0000","last_became_active":"2024-09-10T08:47:53.034600+0000","last_became_peered":"2024-09-10T08:47:53.034600+0000","last_unstale":"2024-09-10T08:47:54.077413+0000","last_undegraded":"2024-09-10T08:47:54.077413+0000","last_fullsized":"2024-09-10T08:47:54.077413+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_clean_scrub_stamp":"2024-09-10T08:47:52.003048+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:32:58.445504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.046472+0000","last_change":"2024-09-10T08:47:54.041610+0000","last_active":"2024-09-10T08:47:54.046472+0000","last_peered":"2024-09-10T08:47:54.046472+0000","last_clean":"2024-09-10T08:47:54.046472+0000","last_became_active":"2024-09-10T08:47:54.041353+0000","last_became_peered":"2024-09-10T08:47:54.041353+0000","last_unstale":"2024-09-10T08:47:54.046472+0000","last_undegraded":"2024-09-10T08:47:54.046472+0000","last_fullsized":"2024-09-10T08:47:54.046472+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:48:20.676961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.072450+0000","last_change":"2024-09-10T08:47:53.035995+0000","last_active":"2024-09-10T08:47:54.072450+0000","last_peered":"2024-09-10T08:47:54.072450+0000","last_clean":"2024-09-10T08:47:54.072450+0000","last_became_active":"2024-09-10T08:47:53.033525+0000","last_became_peered":"2024-09-10T08:47:53.033525+0000","last_unstale":"2024-09-10T08:47:54.072450+0000","last_undegraded":"2024-09-10T08:47:54.072450+0000","last_fullsized":"2024-09-10T08:47:54.072450+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_clean_scrub_stamp":"2024-09-10T08:47:52.003048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:16.821673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.066544+0000","last_change":"2024-09-10T08:47:54.060303+0000","last_active":"2024-09-10T08:47:54.066544+0000","last_peered":"2024-09-10T08:47:54.066544+0000","last_clean":"2024-09-10T08:47:54.066544+0000","last_became_active":"2024-09-10T08:47:54.060080+0000","last_became_peered":"2024-09-10T08:47:54.060080+0000","last_unstale":"2024-09-10T08:47:54.066544+0000","last_undegraded":"2024-09-10T08:47:54.066544+0000","last_fullsized":"2024-09-10T08:47:54.066544+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:10:07.359735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.028777+0000","last_change":"2024-09-10T08:47:53.034349+0000","last_active":"2024-09-10T08:47:54.028777+0000","last_peered":"2024-09-10T08:47:54.028777+0000","last_clean":"2024-09-10T08:47:54.028777+0000","last_became_active":"2024-09-10T08:47:53.034051+0000","last_became_peered":"2024-09-10T08:47:53.034051+0000","last_unstale":"2024-09-10T08:47:54.028777+0000","last_undegraded":"2024-09-10T08:47:54.028777+0000","last_fullsized":"2024-09-10T08:47:54.028777+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_clean_scrub_stamp":"2024-09-10T08:47:52.003048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:25:47.165507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.050837+0000","last_change":"2024-09-10T08:47:54.043178+0000","last_active":"2024-09-10T08:47:54.050837+0000","last_peered":"2024-09-10T08:47:54.050837+0000","last_clean":"2024-09-10T08:47:54.050837+0000","last_became_active":"2024-09-10T08:47:54.042335+0000","last_became_peered":"2024-09-10T08:47:54.042335+0000","last_unstale":"2024-09-10T08:47:54.050837+0000","last_undegraded":"2024-09-10T08:47:54.050837+0000","last_fullsized":"2024-09-10T08:47:54.050837+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:36:25.270876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.028238+0000","last_change":"2024-09-10T08:47:53.031056+0000","last_active":"2024-09-10T08:47:54.028238+0000","last_peered":"2024-09-10T08:47:54.028238+0000","last_clean":"2024-09-10T08:47:54.028238+0000","last_became_active":"2024-09-10T08:47:53.030708+0000","last_became_peered":"2024-09-10T08:47:53.030708+0000","last_unstale":"2024-09-10T08:47:54.028238+0000","last_undegraded":"2024-09-10T08:47:54.028238+0000","last_fullsized":"2024-09-10T08:47:54.028238+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_clean_scrub_stamp":"2024-09-10T08:47:52.003048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:41:29.289947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.065499+0000","last_change":"2024-09-10T08:47:54.061382+0000","last_active":"2024-09-10T08:47:54.065499+0000","last_peered":"2024-09-10T08:47:54.065499+0000","last_clean":"2024-09-10T08:47:54.065499+0000","last_became_active":"2024-09-10T08:47:54.060638+0000","last_became_peered":"2024-09-10T08:47:54.060638+0000","last_unstale":"2024-09-10T08:47:54.065499+0000","last_undegraded":"2024-09-10T08:47:54.065499+0000","last_fullsized":"2024-09-10T08:47:54.065499+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:19:16.826406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"37'8","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.064013+0000","last_change":"2024-09-10T08:47:53.032960+0000","last_active":"2024-09-10T08:47:54.064013+0000","last_peered":"2024-09-10T08:47:54.064013+0000","last_clean":"2024-09-10T08:47:54.064013+0000","last_became_active":"2024-09-10T08:47:53.032483+0000","last_became_peered":"2024-09-10T08:47:53.032483+0000","last_unstale":"2024-09-10T08:47:54.064013+0000","last_undegraded":"2024-09-10T08:47:54.064013+0000","last_fullsized":"2024-09-10T08:47:54.064013+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_clean_scrub_stamp":"2024-09-10T08:47:52.003048+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:29:20.215604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.066584+0000","last_change":"2024-09-10T08:47:54.059253+0000","last_active":"2024-09-10T08:47:54.066584+0000","last_peered":"2024-09-10T08:47:54.066584+0000","last_clean":"2024-09-10T08:47:54.066584+0000","last_became_active":"2024-09-10T08:47:54.051904+0000","last_became_peered":"2024-09-10T08:47:54.051904+0000","last_unstale":"2024-09-10T08:47:54.066584+0000","last_undegraded":"2024-09-10T08:47:54.066584+0000","last_fullsized":"2024-09-10T08:47:54.066584+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:10:58.984569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.059750+0000","last_change":"2024-09-10T08:47:53.039251+0000","last_active":"2024-09-10T08:47:54.059750+0000","last_peered":"2024-09-10T08:47:54.059750+0000","last_clean":"2024-09-10T08:47:54.059750+0000","last_became_active":"2024-09-10T08:47:53.038989+0000","last_became_peered":"2024-09-10T08:47:53.038989+0000","last_unstale":"2024-09-10T08:47:54.059750+0000","last_undegraded":"2024-09-10T08:47:54.059750+0000","last_fullsized":"2024-09-10T08:47:54.059750+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_clean_scrub_stamp":"2024-09-10T08:47:52.003048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:36:43.495190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.049635+0000","last_change":"2024-09-10T08:47:54.043035+0000","last_active":"2024-09-10T08:47:54.049635+0000","last_peered":"2024-09-10T08:47:54.049635+0000","last_clean":"2024-09-10T08:47:54.049635+0000","last_became_active":"2024-09-10T08:47:54.042686+0000","last_became_peered":"2024-09-10T08:47:54.042686+0000","last_unstale":"2024-09-10T08:47:54.049635+0000","last_undegraded":"2024-09-10T08:47:54.049635+0000","last_fullsized":"2024-09-10T08:47:54.049635+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:36:08.249489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.063807+0000","last_change":"2024-09-10T08:47:53.029974+0000","last_active":"2024-09-10T08:47:54.063807+0000","last_peered":"2024-09-10T08:47:54.063807+0000","last_clean":"2024-09-10T08:47:54.063807+0000","last_became_active":"2024-09-10T08:47:53.029678+0000","last_became_peered":"2024-09-10T08:47:53.029678+0000","last_unstale":"2024-09-10T08:47:54.063807+0000","last_undegraded":"2024-09-10T08:47:54.063807+0000","last_fullsized":"2024-09-10T08:47:54.063807+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_clean_scrub_stamp":"2024-09-10T08:47:52.003048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:51:44.691471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.045859+0000","last_change":"2024-09-10T08:47:54.037933+0000","last_active":"2024-09-10T08:47:54.045859+0000","last_peered":"2024-09-10T08:47:54.045859+0000","last_clean":"2024-09-10T08:47:54.045859+0000","last_became_active":"2024-09-10T08:47:54.036074+0000","last_became_peered":"2024-09-10T08:47:54.036074+0000","last_unstale":"2024-09-10T08:47:54.045859+0000","last_undegraded":"2024-09-10T08:47:54.045859+0000","last_fullsized":"2024-09-10T08:47:54.045859+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:29:21.218016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.063802+0000","last_change":"2024-09-10T08:47:53.033633+0000","last_active":"2024-09-10T08:47:54.063802+0000","last_peered":"2024-09-10T08:47:54.063802+0000","last_clean":"2024-09-10T08:47:54.063802+0000","last_became_active":"2024-09-10T08:47:53.033378+0000","last_became_peered":"2024-09-10T08:47:53.033378+0000","last_unstale":"2024-09-10T08:47:54.063802+0000","last_undegraded":"2024-09-10T08:47:54.063802+0000","last_fullsized":"2024-09-10T08:47:54.063802+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_clean_scrub_stamp":"2024-09-10T08:47:52.003048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:32:32.470485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.066328+0000","last_change":"2024-09-10T08:47:54.065370+0000","last_active":"2024-09-10T08:47:54.066328+0000","last_peered":"2024-09-10T08:47:54.066328+0000","last_clean":"2024-09-10T08:47:54.066328+0000","last_became_active":"2024-09-10T08:47:54.065027+0000","last_became_peered":"2024-09-10T08:47:54.065027+0000","last_unstale":"2024-09-10T08:47:54.066328+0000","last_undegraded":"2024-09-10T08:47:54.066328+0000","last_fullsized":"2024-09-10T08:47:54.066328+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:04:11.831215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.029810+0000","last_change":"2024-09-10T08:47:53.033886+0000","last_active":"2024-09-10T08:47:54.029810+0000","last_peered":"2024-09-10T08:47:54.029810+0000","last_clean":"2024-09-10T08:47:54.029810+0000","last_became_active":"2024-09-10T08:47:53.033608+0000","last_became_peered":"2024-09-10T08:47:53.033608+0000","last_unstale":"2024-09-10T08:47:54.029810+0000","last_undegraded":"2024-09-10T08:47:54.029810+0000","last_fullsized":"2024-09-10T08:47:54.029810+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_clean_scrub_stamp":"2024-09-10T08:47:52.003048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:51:44.691471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.054965+0000","last_change":"2024-09-10T08:47:54.046348+0000","last_active":"2024-09-10T08:47:54.054965+0000","last_peered":"2024-09-10T08:47:54.054965+0000","last_clean":"2024-09-10T08:47:54.054965+0000","last_became_active":"2024-09-10T08:47:54.045662+0000","last_became_peered":"2024-09-10T08:47:54.045662+0000","last_unstale":"2024-09-10T08:47:54.054965+0000","last_undegraded":"2024-09-10T08:47:54.054965+0000","last_fullsized":"2024-09-10T08:47:54.054965+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:38:57.458122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.057801+0000","last_change":"2024-09-10T08:47:53.032155+0000","last_active":"2024-09-10T08:47:54.057801+0000","last_peered":"2024-09-10T08:47:54.057801+0000","last_clean":"2024-09-10T08:47:54.057801+0000","last_became_active":"2024-09-10T08:47:53.031890+0000","last_became_peered":"2024-09-10T08:47:53.031890+0000","last_unstale":"2024-09-10T08:47:54.057801+0000","last_undegraded":"2024-09-10T08:47:54.057801+0000","last_fullsized":"2024-09-10T08:47:54.057801+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_clean_scrub_stamp":"2024-09-10T08:47:52.003048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:46:16.014995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.050517+0000","last_change":"2024-09-10T08:47:54.048569+0000","last_active":"2024-09-10T08:47:54.050517+0000","last_peered":"2024-09-10T08:47:54.050517+0000","last_clean":"2024-09-10T08:47:54.050517+0000","last_became_active":"2024-09-10T08:47:54.048228+0000","last_became_peered":"2024-09-10T08:47:54.048228+0000","last_unstale":"2024-09-10T08:47:54.050517+0000","last_undegraded":"2024-09-10T08:47:54.050517+0000","last_fullsized":"2024-09-10T08:47:54.050517+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:38:57.458122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.022988+0000","last_change":"2024-09-10T08:47:53.027837+0000","last_active":"2024-09-10T08:47:54.022988+0000","last_peered":"2024-09-10T08:47:54.022988+0000","last_clean":"2024-09-10T08:47:54.022988+0000","last_became_active":"2024-09-10T08:47:53.027512+0000","last_became_peered":"2024-09-10T08:47:53.027512+0000","last_unstale":"2024-09-10T08:47:54.022988+0000","last_undegraded":"2024-09-10T08:47:54.022988+0000","last_fullsized":"2024-09-10T08:47:54.022988+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_clean_scrub_stamp":"2024-09-10T08:47:52.003048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:34:00.806939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.048599+0000","last_change":"2024-09-10T08:47:54.042717+0000","last_active":"2024-09-10T08:47:54.048599+0000","last_peered":"2024-09-10T08:47:54.048599+0000","last_clean":"2024-09-10T08:47:54.048599+0000","last_became_active":"2024-09-10T08:47:54.042458+0000","last_became_peered":"2024-09-10T08:47:54.042458+0000","last_unstale":"2024-09-10T08:47:54.048599+0000","last_undegraded":"2024-09-10T08:47:54.048599+0000","last_fullsized":"2024-09-10T08:47:54.048599+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:38:57.458122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.030240+0000","last_change":"2024-09-10T08:47:53.036813+0000","last_active":"2024-09-10T08:47:54.030240+0000","last_peered":"2024-09-10T08:47:54.030240+0000","last_clean":"2024-09-10T08:47:54.030240+0000","last_became_active":"2024-09-10T08:47:53.036519+0000","last_became_peered":"2024-09-10T08:47:53.036519+0000","last_unstale":"2024-09-10T08:47:54.030240+0000","last_undegraded":"2024-09-10T08:47:54.030240+0000","last_fullsized":"2024-09-10T08:47:54.030240+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_clean_scrub_stamp":"2024-09-10T08:47:52.003048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:56:46.989224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.065519+0000","last_change":"2024-09-10T08:47:54.061617+0000","last_active":"2024-09-10T08:47:54.065519+0000","last_peered":"2024-09-10T08:47:54.065519+0000","last_clean":"2024-09-10T08:47:54.065519+0000","last_became_active":"2024-09-10T08:47:54.061057+0000","last_became_peered":"2024-09-10T08:47:54.061057+0000","last_unstale":"2024-09-10T08:47:54.065519+0000","last_undegraded":"2024-09-10T08:47:54.065519+0000","last_fullsized":"2024-09-10T08:47:54.065519+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:35:09.428560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.023381+0000","last_change":"2024-09-10T08:47:53.032014+0000","last_active":"2024-09-10T08:47:54.023381+0000","last_peered":"2024-09-10T08:47:54.023381+0000","last_clean":"2024-09-10T08:47:54.023381+0000","last_became_active":"2024-09-10T08:47:53.031754+0000","last_became_peered":"2024-09-10T08:47:53.031754+0000","last_unstale":"2024-09-10T08:47:54.023381+0000","last_undegraded":"2024-09-10T08:47:54.023381+0000","last_fullsized":"2024-09-10T08:47:54.023381+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_clean_scrub_stamp":"2024-09-10T08:47:52.003048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:35:10.685692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.052842+0000","last_change":"2024-09-10T08:47:54.040408+0000","last_active":"2024-09-10T08:47:54.052842+0000","last_peered":"2024-09-10T08:47:54.052842+0000","last_clean":"2024-09-10T08:47:54.052842+0000","last_became_active":"2024-09-10T08:47:54.040136+0000","last_became_peered":"2024-09-10T08:47:54.040136+0000","last_unstale":"2024-09-10T08:47:54.052842+0000","last_undegraded":"2024-09-10T08:47:54.052842+0000","last_fullsized":"2024-09-10T08:47:54.052842+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:29:21.218016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.059688+0000","last_change":"2024-09-10T08:47:53.034066+0000","last_active":"2024-09-10T08:47:54.059688+0000","last_peered":"2024-09-10T08:47:54.059688+0000","last_clean":"2024-09-10T08:47:54.059688+0000","last_became_active":"2024-09-10T08:47:53.033830+0000","last_became_peered":"2024-09-10T08:47:53.033830+0000","last_unstale":"2024-09-10T08:47:54.059688+0000","last_undegraded":"2024-09-10T08:47:54.059688+0000","last_fullsized":"2024-09-10T08:47:54.059688+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_clean_scrub_stamp":"2024-09-10T08:47:52.003048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:16.821673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.058962+0000","last_change":"2024-09-10T08:47:54.054155+0000","last_active":"2024-09-10T08:47:54.058962+0000","last_peered":"2024-09-10T08:47:54.058962+0000","last_clean":"2024-09-10T08:47:54.058962+0000","last_became_active":"2024-09-10T08:47:54.053793+0000","last_became_peered":"2024-09-10T08:47:54.053793+0000","last_unstale":"2024-09-10T08:47:54.058962+0000","last_undegraded":"2024-09-10T08:47:54.058962+0000","last_fullsized":"2024-09-10T08:47:54.058962+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:10:07.359735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.023455+0000","last_change":"2024-09-10T08:47:53.031751+0000","last_active":"2024-09-10T08:47:54.023455+0000","last_peered":"2024-09-10T08:47:54.023455+0000","last_clean":"2024-09-10T08:47:54.023455+0000","last_became_active":"2024-09-10T08:47:53.031399+0000","last_became_peered":"2024-09-10T08:47:53.031399+0000","last_unstale":"2024-09-10T08:47:54.023455+0000","last_undegraded":"2024-09-10T08:47:54.023455+0000","last_fullsized":"2024-09-10T08:47:54.023455+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_clean_scrub_stamp":"2024-09-10T08:47:52.003048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:30:21.254777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.063243+0000","last_change":"2024-09-10T08:47:54.054851+0000","last_active":"2024-09-10T08:47:54.063243+0000","last_peered":"2024-09-10T08:47:54.063243+0000","last_clean":"2024-09-10T08:47:54.063243+0000","last_became_active":"2024-09-10T08:47:54.054214+0000","last_became_peered":"2024-09-10T08:47:54.054214+0000","last_unstale":"2024-09-10T08:47:54.063243+0000","last_undegraded":"2024-09-10T08:47:54.063243+0000","last_fullsized":"2024-09-10T08:47:54.063243+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:38:57.458122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.028601+0000","last_change":"2024-09-10T08:47:53.031537+0000","last_active":"2024-09-10T08:47:54.028601+0000","last_peered":"2024-09-10T08:47:54.028601+0000","last_clean":"2024-09-10T08:47:54.028601+0000","last_became_active":"2024-09-10T08:47:53.031272+0000","last_became_peered":"2024-09-10T08:47:53.031272+0000","last_unstale":"2024-09-10T08:47:54.028601+0000","last_undegraded":"2024-09-10T08:47:54.028601+0000","last_fullsized":"2024-09-10T08:47:54.028601+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_clean_scrub_stamp":"2024-09-10T08:47:52.003048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:24:54.437335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.066096+0000","last_change":"2024-09-10T08:47:54.064619+0000","last_active":"2024-09-10T08:47:54.066096+0000","last_peered":"2024-09-10T08:47:54.066096+0000","last_clean":"2024-09-10T08:47:54.066096+0000","last_became_active":"2024-09-10T08:47:54.064349+0000","last_became_peered":"2024-09-10T08:47:54.064349+0000","last_unstale":"2024-09-10T08:47:54.066096+0000","last_undegraded":"2024-09-10T08:47:54.066096+0000","last_fullsized":"2024-09-10T08:47:54.066096+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:36:08.249489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.033333+0000","last_change":"2024-09-10T08:47:53.036526+0000","last_active":"2024-09-10T08:47:54.033333+0000","last_peered":"2024-09-10T08:47:54.033333+0000","last_clean":"2024-09-10T08:47:54.033333+0000","last_became_active":"2024-09-10T08:47:53.036278+0000","last_became_peered":"2024-09-10T08:47:53.036278+0000","last_unstale":"2024-09-10T08:47:54.033333+0000","last_undegraded":"2024-09-10T08:47:54.033333+0000","last_fullsized":"2024-09-10T08:47:54.033333+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_clean_scrub_stamp":"2024-09-10T08:47:52.003048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:29:20.215604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.055273+0000","last_change":"2024-09-10T08:47:54.041278+0000","last_active":"2024-09-10T08:47:54.055273+0000","last_peered":"2024-09-10T08:47:54.055273+0000","last_clean":"2024-09-10T08:47:54.055273+0000","last_became_active":"2024-09-10T08:47:54.040974+0000","last_became_peered":"2024-09-10T08:47:54.040974+0000","last_unstale":"2024-09-10T08:47:54.055273+0000","last_undegraded":"2024-09-10T08:47:54.055273+0000","last_fullsized":"2024-09-10T08:47:54.055273+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:08.518513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.028457+0000","last_change":"2024-09-10T08:47:53.034441+0000","last_active":"2024-09-10T08:47:54.028457+0000","last_peered":"2024-09-10T08:47:54.028457+0000","last_clean":"2024-09-10T08:47:54.028457+0000","last_became_active":"2024-09-10T08:47:53.033394+0000","last_became_peered":"2024-09-10T08:47:53.033394+0000","last_unstale":"2024-09-10T08:47:54.028457+0000","last_undegraded":"2024-09-10T08:47:54.028457+0000","last_fullsized":"2024-09-10T08:47:54.028457+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_clean_scrub_stamp":"2024-09-10T08:47:52.003048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:04:10.828802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.065510+0000","last_change":"2024-09-10T08:47:54.062696+0000","last_active":"2024-09-10T08:47:54.065510+0000","last_peered":"2024-09-10T08:47:54.065510+0000","last_clean":"2024-09-10T08:47:54.065510+0000","last_became_active":"2024-09-10T08:47:54.061992+0000","last_became_peered":"2024-09-10T08:47:54.061992+0000","last_unstale":"2024-09-10T08:47:54.065510+0000","last_undegraded":"2024-09-10T08:47:54.065510+0000","last_fullsized":"2024-09-10T08:47:54.065510+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:36:44.497603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.024287+0000","last_change":"2024-09-10T08:47:53.029213+0000","last_active":"2024-09-10T08:47:54.024287+0000","last_peered":"2024-09-10T08:47:54.024287+0000","last_clean":"2024-09-10T08:47:54.024287+0000","last_became_active":"2024-09-10T08:47:53.028866+0000","last_became_peered":"2024-09-10T08:47:53.028866+0000","last_unstale":"2024-09-10T08:47:54.024287+0000","last_undegraded":"2024-09-10T08:47:54.024287+0000","last_fullsized":"2024-09-10T08:47:54.024287+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_clean_scrub_stamp":"2024-09-10T08:47:52.003048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:35:46.815735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.050726+0000","last_change":"2024-09-10T08:47:54.043941+0000","last_active":"2024-09-10T08:47:54.050726+0000","last_peered":"2024-09-10T08:47:54.050726+0000","last_clean":"2024-09-10T08:47:54.050726+0000","last_became_active":"2024-09-10T08:47:54.042288+0000","last_became_peered":"2024-09-10T08:47:54.042288+0000","last_unstale":"2024-09-10T08:47:54.050726+0000","last_undegraded":"2024-09-10T08:47:54.050726+0000","last_fullsized":"2024-09-10T08:47:54.050726+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:36:44.497603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.058313+0000","last_change":"2024-09-10T08:47:53.030357+0000","last_active":"2024-09-10T08:47:54.058313+0000","last_peered":"2024-09-10T08:47:54.058313+0000","last_clean":"2024-09-10T08:47:54.058313+0000","last_became_active":"2024-09-10T08:47:53.030110+0000","last_became_peered":"2024-09-10T08:47:53.030110+0000","last_unstale":"2024-09-10T08:47:54.058313+0000","last_undegraded":"2024-09-10T08:47:54.058313+0000","last_fullsized":"2024-09-10T08:47:54.058313+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_clean_scrub_stamp":"2024-09-10T08:47:52.003048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:55:59.612280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.071515+0000","last_change":"2024-09-10T08:47:54.069990+0000","last_active":"2024-09-10T08:47:54.071515+0000","last_peered":"2024-09-10T08:47:54.071515+0000","last_clean":"2024-09-10T08:47:54.071515+0000","last_became_active":"2024-09-10T08:47:54.069586+0000","last_became_peered":"2024-09-10T08:47:54.069586+0000","last_unstale":"2024-09-10T08:47:54.071515+0000","last_undegraded":"2024-09-10T08:47:54.071515+0000","last_fullsized":"2024-09-10T08:47:54.071515+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:05:25.630297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.034795+0000","last_change":"2024-09-10T08:47:53.035241+0000","last_active":"2024-09-10T08:47:54.034795+0000","last_peered":"2024-09-10T08:47:54.034795+0000","last_clean":"2024-09-10T08:47:54.034795+0000","last_became_active":"2024-09-10T08:47:53.034719+0000","last_became_peered":"2024-09-10T08:47:53.034719+0000","last_unstale":"2024-09-10T08:47:54.034795+0000","last_undegraded":"2024-09-10T08:47:54.034795+0000","last_fullsized":"2024-09-10T08:47:54.034795+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_clean_scrub_stamp":"2024-09-10T08:47:52.003048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:48:19.674548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":200,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.030988+0000","last_change":"2024-09-10T08:46:42.177049+0000","last_active":"2024-09-10T08:47:54.030988+0000","last_peered":"2024-09-10T08:47:54.030988+0000","last_clean":"2024-09-10T08:47:54.030988+0000","last_became_active":"2024-09-10T08:46:42.175678+0000","last_became_peered":"2024-09-10T08:46:42.175678+0000","last_unstale":"2024-09-10T08:47:54.030988+0000","last_undegraded":"2024-09-10T08:47:54.030988+0000","last_fullsized":"2024-09-10T08:47:54.030988+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:40.326212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:40.326212+0000","last_clean_scrub_stamp":"2024-09-10T08:46:40.326212+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:06.642437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28016,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343824,"statfs":{"total":96636764160,"available":96608075776,"internally_reserved":0,"allocated":1007616,"data_stored":766707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":430080,"data_stored":184088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":434176,"data_stored":183618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":434176,"data_stored":184110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31596,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340244,"statfs":{"total":96636764160,"available":96604409856,"internally_reserved":0,"allocated":413696,"data_stored":176339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31612,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340228,"statfs":{"total":96636764160,"available":96604393472,"internally_reserved":0,"allocated":430080,"data_stored":183576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31592,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340248,"statfs":{"total":96636764160,"available":96604413952,"internally_reserved":0,"allocated":413696,"data_stored":176339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32188,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339652,"statfs":{"total":96636764160,"available":96603803648,"internally_reserved":0,"allocated":1024000,"data_stored":773908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:47:58.243 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:47:58.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.434+0000 7f9c37200640 1 Processor -- start 2024-09-10T08:47:58.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.434+0000 7f9c37200640 1 -- start start 2024-09-10T08:47:58.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.435+0000 7f9c37200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c380cebc0 0x7f9c380b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:58.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.435+0000 7f9c37200640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c380d4180 con 0x7f9c3815e4c0 2024-09-10T08:47:58.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.435+0000 7f9c37200640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c380d30e0 con 0x7f9c380b6320 2024-09-10T08:47:58.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.435+0000 7f9c37200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9c380b6770 con 0x7f9c380cebc0 2024-09-10T08:47:58.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.435+0000 7f9c35e00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f9c3815e4c0 0x7f9c380d2890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:40984/0 (socket says 172.21.15.2:40984) 2024-09-10T08:47:58.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.435+0000 7f9c35e00640 1 -- 172.21.15.2:0/530748117 learned_addr learned my addr 172.21.15.2:0/530748117 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:47:58.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.436+0000 7f9c35400640 1 --2- 172.21.15.2:0/530748117 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c380cebc0 0x7f9c380b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:58.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.436+0000 7f9c34a00640 1 -- 172.21.15.2:0/530748117 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1965083899 0 0) 0x7f9c28001110 con 0x7f9c3815e4c0 2024-09-10T08:47:58.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.436+0000 7f9c34a00640 1 -- 172.21.15.2:0/530748117 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c1c003520 con 0x7f9c3815e4c0 2024-09-10T08:47:58.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.436+0000 7f9c34a00640 1 -- 172.21.15.2:0/530748117 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3881581747 0 0) 0x7f9c380d30e0 con 0x7f9c380b6320 2024-09-10T08:47:58.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.436+0000 7f9c34a00640 1 -- 172.21.15.2:0/530748117 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c28001110 con 0x7f9c380b6320 2024-09-10T08:47:58.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.436+0000 7f9c34a00640 1 -- 172.21.15.2:0/530748117 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 126083089 0 0) 0x7f9c1c003520 con 0x7f9c3815e4c0 2024-09-10T08:47:58.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.436+0000 7f9c35400640 1 -- 172.21.15.2:0/530748117 >> v1:172.21.15.155:6789/0 conn(0x7f9c380b6320 legacy=0x7f9c380b7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:58.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.436+0000 7f9c35400640 1 -- 172.21.15.2:0/530748117 >> v1:172.21.15.2:6789/0 conn(0x7f9c3815e4c0 legacy=0x7f9c380d2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:58.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.436+0000 7f9c35400640 1 -- 172.21.15.2:0/530748117 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c380d33c0 con 0x7f9c380cebc0 2024-09-10T08:47:58.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.437+0000 7f9c35400640 1 --2- 172.21.15.2:0/530748117 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c380cebc0 0x7f9c380b5de0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9c240097d0 tx=0x7f9c2402a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0771f7a578d390d server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:58.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.437+0000 7f9c34a00640 1 -- 172.21.15.2:0/530748117 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c24037070 con 0x7f9c380cebc0 2024-09-10T08:47:58.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.437+0000 7f9c34a00640 1 -- 172.21.15.2:0/530748117 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c2402ab90 con 0x7f9c380cebc0 2024-09-10T08:47:58.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.437+0000 7f9c34a00640 1 -- 172.21.15.2:0/530748117 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c28001840 con 0x7f9c380cebc0 2024-09-10T08:47:58.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.438+0000 7f9c37200640 1 -- 172.21.15.2:0/530748117 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c380cebc0 msgr2=0x7f9c380b5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:58.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.438+0000 7f9c37200640 1 --2- 172.21.15.2:0/530748117 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c380cebc0 0x7f9c380b5de0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9c240097d0 tx=0x7f9c2402a100 comp rx=0 tx=0).stop 2024-09-10T08:47:58.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.438+0000 7f9c37200640 1 -- 172.21.15.2:0/530748117 shutdown_connections 2024-09-10T08:47:58.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.438+0000 7f9c37200640 1 --2- 172.21.15.2:0/530748117 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c380cebc0 0x7f9c380b5de0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:58.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.438+0000 7f9c37200640 1 -- 172.21.15.2:0/530748117 >> 172.21.15.2:0/530748117 conn(0x7f9c380d0de0 msgr2=0x7f9c380d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:58.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.438+0000 7f9c37200640 1 -- 172.21.15.2:0/530748117 shutdown_connections 2024-09-10T08:47:58.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.438+0000 7f9c37200640 1 -- 172.21.15.2:0/530748117 wait complete. 2024-09-10T08:47:58.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.440+0000 7f9c37200640 1 Processor -- start 2024-09-10T08:47:58.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.440+0000 7f9c37200640 1 -- start start 2024-09-10T08:47:58.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.441+0000 7f9c37200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c380b6320 0x7f9c38159270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:58.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.441+0000 7f9c37200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c380cebc0 0x7f9c381f87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:58.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.441+0000 7f9c37200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c3815e4c0 0x7f9c38154790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:58.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.441+0000 7f9c37200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f9c380d3c60 con 0x7f9c380b6320 2024-09-10T08:47:58.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.441+0000 7f9c37200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9c380d3980 con 0x7f9c3815e4c0 2024-09-10T08:47:58.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.441+0000 7f9c37200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f9c3815e8a0 con 0x7f9c380cebc0 2024-09-10T08:47:58.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.441+0000 7f9c35e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c380b6320 0x7f9c38159270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:58.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.441+0000 7f9c35e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c380b6320 0x7f9c38159270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55628/0 (socket says 172.21.15.2:55628) 2024-09-10T08:47:58.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.441+0000 7f9c35e00640 1 -- 172.21.15.2:0/321573428 learned_addr learned my addr 172.21.15.2:0/321573428 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:58.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.441+0000 7f9c35400640 1 --2- 172.21.15.2:0/321573428 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c380cebc0 0x7f9c381f87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:58.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.441+0000 7f9c36800640 1 --2- 172.21.15.2:0/321573428 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c3815e4c0 0x7f9c38154790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:58.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.441+0000 7f9c35e00640 1 -- 172.21.15.2:0/321573428 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c380cebc0 msgr2=0x7f9c381f87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:58.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.441+0000 7f9c35e00640 1 --2- 172.21.15.2:0/321573428 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c380cebc0 0x7f9c381f87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:58.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.441+0000 7f9c35e00640 1 -- 172.21.15.2:0/321573428 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c3815e4c0 msgr2=0x7f9c38154790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:58.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.441+0000 7f9c35e00640 1 --2- 172.21.15.2:0/321573428 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c3815e4c0 0x7f9c38154790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:58.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.441+0000 7f9c35e00640 1 -- 172.21.15.2:0/321573428 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c381f8ce0 con 0x7f9c380b6320 2024-09-10T08:47:58.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.442+0000 7f9c35e00640 1 --2- 172.21.15.2:0/321573428 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c380b6320 0x7f9c38159270 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9c2800caf0 tx=0x7f9c28001870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:58.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.442+0000 7f9c2e000640 1 -- 172.21.15.2:0/321573428 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c28017070 con 0x7f9c380b6320 2024-09-10T08:47:58.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.442+0000 7f9c2e000640 1 -- 172.21.15.2:0/321573428 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c28005d00 con 0x7f9c380b6320 2024-09-10T08:47:58.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.442+0000 7f9c2e000640 1 -- 172.21.15.2:0/321573428 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c280072b0 con 0x7f9c380b6320 2024-09-10T08:47:58.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.442+0000 7f9c37200640 1 -- 172.21.15.2:0/321573428 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c38154cd0 con 0x7f9c380b6320 2024-09-10T08:47:58.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.442+0000 7f9c37200640 1 -- 172.21.15.2:0/321573428 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c3815ed70 con 0x7f9c380b6320 2024-09-10T08:47:58.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.443+0000 7f9c37200640 1 -- 172.21.15.2:0/321573428 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c380b5de0 con 0x7f9c380b6320 2024-09-10T08:47:58.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.444+0000 7f9c2e000640 1 -- 172.21.15.2:0/321573428 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9c2801a070 con 0x7f9c380b6320 2024-09-10T08:47:58.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.445+0000 7f9c2e000640 1 --2- 172.21.15.2:0/321573428 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f9c1806be60 0x7f9c1806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:58.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.445+0000 7f9c2e000640 1 -- 172.21.15.2:0/321573428 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f9c2808a710 con 0x7f9c380b6320 2024-09-10T08:47:58.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.445+0000 7f9c35400640 1 --2- 172.21.15.2:0/321573428 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f9c1806be60 0x7f9c1806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:58.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.446+0000 7f9c35400640 1 --2- 172.21.15.2:0/321573428 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f9c1806be60 0x7f9c1806e320 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9c24034000 tx=0x7f9c2402e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:58.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.449+0000 7f9c2e000640 1 -- 172.21.15.2:0/321573428 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9c381f8ce0 con 0x7f9c380b6320 2024-09-10T08:47:58.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.630+0000 7f9c37200640 1 -- 172.21.15.2:0/321573428 --> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9c380b7240 con 0x7f9c1806be60 2024-09-10T08:47:58.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.637+0000 7f9c2e000640 1 -- 172.21.15.2:0/321573428 <== mgr.4099 v2:172.21.15.155:6832/2611418382 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251888 (secure 0 0 0) 0x7f9c24080800 con 0x7f9c1806be60 2024-09-10T08:47:58.641 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:47:58.642 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-10T08:47:58.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.641+0000 7f9c37200640 1 -- 172.21.15.2:0/321573428 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f9c1806be60 msgr2=0x7f9c1806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:58.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.641+0000 7f9c37200640 1 --2- 172.21.15.2:0/321573428 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f9c1806be60 0x7f9c1806e320 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9c24034000 tx=0x7f9c2402e000 comp rx=0 tx=0).stop 2024-09-10T08:47:58.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.641+0000 7f9c37200640 1 -- 172.21.15.2:0/321573428 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c380b6320 msgr2=0x7f9c38159270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:58.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.641+0000 7f9c37200640 1 --2- 172.21.15.2:0/321573428 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c380b6320 0x7f9c38159270 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9c2800caf0 tx=0x7f9c28001870 comp rx=0 tx=0).stop 2024-09-10T08:47:58.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.641+0000 7f9c37200640 1 -- 172.21.15.2:0/321573428 shutdown_connections 2024-09-10T08:47:58.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.641+0000 7f9c37200640 1 --2- 172.21.15.2:0/321573428 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c3815e4c0 0x7f9c38154790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:58.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.641+0000 7f9c37200640 1 --2- 172.21.15.2:0/321573428 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f9c1806be60 0x7f9c1806e320 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:58.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.641+0000 7f9c37200640 1 --2- 172.21.15.2:0/321573428 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c380cebc0 0x7f9c381f87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:58.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.641+0000 7f9c37200640 1 --2- 172.21.15.2:0/321573428 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c380b6320 0x7f9c38159270 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:58.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.641+0000 7f9c37200640 1 -- 172.21.15.2:0/321573428 >> 172.21.15.2:0/321573428 conn(0x7f9c380d0de0 msgr2=0x7f9c380d2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:58.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.641+0000 7f9c37200640 1 -- 172.21.15.2:0/321573428 shutdown_connections 2024-09-10T08:47:58.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.641+0000 7f9c37200640 1 -- 172.21.15.2:0/321573428 wait complete. 2024-09-10T08:47:58.658 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2024-09-10T08:47:57.388204+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":99,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237364,"kb_used_data":4480,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737356,"statfs":{"total":773094113280,"available":772851052544,"internally_reserved":0,"allocated":4587520,"data_stored":2628685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.378842"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.069596+0000","last_change":"2024-09-10T08:47:54.066656+0000","last_active":"2024-09-10T08:47:54.069596+0000","last_peered":"2024-09-10T08:47:54.069596+0000","last_clean":"2024-09-10T08:47:54.069596+0000","last_became_active":"2024-09-10T08:47:54.066421+0000","last_became_peered":"2024-09-10T08:47:54.066421+0000","last_unstale":"2024-09-10T08:47:54.069596+0000","last_undegraded":"2024-09-10T08:47:54.069596+0000","last_fullsized":"2024-09-10T08:47:54.069596+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:33:33.440487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.063302+0000","last_change":"2024-09-10T08:47:54.055089+0000","last_active":"2024-09-10T08:47:54.063302+0000","last_peered":"2024-09-10T08:47:54.063302+0000","last_clean":"2024-09-10T08:47:54.063302+0000","last_became_active":"2024-09-10T08:47:54.054551+0000","last_became_peered":"2024-09-10T08:47:54.054551+0000","last_unstale":"2024-09-10T08:47:54.063302+0000","last_undegraded":"2024-09-10T08:47:54.063302+0000","last_fullsized":"2024-09-10T08:47:54.063302+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:36:08.249489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.049534+0000","last_change":"2024-09-10T08:47:54.044420+0000","last_active":"2024-09-10T08:47:54.049534+0000","last_peered":"2024-09-10T08:47:54.049534+0000","last_clean":"2024-09-10T08:47:54.049534+0000","last_became_active":"2024-09-10T08:47:54.044152+0000","last_became_peered":"2024-09-10T08:47:54.044152+0000","last_unstale":"2024-09-10T08:47:54.049534+0000","last_undegraded":"2024-09-10T08:47:54.049534+0000","last_fullsized":"2024-09-10T08:47:54.049534+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:36:25.270876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.037946+0000","last_change":"2024-09-10T08:47:54.034781+0000","last_active":"2024-09-10T08:47:54.037946+0000","last_peered":"2024-09-10T08:47:54.037946+0000","last_clean":"2024-09-10T08:47:54.037946+0000","last_became_active":"2024-09-10T08:47:54.034454+0000","last_became_peered":"2024-09-10T08:47:54.034454+0000","last_unstale":"2024-09-10T08:47:54.037946+0000","last_undegraded":"2024-09-10T08:47:54.037946+0000","last_fullsized":"2024-09-10T08:47:54.037946+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:38:32.853167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.036152+0000","last_change":"2024-09-10T08:47:54.032474+0000","last_active":"2024-09-10T08:47:54.036152+0000","last_peered":"2024-09-10T08:47:54.036152+0000","last_clean":"2024-09-10T08:47:54.036152+0000","last_became_active":"2024-09-10T08:47:54.032188+0000","last_became_peered":"2024-09-10T08:47:54.032188+0000","last_unstale":"2024-09-10T08:47:54.036152+0000","last_undegraded":"2024-09-10T08:47:54.036152+0000","last_fullsized":"2024-09-10T08:47:54.036152+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:29:16.902647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.071457+0000","last_change":"2024-09-10T08:47:54.069513+0000","last_active":"2024-09-10T08:47:54.071457+0000","last_peered":"2024-09-10T08:47:54.071457+0000","last_clean":"2024-09-10T08:47:54.071457+0000","last_became_active":"2024-09-10T08:47:54.069238+0000","last_became_peered":"2024-09-10T08:47:54.069238+0000","last_unstale":"2024-09-10T08:47:54.071457+0000","last_undegraded":"2024-09-10T08:47:54.071457+0000","last_fullsized":"2024-09-10T08:47:54.071457+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:36:44.497603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.068499+0000","last_change":"2024-09-10T08:47:54.067161+0000","last_active":"2024-09-10T08:47:54.068499+0000","last_peered":"2024-09-10T08:47:54.068499+0000","last_clean":"2024-09-10T08:47:54.068499+0000","last_became_active":"2024-09-10T08:47:54.066912+0000","last_became_peered":"2024-09-10T08:47:54.066912+0000","last_unstale":"2024-09-10T08:47:54.068499+0000","last_undegraded":"2024-09-10T08:47:54.068499+0000","last_fullsized":"2024-09-10T08:47:54.068499+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:54:47.827173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.071109+0000","last_change":"2024-09-10T08:47:54.069342+0000","last_active":"2024-09-10T08:47:54.071109+0000","last_peered":"2024-09-10T08:47:54.071109+0000","last_clean":"2024-09-10T08:47:54.071109+0000","last_became_active":"2024-09-10T08:47:54.068952+0000","last_became_peered":"2024-09-10T08:47:54.068952+0000","last_unstale":"2024-09-10T08:47:54.071109+0000","last_undegraded":"2024-09-10T08:47:54.071109+0000","last_fullsized":"2024-09-10T08:47:54.071109+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:42:06.509817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.049575+0000","last_change":"2024-09-10T08:47:54.045957+0000","last_active":"2024-09-10T08:47:54.049575+0000","last_peered":"2024-09-10T08:47:54.049575+0000","last_clean":"2024-09-10T08:47:54.049575+0000","last_became_active":"2024-09-10T08:47:54.045652+0000","last_became_peered":"2024-09-10T08:47:54.045652+0000","last_unstale":"2024-09-10T08:47:54.049575+0000","last_undegraded":"2024-09-10T08:47:54.049575+0000","last_fullsized":"2024-09-10T08:47:54.049575+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:17.824086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.060725+0000","last_change":"2024-09-10T08:47:54.056475+0000","last_active":"2024-09-10T08:47:54.060725+0000","last_peered":"2024-09-10T08:47:54.060725+0000","last_clean":"2024-09-10T08:47:54.060725+0000","last_became_active":"2024-09-10T08:47:54.055492+0000","last_became_peered":"2024-09-10T08:47:54.055492+0000","last_unstale":"2024-09-10T08:47:54.060725+0000","last_undegraded":"2024-09-10T08:47:54.060725+0000","last_fullsized":"2024-09-10T08:47:54.060725+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:19:16.826406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.053789+0000","last_change":"2024-09-10T08:47:54.049142+0000","last_active":"2024-09-10T08:47:54.053789+0000","last_peered":"2024-09-10T08:47:54.053789+0000","last_clean":"2024-09-10T08:47:54.053789+0000","last_became_active":"2024-09-10T08:47:54.047386+0000","last_became_peered":"2024-09-10T08:47:54.047386+0000","last_unstale":"2024-09-10T08:47:54.053789+0000","last_undegraded":"2024-09-10T08:47:54.053789+0000","last_fullsized":"2024-09-10T08:47:54.053789+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:18:52.134514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.049325+0000","last_change":"2024-09-10T08:47:54.045271+0000","last_active":"2024-09-10T08:47:54.049325+0000","last_peered":"2024-09-10T08:47:54.049325+0000","last_clean":"2024-09-10T08:47:54.049325+0000","last_became_active":"2024-09-10T08:47:54.042846+0000","last_became_peered":"2024-09-10T08:47:54.042846+0000","last_unstale":"2024-09-10T08:47:54.049325+0000","last_undegraded":"2024-09-10T08:47:54.049325+0000","last_fullsized":"2024-09-10T08:47:54.049325+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:36:44.497603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.059968+0000","last_change":"2024-09-10T08:47:54.053207+0000","last_active":"2024-09-10T08:47:54.059968+0000","last_peered":"2024-09-10T08:47:54.059968+0000","last_clean":"2024-09-10T08:47:54.059968+0000","last_became_active":"2024-09-10T08:47:54.052975+0000","last_became_peered":"2024-09-10T08:47:54.052975+0000","last_unstale":"2024-09-10T08:47:54.059968+0000","last_undegraded":"2024-09-10T08:47:54.059968+0000","last_fullsized":"2024-09-10T08:47:54.059968+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:10:07.359735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.050102+0000","last_change":"2024-09-10T08:47:54.042526+0000","last_active":"2024-09-10T08:47:54.050102+0000","last_peered":"2024-09-10T08:47:54.050102+0000","last_clean":"2024-09-10T08:47:54.050102+0000","last_became_active":"2024-09-10T08:47:54.042203+0000","last_became_peered":"2024-09-10T08:47:54.042203+0000","last_unstale":"2024-09-10T08:47:54.050102+0000","last_undegraded":"2024-09-10T08:47:54.050102+0000","last_fullsized":"2024-09-10T08:47:54.050102+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:48:20.676961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.052675+0000","last_change":"2024-09-10T08:47:54.046017+0000","last_active":"2024-09-10T08:47:54.052675+0000","last_peered":"2024-09-10T08:47:54.052675+0000","last_clean":"2024-09-10T08:47:54.052675+0000","last_became_active":"2024-09-10T08:47:54.044336+0000","last_became_peered":"2024-09-10T08:47:54.044336+0000","last_unstale":"2024-09-10T08:47:54.052675+0000","last_undegraded":"2024-09-10T08:47:54.052675+0000","last_fullsized":"2024-09-10T08:47:54.052675+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:10:58.984569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.054988+0000","last_change":"2024-09-10T08:47:54.046297+0000","last_active":"2024-09-10T08:47:54.054988+0000","last_peered":"2024-09-10T08:47:54.054988+0000","last_clean":"2024-09-10T08:47:54.054988+0000","last_became_active":"2024-09-10T08:47:54.044151+0000","last_became_peered":"2024-09-10T08:47:54.044151+0000","last_unstale":"2024-09-10T08:47:54.054988+0000","last_undegraded":"2024-09-10T08:47:54.054988+0000","last_fullsized":"2024-09-10T08:47:54.054988+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:32:59.447916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.053987+0000","last_change":"2024-09-10T08:47:54.048332+0000","last_active":"2024-09-10T08:47:54.053987+0000","last_peered":"2024-09-10T08:47:54.053987+0000","last_clean":"2024-09-10T08:47:54.053987+0000","last_became_active":"2024-09-10T08:47:54.047880+0000","last_became_peered":"2024-09-10T08:47:54.047880+0000","last_unstale":"2024-09-10T08:47:54.053987+0000","last_undegraded":"2024-09-10T08:47:54.053987+0000","last_fullsized":"2024-09-10T08:47:54.053987+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:36:08.249489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.039574+0000","last_change":"2024-09-10T08:47:54.033410+0000","last_active":"2024-09-10T08:47:54.039574+0000","last_peered":"2024-09-10T08:47:54.039574+0000","last_clean":"2024-09-10T08:47:54.039574+0000","last_became_active":"2024-09-10T08:47:54.033077+0000","last_became_peered":"2024-09-10T08:47:54.033077+0000","last_unstale":"2024-09-10T08:47:54.039574+0000","last_undegraded":"2024-09-10T08:47:54.039574+0000","last_fullsized":"2024-09-10T08:47:54.039574+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:25:48.167920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.035067+0000","last_change":"2024-09-10T08:47:54.031427+0000","last_active":"2024-09-10T08:47:54.035067+0000","last_peered":"2024-09-10T08:47:54.035067+0000","last_clean":"2024-09-10T08:47:54.035067+0000","last_became_active":"2024-09-10T08:47:54.031154+0000","last_became_peered":"2024-09-10T08:47:54.031154+0000","last_unstale":"2024-09-10T08:47:54.035067+0000","last_undegraded":"2024-09-10T08:47:54.035067+0000","last_fullsized":"2024-09-10T08:47:54.035067+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:32:08.278076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.039664+0000","last_change":"2024-09-10T08:47:54.034606+0000","last_active":"2024-09-10T08:47:54.039664+0000","last_peered":"2024-09-10T08:47:54.039664+0000","last_clean":"2024-09-10T08:47:54.039664+0000","last_became_active":"2024-09-10T08:47:54.034295+0000","last_became_peered":"2024-09-10T08:47:54.034295+0000","last_unstale":"2024-09-10T08:47:54.039664+0000","last_undegraded":"2024-09-10T08:47:54.039664+0000","last_fullsized":"2024-09-10T08:47:54.039664+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:51:45.693884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.048690+0000","last_change":"2024-09-10T08:47:54.042152+0000","last_active":"2024-09-10T08:47:54.048690+0000","last_peered":"2024-09-10T08:47:54.048690+0000","last_clean":"2024-09-10T08:47:54.048690+0000","last_became_active":"2024-09-10T08:47:54.041808+0000","last_became_peered":"2024-09-10T08:47:54.041808+0000","last_unstale":"2024-09-10T08:47:54.048690+0000","last_undegraded":"2024-09-10T08:47:54.048690+0000","last_fullsized":"2024-09-10T08:47:54.048690+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:32:59.447916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.044157+0000","last_change":"2024-09-10T08:47:54.036979+0000","last_active":"2024-09-10T08:47:54.044157+0000","last_peered":"2024-09-10T08:47:54.044157+0000","last_clean":"2024-09-10T08:47:54.044157+0000","last_became_active":"2024-09-10T08:47:54.036685+0000","last_became_peered":"2024-09-10T08:47:54.036685+0000","last_unstale":"2024-09-10T08:47:54.044157+0000","last_undegraded":"2024-09-10T08:47:54.044157+0000","last_fullsized":"2024-09-10T08:47:54.044157+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:24:55.439747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.051658+0000","last_change":"2024-09-10T08:47:54.044871+0000","last_active":"2024-09-10T08:47:54.051658+0000","last_peered":"2024-09-10T08:47:54.051658+0000","last_clean":"2024-09-10T08:47:54.051658+0000","last_became_active":"2024-09-10T08:47:54.044606+0000","last_became_peered":"2024-09-10T08:47:54.044606+0000","last_unstale":"2024-09-10T08:47:54.051658+0000","last_undegraded":"2024-09-10T08:47:54.051658+0000","last_fullsized":"2024-09-10T08:47:54.051658+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:17.824086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.052791+0000","last_change":"2024-09-10T08:47:54.050394+0000","last_active":"2024-09-10T08:47:54.052791+0000","last_peered":"2024-09-10T08:47:54.052791+0000","last_clean":"2024-09-10T08:47:54.052791+0000","last_became_active":"2024-09-10T08:47:54.049462+0000","last_became_peered":"2024-09-10T08:47:54.049462+0000","last_unstale":"2024-09-10T08:47:54.052791+0000","last_undegraded":"2024-09-10T08:47:54.052791+0000","last_fullsized":"2024-09-10T08:47:54.052791+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:00:14.660427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.043248+0000","last_change":"2024-09-10T08:47:54.039023+0000","last_active":"2024-09-10T08:47:54.043248+0000","last_peered":"2024-09-10T08:47:54.043248+0000","last_clean":"2024-09-10T08:47:54.043248+0000","last_became_active":"2024-09-10T08:47:54.038018+0000","last_became_peered":"2024-09-10T08:47:54.038018+0000","last_unstale":"2024-09-10T08:47:54.043248+0000","last_undegraded":"2024-09-10T08:47:54.043248+0000","last_fullsized":"2024-09-10T08:47:54.043248+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:24:55.439747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.054105+0000","last_change":"2024-09-10T08:47:54.041481+0000","last_active":"2024-09-10T08:47:54.054105+0000","last_peered":"2024-09-10T08:47:54.054105+0000","last_clean":"2024-09-10T08:47:54.054105+0000","last_became_active":"2024-09-10T08:47:54.041181+0000","last_became_peered":"2024-09-10T08:47:54.041181+0000","last_unstale":"2024-09-10T08:47:54.054105+0000","last_undegraded":"2024-09-10T08:47:54.054105+0000","last_fullsized":"2024-09-10T08:47:54.054105+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:48:20.676961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.046806+0000","last_change":"2024-09-10T08:47:54.039074+0000","last_active":"2024-09-10T08:47:54.046806+0000","last_peered":"2024-09-10T08:47:54.046806+0000","last_clean":"2024-09-10T08:47:54.046806+0000","last_became_active":"2024-09-10T08:47:54.037364+0000","last_became_peered":"2024-09-10T08:47:54.037364+0000","last_unstale":"2024-09-10T08:47:54.046806+0000","last_undegraded":"2024-09-10T08:47:54.046806+0000","last_fullsized":"2024-09-10T08:47:54.046806+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:56:47.991637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.063424+0000","last_change":"2024-09-10T08:47:54.058883+0000","last_active":"2024-09-10T08:47:54.063424+0000","last_peered":"2024-09-10T08:47:54.063424+0000","last_clean":"2024-09-10T08:47:54.063424+0000","last_became_active":"2024-09-10T08:47:54.058593+0000","last_became_peered":"2024-09-10T08:47:54.058593+0000","last_unstale":"2024-09-10T08:47:54.063424+0000","last_undegraded":"2024-09-10T08:47:54.063424+0000","last_fullsized":"2024-09-10T08:47:54.063424+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:35:09.428560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.037401+0000","last_change":"2024-09-10T08:47:54.031807+0000","last_active":"2024-09-10T08:47:54.037401+0000","last_peered":"2024-09-10T08:47:54.037401+0000","last_clean":"2024-09-10T08:47:54.037401+0000","last_became_active":"2024-09-10T08:47:54.031519+0000","last_became_peered":"2024-09-10T08:47:54.031519+0000","last_unstale":"2024-09-10T08:47:54.037401+0000","last_undegraded":"2024-09-10T08:47:54.037401+0000","last_fullsized":"2024-09-10T08:47:54.037401+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:35:47.818148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.065461+0000","last_change":"2024-09-10T08:47:54.062716+0000","last_active":"2024-09-10T08:47:54.065461+0000","last_peered":"2024-09-10T08:47:54.065461+0000","last_clean":"2024-09-10T08:47:54.065461+0000","last_became_active":"2024-09-10T08:47:54.062362+0000","last_became_peered":"2024-09-10T08:47:54.062362+0000","last_unstale":"2024-09-10T08:47:54.065461+0000","last_undegraded":"2024-09-10T08:47:54.065461+0000","last_fullsized":"2024-09-10T08:47:54.065461+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:29:21.218016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.056758+0000","last_change":"2024-09-10T08:47:54.051520+0000","last_active":"2024-09-10T08:47:54.056758+0000","last_peered":"2024-09-10T08:47:54.056758+0000","last_clean":"2024-09-10T08:47:54.056758+0000","last_became_active":"2024-09-10T08:47:54.051065+0000","last_became_peered":"2024-09-10T08:47:54.051065+0000","last_unstale":"2024-09-10T08:47:54.056758+0000","last_undegraded":"2024-09-10T08:47:54.056758+0000","last_fullsized":"2024-09-10T08:47:54.056758+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:56:00.614693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.051097+0000","last_change":"2024-09-10T08:47:54.038637+0000","last_active":"2024-09-10T08:47:54.051097+0000","last_peered":"2024-09-10T08:47:54.051097+0000","last_clean":"2024-09-10T08:47:54.051097+0000","last_became_active":"2024-09-10T08:47:54.038363+0000","last_became_peered":"2024-09-10T08:47:54.038363+0000","last_unstale":"2024-09-10T08:47:54.051097+0000","last_undegraded":"2024-09-10T08:47:54.051097+0000","last_fullsized":"2024-09-10T08:47:54.051097+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:56:47.991637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.058283+0000","last_change":"2024-09-10T08:47:54.052828+0000","last_active":"2024-09-10T08:47:54.058283+0000","last_peered":"2024-09-10T08:47:54.058283+0000","last_clean":"2024-09-10T08:47:54.058283+0000","last_became_active":"2024-09-10T08:47:54.052545+0000","last_became_peered":"2024-09-10T08:47:54.052545+0000","last_unstale":"2024-09-10T08:47:54.058283+0000","last_undegraded":"2024-09-10T08:47:54.058283+0000","last_fullsized":"2024-09-10T08:47:54.058283+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:10:58.984569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"37'4","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.063658+0000","last_change":"2024-09-10T08:47:53.028540+0000","last_active":"2024-09-10T08:47:54.063658+0000","last_peered":"2024-09-10T08:47:54.063658+0000","last_clean":"2024-09-10T08:47:54.063658+0000","last_became_active":"2024-09-10T08:47:53.028309+0000","last_became_peered":"2024-09-10T08:47:53.028309+0000","last_unstale":"2024-09-10T08:47:54.063658+0000","last_undegraded":"2024-09-10T08:47:54.063658+0000","last_fullsized":"2024-09-10T08:47:54.063658+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_clean_scrub_stamp":"2024-09-10T08:47:52.003048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:00:13.658014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.055231+0000","last_change":"2024-09-10T08:47:54.049068+0000","last_active":"2024-09-10T08:47:54.055231+0000","last_peered":"2024-09-10T08:47:54.055231+0000","last_clean":"2024-09-10T08:47:54.055231+0000","last_became_active":"2024-09-10T08:47:54.048780+0000","last_became_peered":"2024-09-10T08:47:54.048780+0000","last_unstale":"2024-09-10T08:47:54.055231+0000","last_undegraded":"2024-09-10T08:47:54.055231+0000","last_fullsized":"2024-09-10T08:47:54.055231+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:36:25.270876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.059039+0000","last_change":"2024-09-10T08:47:53.036088+0000","last_active":"2024-09-10T08:47:54.059039+0000","last_peered":"2024-09-10T08:47:54.059039+0000","last_clean":"2024-09-10T08:47:54.059039+0000","last_became_active":"2024-09-10T08:47:53.035686+0000","last_became_peered":"2024-09-10T08:47:53.035686+0000","last_unstale":"2024-09-10T08:47:54.059039+0000","last_undegraded":"2024-09-10T08:47:54.059039+0000","last_fullsized":"2024-09-10T08:47:54.059039+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_clean_scrub_stamp":"2024-09-10T08:47:52.003048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:56:46.989224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.049879+0000","last_change":"2024-09-10T08:47:54.045410+0000","last_active":"2024-09-10T08:47:54.049879+0000","last_peered":"2024-09-10T08:47:54.049879+0000","last_clean":"2024-09-10T08:47:54.049879+0000","last_became_active":"2024-09-10T08:47:54.042159+0000","last_became_peered":"2024-09-10T08:47:54.042159+0000","last_unstale":"2024-09-10T08:47:54.049879+0000","last_undegraded":"2024-09-10T08:47:54.049879+0000","last_fullsized":"2024-09-10T08:47:54.049879+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:36:25.270876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.064137+0000","last_change":"2024-09-10T08:47:53.039146+0000","last_active":"2024-09-10T08:47:54.064137+0000","last_peered":"2024-09-10T08:47:54.064137+0000","last_clean":"2024-09-10T08:47:54.064137+0000","last_became_active":"2024-09-10T08:47:53.038608+0000","last_became_peered":"2024-09-10T08:47:53.038608+0000","last_unstale":"2024-09-10T08:47:54.064137+0000","last_undegraded":"2024-09-10T08:47:54.064137+0000","last_fullsized":"2024-09-10T08:47:54.064137+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_clean_scrub_stamp":"2024-09-10T08:47:52.003048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:24:54.437335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.068613+0000","last_change":"2024-09-10T08:47:54.064405+0000","last_active":"2024-09-10T08:47:54.068613+0000","last_peered":"2024-09-10T08:47:54.068613+0000","last_clean":"2024-09-10T08:47:54.068613+0000","last_became_active":"2024-09-10T08:47:54.063914+0000","last_became_peered":"2024-09-10T08:47:54.063914+0000","last_unstale":"2024-09-10T08:47:54.068613+0000","last_undegraded":"2024-09-10T08:47:54.068613+0000","last_fullsized":"2024-09-10T08:47:54.068613+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:05:25.630297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.068950+0000","last_change":"2024-09-10T08:47:53.027692+0000","last_active":"2024-09-10T08:47:54.068950+0000","last_peered":"2024-09-10T08:47:54.068950+0000","last_clean":"2024-09-10T08:47:54.068950+0000","last_became_active":"2024-09-10T08:47:53.027432+0000","last_became_peered":"2024-09-10T08:47:53.027432+0000","last_unstale":"2024-09-10T08:47:54.068950+0000","last_undegraded":"2024-09-10T08:47:54.068950+0000","last_fullsized":"2024-09-10T08:47:54.068950+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_clean_scrub_stamp":"2024-09-10T08:47:52.003048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:25:47.165507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.046450+0000","last_change":"2024-09-10T08:47:54.040408+0000","last_active":"2024-09-10T08:47:54.046450+0000","last_peered":"2024-09-10T08:47:54.046450+0000","last_clean":"2024-09-10T08:47:54.046450+0000","last_became_active":"2024-09-10T08:47:54.040142+0000","last_became_peered":"2024-09-10T08:47:54.040142+0000","last_unstale":"2024-09-10T08:47:54.046450+0000","last_undegraded":"2024-09-10T08:47:54.046450+0000","last_fullsized":"2024-09-10T08:47:54.046450+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:08.518513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.057835+0000","last_change":"2024-09-10T08:47:53.035616+0000","last_active":"2024-09-10T08:47:54.057835+0000","last_peered":"2024-09-10T08:47:54.057835+0000","last_clean":"2024-09-10T08:47:54.057835+0000","last_became_active":"2024-09-10T08:47:53.032766+0000","last_became_peered":"2024-09-10T08:47:53.032766+0000","last_unstale":"2024-09-10T08:47:54.057835+0000","last_undegraded":"2024-09-10T08:47:54.057835+0000","last_fullsized":"2024-09-10T08:47:54.057835+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_clean_scrub_stamp":"2024-09-10T08:47:52.003048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:48:19.674548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.052651+0000","last_change":"2024-09-10T08:47:54.044623+0000","last_active":"2024-09-10T08:47:54.052651+0000","last_peered":"2024-09-10T08:47:54.052651+0000","last_clean":"2024-09-10T08:47:54.052651+0000","last_became_active":"2024-09-10T08:47:54.041751+0000","last_became_peered":"2024-09-10T08:47:54.041751+0000","last_unstale":"2024-09-10T08:47:54.052651+0000","last_undegraded":"2024-09-10T08:47:54.052651+0000","last_fullsized":"2024-09-10T08:47:54.052651+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:56:00.614693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.064112+0000","last_change":"2024-09-10T08:47:53.040358+0000","last_active":"2024-09-10T08:47:54.064112+0000","last_peered":"2024-09-10T08:47:54.064112+0000","last_clean":"2024-09-10T08:47:54.064112+0000","last_became_active":"2024-09-10T08:47:53.040061+0000","last_became_peered":"2024-09-10T08:47:53.040061+0000","last_unstale":"2024-09-10T08:47:54.064112+0000","last_undegraded":"2024-09-10T08:47:54.064112+0000","last_fullsized":"2024-09-10T08:47:54.064112+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_clean_scrub_stamp":"2024-09-10T08:47:52.003048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:07.516101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.044178+0000","last_change":"2024-09-10T08:47:54.037560+0000","last_active":"2024-09-10T08:47:54.044178+0000","last_peered":"2024-09-10T08:47:54.044178+0000","last_clean":"2024-09-10T08:47:54.044178+0000","last_became_active":"2024-09-10T08:47:54.035872+0000","last_became_peered":"2024-09-10T08:47:54.035872+0000","last_unstale":"2024-09-10T08:47:54.044178+0000","last_undegraded":"2024-09-10T08:47:54.044178+0000","last_fullsized":"2024-09-10T08:47:54.044178+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:56:47.991637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.027151+0000","last_change":"2024-09-10T08:47:53.035542+0000","last_active":"2024-09-10T08:47:54.027151+0000","last_peered":"2024-09-10T08:47:54.027151+0000","last_clean":"2024-09-10T08:47:54.027151+0000","last_became_active":"2024-09-10T08:47:53.034642+0000","last_became_peered":"2024-09-10T08:47:53.034642+0000","last_unstale":"2024-09-10T08:47:54.027151+0000","last_undegraded":"2024-09-10T08:47:54.027151+0000","last_fullsized":"2024-09-10T08:47:54.027151+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_clean_scrub_stamp":"2024-09-10T08:47:52.003048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:35:46.815735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.065536+0000","last_change":"2024-09-10T08:47:54.062225+0000","last_active":"2024-09-10T08:47:54.065536+0000","last_peered":"2024-09-10T08:47:54.065536+0000","last_clean":"2024-09-10T08:47:54.065536+0000","last_became_active":"2024-09-10T08:47:54.061136+0000","last_became_peered":"2024-09-10T08:47:54.061136+0000","last_unstale":"2024-09-10T08:47:54.065536+0000","last_undegraded":"2024-09-10T08:47:54.065536+0000","last_fullsized":"2024-09-10T08:47:54.065536+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:54:47.827173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.024289+0000","last_change":"2024-09-10T08:47:53.032046+0000","last_active":"2024-09-10T08:47:54.024289+0000","last_peered":"2024-09-10T08:47:54.024289+0000","last_clean":"2024-09-10T08:47:54.024289+0000","last_became_active":"2024-09-10T08:47:53.030327+0000","last_became_peered":"2024-09-10T08:47:53.030327+0000","last_unstale":"2024-09-10T08:47:54.024289+0000","last_undegraded":"2024-09-10T08:47:54.024289+0000","last_fullsized":"2024-09-10T08:47:54.024289+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_clean_scrub_stamp":"2024-09-10T08:47:52.003048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:04:10.828802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.038272+0000","last_change":"2024-09-10T08:47:54.036905+0000","last_active":"2024-09-10T08:47:54.038272+0000","last_peered":"2024-09-10T08:47:54.038272+0000","last_clean":"2024-09-10T08:47:54.038272+0000","last_became_active":"2024-09-10T08:47:54.034653+0000","last_became_peered":"2024-09-10T08:47:54.034653+0000","last_unstale":"2024-09-10T08:47:54.038272+0000","last_undegraded":"2024-09-10T08:47:54.038272+0000","last_fullsized":"2024-09-10T08:47:54.038272+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:41:30.292360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.059672+0000","last_change":"2024-09-10T08:47:53.028467+0000","last_active":"2024-09-10T08:47:54.059672+0000","last_peered":"2024-09-10T08:47:54.059672+0000","last_clean":"2024-09-10T08:47:54.059672+0000","last_became_active":"2024-09-10T08:47:53.028181+0000","last_became_peered":"2024-09-10T08:47:53.028181+0000","last_unstale":"2024-09-10T08:47:54.059672+0000","last_undegraded":"2024-09-10T08:47:54.059672+0000","last_fullsized":"2024-09-10T08:47:54.059672+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_clean_scrub_stamp":"2024-09-10T08:47:52.003048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:18:51.132102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.058935+0000","last_change":"2024-09-10T08:47:54.053361+0000","last_active":"2024-09-10T08:47:54.058935+0000","last_peered":"2024-09-10T08:47:54.058935+0000","last_clean":"2024-09-10T08:47:54.058935+0000","last_became_active":"2024-09-10T08:47:54.053087+0000","last_became_peered":"2024-09-10T08:47:54.053087+0000","last_unstale":"2024-09-10T08:47:54.058935+0000","last_undegraded":"2024-09-10T08:47:54.058935+0000","last_fullsized":"2024-09-10T08:47:54.058935+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:18:52.134514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.035438+0000","last_change":"2024-09-10T08:47:53.028949+0000","last_active":"2024-09-10T08:47:54.035438+0000","last_peered":"2024-09-10T08:47:54.035438+0000","last_clean":"2024-09-10T08:47:54.035438+0000","last_became_active":"2024-09-10T08:47:53.028649+0000","last_became_peered":"2024-09-10T08:47:53.028649+0000","last_unstale":"2024-09-10T08:47:54.035438+0000","last_undegraded":"2024-09-10T08:47:54.035438+0000","last_fullsized":"2024-09-10T08:47:54.035438+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_clean_scrub_stamp":"2024-09-10T08:47:52.003048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:07.516101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.050914+0000","last_change":"2024-09-10T08:47:54.048563+0000","last_active":"2024-09-10T08:47:54.050914+0000","last_peered":"2024-09-10T08:47:54.050914+0000","last_clean":"2024-09-10T08:47:54.050914+0000","last_became_active":"2024-09-10T08:47:54.048267+0000","last_became_peered":"2024-09-10T08:47:54.048267+0000","last_unstale":"2024-09-10T08:47:54.050914+0000","last_undegraded":"2024-09-10T08:47:54.050914+0000","last_fullsized":"2024-09-10T08:47:54.050914+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:32:59.447916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"37'3","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.060340+0000","last_change":"2024-09-10T08:47:53.035227+0000","last_active":"2024-09-10T08:47:54.060340+0000","last_peered":"2024-09-10T08:47:54.060340+0000","last_clean":"2024-09-10T08:47:54.060340+0000","last_became_active":"2024-09-10T08:47:53.034955+0000","last_became_peered":"2024-09-10T08:47:53.034955+0000","last_unstale":"2024-09-10T08:47:54.060340+0000","last_undegraded":"2024-09-10T08:47:54.060340+0000","last_fullsized":"2024-09-10T08:47:54.060340+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_clean_scrub_stamp":"2024-09-10T08:47:52.003048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:36:24.268464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.050543+0000","last_change":"2024-09-10T08:47:54.039407+0000","last_active":"2024-09-10T08:47:54.050543+0000","last_peered":"2024-09-10T08:47:54.050543+0000","last_clean":"2024-09-10T08:47:54.050543+0000","last_became_active":"2024-09-10T08:47:54.039090+0000","last_became_peered":"2024-09-10T08:47:54.039090+0000","last_unstale":"2024-09-10T08:47:54.050543+0000","last_undegraded":"2024-09-10T08:47:54.050543+0000","last_fullsized":"2024-09-10T08:47:54.050543+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:08.518513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"37'6","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.077413+0000","last_change":"2024-09-10T08:47:53.034880+0000","last_active":"2024-09-10T08:47:54.077413+0000","last_peered":"2024-09-10T08:47:54.077413+0000","last_clean":"2024-09-10T08:47:54.077413+0000","last_became_active":"2024-09-10T08:47:53.034600+0000","last_became_peered":"2024-09-10T08:47:53.034600+0000","last_unstale":"2024-09-10T08:47:54.077413+0000","last_undegraded":"2024-09-10T08:47:54.077413+0000","last_fullsized":"2024-09-10T08:47:54.077413+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_clean_scrub_stamp":"2024-09-10T08:47:52.003048+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:32:58.445504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.046472+0000","last_change":"2024-09-10T08:47:54.041610+0000","last_active":"2024-09-10T08:47:54.046472+0000","last_peered":"2024-09-10T08:47:54.046472+0000","last_clean":"2024-09-10T08:47:54.046472+0000","last_became_active":"2024-09-10T08:47:54.041353+0000","last_became_peered":"2024-09-10T08:47:54.041353+0000","last_unstale":"2024-09-10T08:47:54.046472+0000","last_undegraded":"2024-09-10T08:47:54.046472+0000","last_fullsized":"2024-09-10T08:47:54.046472+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:48:20.676961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.072450+0000","last_change":"2024-09-10T08:47:53.035995+0000","last_active":"2024-09-10T08:47:54.072450+0000","last_peered":"2024-09-10T08:47:54.072450+0000","last_clean":"2024-09-10T08:47:54.072450+0000","last_became_active":"2024-09-10T08:47:53.033525+0000","last_became_peered":"2024-09-10T08:47:53.033525+0000","last_unstale":"2024-09-10T08:47:54.072450+0000","last_undegraded":"2024-09-10T08:47:54.072450+0000","last_fullsized":"2024-09-10T08:47:54.072450+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_clean_scrub_stamp":"2024-09-10T08:47:52.003048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:16.821673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.066544+0000","last_change":"2024-09-10T08:47:54.060303+0000","last_active":"2024-09-10T08:47:54.066544+0000","last_peered":"2024-09-10T08:47:54.066544+0000","last_clean":"2024-09-10T08:47:54.066544+0000","last_became_active":"2024-09-10T08:47:54.060080+0000","last_became_peered":"2024-09-10T08:47:54.060080+0000","last_unstale":"2024-09-10T08:47:54.066544+0000","last_undegraded":"2024-09-10T08:47:54.066544+0000","last_fullsized":"2024-09-10T08:47:54.066544+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:10:07.359735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.028777+0000","last_change":"2024-09-10T08:47:53.034349+0000","last_active":"2024-09-10T08:47:54.028777+0000","last_peered":"2024-09-10T08:47:54.028777+0000","last_clean":"2024-09-10T08:47:54.028777+0000","last_became_active":"2024-09-10T08:47:53.034051+0000","last_became_peered":"2024-09-10T08:47:53.034051+0000","last_unstale":"2024-09-10T08:47:54.028777+0000","last_undegraded":"2024-09-10T08:47:54.028777+0000","last_fullsized":"2024-09-10T08:47:54.028777+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_clean_scrub_stamp":"2024-09-10T08:47:52.003048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:25:47.165507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.050837+0000","last_change":"2024-09-10T08:47:54.043178+0000","last_active":"2024-09-10T08:47:54.050837+0000","last_peered":"2024-09-10T08:47:54.050837+0000","last_clean":"2024-09-10T08:47:54.050837+0000","last_became_active":"2024-09-10T08:47:54.042335+0000","last_became_peered":"2024-09-10T08:47:54.042335+0000","last_unstale":"2024-09-10T08:47:54.050837+0000","last_undegraded":"2024-09-10T08:47:54.050837+0000","last_fullsized":"2024-09-10T08:47:54.050837+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:36:25.270876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.028238+0000","last_change":"2024-09-10T08:47:53.031056+0000","last_active":"2024-09-10T08:47:54.028238+0000","last_peered":"2024-09-10T08:47:54.028238+0000","last_clean":"2024-09-10T08:47:54.028238+0000","last_became_active":"2024-09-10T08:47:53.030708+0000","last_became_peered":"2024-09-10T08:47:53.030708+0000","last_unstale":"2024-09-10T08:47:54.028238+0000","last_undegraded":"2024-09-10T08:47:54.028238+0000","last_fullsized":"2024-09-10T08:47:54.028238+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_clean_scrub_stamp":"2024-09-10T08:47:52.003048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:41:29.289947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.065499+0000","last_change":"2024-09-10T08:47:54.061382+0000","last_active":"2024-09-10T08:47:54.065499+0000","last_peered":"2024-09-10T08:47:54.065499+0000","last_clean":"2024-09-10T08:47:54.065499+0000","last_became_active":"2024-09-10T08:47:54.060638+0000","last_became_peered":"2024-09-10T08:47:54.060638+0000","last_unstale":"2024-09-10T08:47:54.065499+0000","last_undegraded":"2024-09-10T08:47:54.065499+0000","last_fullsized":"2024-09-10T08:47:54.065499+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:19:16.826406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"37'8","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.064013+0000","last_change":"2024-09-10T08:47:53.032960+0000","last_active":"2024-09-10T08:47:54.064013+0000","last_peered":"2024-09-10T08:47:54.064013+0000","last_clean":"2024-09-10T08:47:54.064013+0000","last_became_active":"2024-09-10T08:47:53.032483+0000","last_became_peered":"2024-09-10T08:47:53.032483+0000","last_unstale":"2024-09-10T08:47:54.064013+0000","last_undegraded":"2024-09-10T08:47:54.064013+0000","last_fullsized":"2024-09-10T08:47:54.064013+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_clean_scrub_stamp":"2024-09-10T08:47:52.003048+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:29:20.215604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.066584+0000","last_change":"2024-09-10T08:47:54.059253+0000","last_active":"2024-09-10T08:47:54.066584+0000","last_peered":"2024-09-10T08:47:54.066584+0000","last_clean":"2024-09-10T08:47:54.066584+0000","last_became_active":"2024-09-10T08:47:54.051904+0000","last_became_peered":"2024-09-10T08:47:54.051904+0000","last_unstale":"2024-09-10T08:47:54.066584+0000","last_undegraded":"2024-09-10T08:47:54.066584+0000","last_fullsized":"2024-09-10T08:47:54.066584+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:10:58.984569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.059750+0000","last_change":"2024-09-10T08:47:53.039251+0000","last_active":"2024-09-10T08:47:54.059750+0000","last_peered":"2024-09-10T08:47:54.059750+0000","last_clean":"2024-09-10T08:47:54.059750+0000","last_became_active":"2024-09-10T08:47:53.038989+0000","last_became_peered":"2024-09-10T08:47:53.038989+0000","last_unstale":"2024-09-10T08:47:54.059750+0000","last_undegraded":"2024-09-10T08:47:54.059750+0000","last_fullsized":"2024-09-10T08:47:54.059750+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_clean_scrub_stamp":"2024-09-10T08:47:52.003048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:36:43.495190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.049635+0000","last_change":"2024-09-10T08:47:54.043035+0000","last_active":"2024-09-10T08:47:54.049635+0000","last_peered":"2024-09-10T08:47:54.049635+0000","last_clean":"2024-09-10T08:47:54.049635+0000","last_became_active":"2024-09-10T08:47:54.042686+0000","last_became_peered":"2024-09-10T08:47:54.042686+0000","last_unstale":"2024-09-10T08:47:54.049635+0000","last_undegraded":"2024-09-10T08:47:54.049635+0000","last_fullsized":"2024-09-10T08:47:54.049635+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:36:08.249489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.063807+0000","last_change":"2024-09-10T08:47:53.029974+0000","last_active":"2024-09-10T08:47:54.063807+0000","last_peered":"2024-09-10T08:47:54.063807+0000","last_clean":"2024-09-10T08:47:54.063807+0000","last_became_active":"2024-09-10T08:47:53.029678+0000","last_became_peered":"2024-09-10T08:47:53.029678+0000","last_unstale":"2024-09-10T08:47:54.063807+0000","last_undegraded":"2024-09-10T08:47:54.063807+0000","last_fullsized":"2024-09-10T08:47:54.063807+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_clean_scrub_stamp":"2024-09-10T08:47:52.003048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:51:44.691471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.045859+0000","last_change":"2024-09-10T08:47:54.037933+0000","last_active":"2024-09-10T08:47:54.045859+0000","last_peered":"2024-09-10T08:47:54.045859+0000","last_clean":"2024-09-10T08:47:54.045859+0000","last_became_active":"2024-09-10T08:47:54.036074+0000","last_became_peered":"2024-09-10T08:47:54.036074+0000","last_unstale":"2024-09-10T08:47:54.045859+0000","last_undegraded":"2024-09-10T08:47:54.045859+0000","last_fullsized":"2024-09-10T08:47:54.045859+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:29:21.218016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"37'1","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.063802+0000","last_change":"2024-09-10T08:47:53.033633+0000","last_active":"2024-09-10T08:47:54.063802+0000","last_peered":"2024-09-10T08:47:54.063802+0000","last_clean":"2024-09-10T08:47:54.063802+0000","last_became_active":"2024-09-10T08:47:53.033378+0000","last_became_peered":"2024-09-10T08:47:53.033378+0000","last_unstale":"2024-09-10T08:47:54.063802+0000","last_undegraded":"2024-09-10T08:47:54.063802+0000","last_fullsized":"2024-09-10T08:47:54.063802+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_clean_scrub_stamp":"2024-09-10T08:47:52.003048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:32:32.470485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.066328+0000","last_change":"2024-09-10T08:47:54.065370+0000","last_active":"2024-09-10T08:47:54.066328+0000","last_peered":"2024-09-10T08:47:54.066328+0000","last_clean":"2024-09-10T08:47:54.066328+0000","last_became_active":"2024-09-10T08:47:54.065027+0000","last_became_peered":"2024-09-10T08:47:54.065027+0000","last_unstale":"2024-09-10T08:47:54.066328+0000","last_undegraded":"2024-09-10T08:47:54.066328+0000","last_fullsized":"2024-09-10T08:47:54.066328+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:04:11.831215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.029810+0000","last_change":"2024-09-10T08:47:53.033886+0000","last_active":"2024-09-10T08:47:54.029810+0000","last_peered":"2024-09-10T08:47:54.029810+0000","last_clean":"2024-09-10T08:47:54.029810+0000","last_became_active":"2024-09-10T08:47:53.033608+0000","last_became_peered":"2024-09-10T08:47:53.033608+0000","last_unstale":"2024-09-10T08:47:54.029810+0000","last_undegraded":"2024-09-10T08:47:54.029810+0000","last_fullsized":"2024-09-10T08:47:54.029810+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_clean_scrub_stamp":"2024-09-10T08:47:52.003048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T11:51:44.691471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.054965+0000","last_change":"2024-09-10T08:47:54.046348+0000","last_active":"2024-09-10T08:47:54.054965+0000","last_peered":"2024-09-10T08:47:54.054965+0000","last_clean":"2024-09-10T08:47:54.054965+0000","last_became_active":"2024-09-10T08:47:54.045662+0000","last_became_peered":"2024-09-10T08:47:54.045662+0000","last_unstale":"2024-09-10T08:47:54.054965+0000","last_undegraded":"2024-09-10T08:47:54.054965+0000","last_fullsized":"2024-09-10T08:47:54.054965+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:38:57.458122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.057801+0000","last_change":"2024-09-10T08:47:53.032155+0000","last_active":"2024-09-10T08:47:54.057801+0000","last_peered":"2024-09-10T08:47:54.057801+0000","last_clean":"2024-09-10T08:47:54.057801+0000","last_became_active":"2024-09-10T08:47:53.031890+0000","last_became_peered":"2024-09-10T08:47:53.031890+0000","last_unstale":"2024-09-10T08:47:54.057801+0000","last_undegraded":"2024-09-10T08:47:54.057801+0000","last_fullsized":"2024-09-10T08:47:54.057801+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_clean_scrub_stamp":"2024-09-10T08:47:52.003048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:46:16.014995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.050517+0000","last_change":"2024-09-10T08:47:54.048569+0000","last_active":"2024-09-10T08:47:54.050517+0000","last_peered":"2024-09-10T08:47:54.050517+0000","last_clean":"2024-09-10T08:47:54.050517+0000","last_became_active":"2024-09-10T08:47:54.048228+0000","last_became_peered":"2024-09-10T08:47:54.048228+0000","last_unstale":"2024-09-10T08:47:54.050517+0000","last_undegraded":"2024-09-10T08:47:54.050517+0000","last_fullsized":"2024-09-10T08:47:54.050517+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:38:57.458122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.022988+0000","last_change":"2024-09-10T08:47:53.027837+0000","last_active":"2024-09-10T08:47:54.022988+0000","last_peered":"2024-09-10T08:47:54.022988+0000","last_clean":"2024-09-10T08:47:54.022988+0000","last_became_active":"2024-09-10T08:47:53.027512+0000","last_became_peered":"2024-09-10T08:47:53.027512+0000","last_unstale":"2024-09-10T08:47:54.022988+0000","last_undegraded":"2024-09-10T08:47:54.022988+0000","last_fullsized":"2024-09-10T08:47:54.022988+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_clean_scrub_stamp":"2024-09-10T08:47:52.003048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:34:00.806939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.048599+0000","last_change":"2024-09-10T08:47:54.042717+0000","last_active":"2024-09-10T08:47:54.048599+0000","last_peered":"2024-09-10T08:47:54.048599+0000","last_clean":"2024-09-10T08:47:54.048599+0000","last_became_active":"2024-09-10T08:47:54.042458+0000","last_became_peered":"2024-09-10T08:47:54.042458+0000","last_unstale":"2024-09-10T08:47:54.048599+0000","last_undegraded":"2024-09-10T08:47:54.048599+0000","last_fullsized":"2024-09-10T08:47:54.048599+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:38:57.458122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.030240+0000","last_change":"2024-09-10T08:47:53.036813+0000","last_active":"2024-09-10T08:47:54.030240+0000","last_peered":"2024-09-10T08:47:54.030240+0000","last_clean":"2024-09-10T08:47:54.030240+0000","last_became_active":"2024-09-10T08:47:53.036519+0000","last_became_peered":"2024-09-10T08:47:53.036519+0000","last_unstale":"2024-09-10T08:47:54.030240+0000","last_undegraded":"2024-09-10T08:47:54.030240+0000","last_fullsized":"2024-09-10T08:47:54.030240+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_clean_scrub_stamp":"2024-09-10T08:47:52.003048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:56:46.989224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.065519+0000","last_change":"2024-09-10T08:47:54.061617+0000","last_active":"2024-09-10T08:47:54.065519+0000","last_peered":"2024-09-10T08:47:54.065519+0000","last_clean":"2024-09-10T08:47:54.065519+0000","last_became_active":"2024-09-10T08:47:54.061057+0000","last_became_peered":"2024-09-10T08:47:54.061057+0000","last_unstale":"2024-09-10T08:47:54.065519+0000","last_undegraded":"2024-09-10T08:47:54.065519+0000","last_fullsized":"2024-09-10T08:47:54.065519+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:35:09.428560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.023381+0000","last_change":"2024-09-10T08:47:53.032014+0000","last_active":"2024-09-10T08:47:54.023381+0000","last_peered":"2024-09-10T08:47:54.023381+0000","last_clean":"2024-09-10T08:47:54.023381+0000","last_became_active":"2024-09-10T08:47:53.031754+0000","last_became_peered":"2024-09-10T08:47:53.031754+0000","last_unstale":"2024-09-10T08:47:54.023381+0000","last_undegraded":"2024-09-10T08:47:54.023381+0000","last_fullsized":"2024-09-10T08:47:54.023381+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_clean_scrub_stamp":"2024-09-10T08:47:52.003048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:35:10.685692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.052842+0000","last_change":"2024-09-10T08:47:54.040408+0000","last_active":"2024-09-10T08:47:54.052842+0000","last_peered":"2024-09-10T08:47:54.052842+0000","last_clean":"2024-09-10T08:47:54.052842+0000","last_became_active":"2024-09-10T08:47:54.040136+0000","last_became_peered":"2024-09-10T08:47:54.040136+0000","last_unstale":"2024-09-10T08:47:54.052842+0000","last_undegraded":"2024-09-10T08:47:54.052842+0000","last_fullsized":"2024-09-10T08:47:54.052842+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:29:21.218016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"37'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.059688+0000","last_change":"2024-09-10T08:47:53.034066+0000","last_active":"2024-09-10T08:47:54.059688+0000","last_peered":"2024-09-10T08:47:54.059688+0000","last_clean":"2024-09-10T08:47:54.059688+0000","last_became_active":"2024-09-10T08:47:53.033830+0000","last_became_peered":"2024-09-10T08:47:53.033830+0000","last_unstale":"2024-09-10T08:47:54.059688+0000","last_undegraded":"2024-09-10T08:47:54.059688+0000","last_fullsized":"2024-09-10T08:47:54.059688+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_clean_scrub_stamp":"2024-09-10T08:47:52.003048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T13:34:16.821673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.058962+0000","last_change":"2024-09-10T08:47:54.054155+0000","last_active":"2024-09-10T08:47:54.058962+0000","last_peered":"2024-09-10T08:47:54.058962+0000","last_clean":"2024-09-10T08:47:54.058962+0000","last_became_active":"2024-09-10T08:47:54.053793+0000","last_became_peered":"2024-09-10T08:47:54.053793+0000","last_unstale":"2024-09-10T08:47:54.058962+0000","last_undegraded":"2024-09-10T08:47:54.058962+0000","last_fullsized":"2024-09-10T08:47:54.058962+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:10:07.359735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.023455+0000","last_change":"2024-09-10T08:47:53.031751+0000","last_active":"2024-09-10T08:47:54.023455+0000","last_peered":"2024-09-10T08:47:54.023455+0000","last_clean":"2024-09-10T08:47:54.023455+0000","last_became_active":"2024-09-10T08:47:53.031399+0000","last_became_peered":"2024-09-10T08:47:53.031399+0000","last_unstale":"2024-09-10T08:47:54.023455+0000","last_undegraded":"2024-09-10T08:47:54.023455+0000","last_fullsized":"2024-09-10T08:47:54.023455+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_clean_scrub_stamp":"2024-09-10T08:47:52.003048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:30:21.254777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.063243+0000","last_change":"2024-09-10T08:47:54.054851+0000","last_active":"2024-09-10T08:47:54.063243+0000","last_peered":"2024-09-10T08:47:54.063243+0000","last_clean":"2024-09-10T08:47:54.063243+0000","last_became_active":"2024-09-10T08:47:54.054214+0000","last_became_peered":"2024-09-10T08:47:54.054214+0000","last_unstale":"2024-09-10T08:47:54.063243+0000","last_undegraded":"2024-09-10T08:47:54.063243+0000","last_fullsized":"2024-09-10T08:47:54.063243+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:38:57.458122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.028601+0000","last_change":"2024-09-10T08:47:53.031537+0000","last_active":"2024-09-10T08:47:54.028601+0000","last_peered":"2024-09-10T08:47:54.028601+0000","last_clean":"2024-09-10T08:47:54.028601+0000","last_became_active":"2024-09-10T08:47:53.031272+0000","last_became_peered":"2024-09-10T08:47:53.031272+0000","last_unstale":"2024-09-10T08:47:54.028601+0000","last_undegraded":"2024-09-10T08:47:54.028601+0000","last_fullsized":"2024-09-10T08:47:54.028601+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_clean_scrub_stamp":"2024-09-10T08:47:52.003048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:24:54.437335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.066096+0000","last_change":"2024-09-10T08:47:54.064619+0000","last_active":"2024-09-10T08:47:54.066096+0000","last_peered":"2024-09-10T08:47:54.066096+0000","last_clean":"2024-09-10T08:47:54.066096+0000","last_became_active":"2024-09-10T08:47:54.064349+0000","last_became_peered":"2024-09-10T08:47:54.064349+0000","last_unstale":"2024-09-10T08:47:54.066096+0000","last_undegraded":"2024-09-10T08:47:54.066096+0000","last_fullsized":"2024-09-10T08:47:54.066096+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T12:36:08.249489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.033333+0000","last_change":"2024-09-10T08:47:53.036526+0000","last_active":"2024-09-10T08:47:54.033333+0000","last_peered":"2024-09-10T08:47:54.033333+0000","last_clean":"2024-09-10T08:47:54.033333+0000","last_became_active":"2024-09-10T08:47:53.036278+0000","last_became_peered":"2024-09-10T08:47:53.036278+0000","last_unstale":"2024-09-10T08:47:54.033333+0000","last_undegraded":"2024-09-10T08:47:54.033333+0000","last_fullsized":"2024-09-10T08:47:54.033333+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_clean_scrub_stamp":"2024-09-10T08:47:52.003048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:29:20.215604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.055273+0000","last_change":"2024-09-10T08:47:54.041278+0000","last_active":"2024-09-10T08:47:54.055273+0000","last_peered":"2024-09-10T08:47:54.055273+0000","last_clean":"2024-09-10T08:47:54.055273+0000","last_became_active":"2024-09-10T08:47:54.040974+0000","last_became_peered":"2024-09-10T08:47:54.040974+0000","last_unstale":"2024-09-10T08:47:54.055273+0000","last_undegraded":"2024-09-10T08:47:54.055273+0000","last_fullsized":"2024-09-10T08:47:54.055273+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:08.518513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.028457+0000","last_change":"2024-09-10T08:47:53.034441+0000","last_active":"2024-09-10T08:47:54.028457+0000","last_peered":"2024-09-10T08:47:54.028457+0000","last_clean":"2024-09-10T08:47:54.028457+0000","last_became_active":"2024-09-10T08:47:53.033394+0000","last_became_peered":"2024-09-10T08:47:53.033394+0000","last_unstale":"2024-09-10T08:47:54.028457+0000","last_undegraded":"2024-09-10T08:47:54.028457+0000","last_fullsized":"2024-09-10T08:47:54.028457+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_clean_scrub_stamp":"2024-09-10T08:47:52.003048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:04:10.828802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.065510+0000","last_change":"2024-09-10T08:47:54.062696+0000","last_active":"2024-09-10T08:47:54.065510+0000","last_peered":"2024-09-10T08:47:54.065510+0000","last_clean":"2024-09-10T08:47:54.065510+0000","last_became_active":"2024-09-10T08:47:54.061992+0000","last_became_peered":"2024-09-10T08:47:54.061992+0000","last_unstale":"2024-09-10T08:47:54.065510+0000","last_undegraded":"2024-09-10T08:47:54.065510+0000","last_fullsized":"2024-09-10T08:47:54.065510+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:36:44.497603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.024287+0000","last_change":"2024-09-10T08:47:53.029213+0000","last_active":"2024-09-10T08:47:54.024287+0000","last_peered":"2024-09-10T08:47:54.024287+0000","last_clean":"2024-09-10T08:47:54.024287+0000","last_became_active":"2024-09-10T08:47:53.028866+0000","last_became_peered":"2024-09-10T08:47:53.028866+0000","last_unstale":"2024-09-10T08:47:54.024287+0000","last_undegraded":"2024-09-10T08:47:54.024287+0000","last_fullsized":"2024-09-10T08:47:54.024287+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_clean_scrub_stamp":"2024-09-10T08:47:52.003048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:35:46.815735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.050726+0000","last_change":"2024-09-10T08:47:54.043941+0000","last_active":"2024-09-10T08:47:54.050726+0000","last_peered":"2024-09-10T08:47:54.050726+0000","last_clean":"2024-09-10T08:47:54.050726+0000","last_became_active":"2024-09-10T08:47:54.042288+0000","last_became_peered":"2024-09-10T08:47:54.042288+0000","last_unstale":"2024-09-10T08:47:54.050726+0000","last_undegraded":"2024-09-10T08:47:54.050726+0000","last_fullsized":"2024-09-10T08:47:54.050726+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:36:44.497603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.058313+0000","last_change":"2024-09-10T08:47:53.030357+0000","last_active":"2024-09-10T08:47:54.058313+0000","last_peered":"2024-09-10T08:47:54.058313+0000","last_clean":"2024-09-10T08:47:54.058313+0000","last_became_active":"2024-09-10T08:47:53.030110+0000","last_became_peered":"2024-09-10T08:47:53.030110+0000","last_unstale":"2024-09-10T08:47:54.058313+0000","last_undegraded":"2024-09-10T08:47:54.058313+0000","last_fullsized":"2024-09-10T08:47:54.058313+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_clean_scrub_stamp":"2024-09-10T08:47:52.003048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T09:55:59.612280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.071515+0000","last_change":"2024-09-10T08:47:54.069990+0000","last_active":"2024-09-10T08:47:54.071515+0000","last_peered":"2024-09-10T08:47:54.071515+0000","last_clean":"2024-09-10T08:47:54.071515+0000","last_became_active":"2024-09-10T08:47:54.069586+0000","last_became_peered":"2024-09-10T08:47:54.069586+0000","last_unstale":"2024-09-10T08:47:54.071515+0000","last_undegraded":"2024-09-10T08:47:54.071515+0000","last_fullsized":"2024-09-10T08:47:54.071515+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:53.005460+0000","last_clean_scrub_stamp":"2024-09-10T08:47:53.005460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T10:05:25.630297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.034795+0000","last_change":"2024-09-10T08:47:53.035241+0000","last_active":"2024-09-10T08:47:54.034795+0000","last_peered":"2024-09-10T08:47:54.034795+0000","last_clean":"2024-09-10T08:47:54.034795+0000","last_became_active":"2024-09-10T08:47:53.034719+0000","last_became_peered":"2024-09-10T08:47:53.034719+0000","last_unstale":"2024-09-10T08:47:54.034795+0000","last_undegraded":"2024-09-10T08:47:54.034795+0000","last_fullsized":"2024-09-10T08:47:54.034795+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:47:52.003048+0000","last_clean_scrub_stamp":"2024-09-10T08:47:52.003048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:48:19.674548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":200,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-10T08:47:54.030988+0000","last_change":"2024-09-10T08:46:42.177049+0000","last_active":"2024-09-10T08:47:54.030988+0000","last_peered":"2024-09-10T08:47:54.030988+0000","last_clean":"2024-09-10T08:47:54.030988+0000","last_became_active":"2024-09-10T08:46:42.175678+0000","last_became_peered":"2024-09-10T08:46:42.175678+0000","last_unstale":"2024-09-10T08:47:54.030988+0000","last_undegraded":"2024-09-10T08:47:54.030988+0000","last_fullsized":"2024-09-10T08:47:54.030988+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:40.326212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:40.326212+0000","last_clean_scrub_stamp":"2024-09-10T08:46:40.326212+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:06.642437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28016,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343824,"statfs":{"total":96636764160,"available":96608075776,"internally_reserved":0,"allocated":1007616,"data_stored":766707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":430080,"data_stored":184088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":434176,"data_stored":183618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":434176,"data_stored":184110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31596,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340244,"statfs":{"total":96636764160,"available":96604409856,"internally_reserved":0,"allocated":413696,"data_stored":176339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31612,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340228,"statfs":{"total":96636764160,"available":96604393472,"internally_reserved":0,"allocated":430080,"data_stored":183576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31592,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340248,"statfs":{"total":96636764160,"available":96604413952,"internally_reserved":0,"allocated":413696,"data_stored":176339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32188,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339652,"statfs":{"total":96636764160,"available":96603803648,"internally_reserved":0,"allocated":1024000,"data_stored":773908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:47:58.661 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T08:47:58.662 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-10T08:47:58.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.861+0000 7f4c4c200640 1 Processor -- start 2024-09-10T08:47:58.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.861+0000 7f4c4c200640 1 -- start start 2024-09-10T08:47:58.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.862+0000 7f4c4c200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4c44161ce0 0x7f4c440d0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:58.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.862+0000 7f4c4c200640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c440cf180 con 0x7f4c440b5a80 2024-09-10T08:47:58.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.862+0000 7f4c4c200640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c440b5ec0 con 0x7f4c440d2e00 2024-09-10T08:47:58.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.862+0000 7f4c4c200640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f4c440d3690 con 0x7f4c44161ce0 2024-09-10T08:47:58.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.862+0000 7f4c48e00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f4c440b5a80 0x7f4c440d26f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:40988/0 (socket says 172.21.15.2:40988) 2024-09-10T08:47:58.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.862+0000 7f4c49800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4c44161ce0 0x7f4c440d0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:58.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.862+0000 7f4c48e00640 1 -- 172.21.15.2:0/3636269672 learned_addr learned my addr 172.21.15.2:0/3636269672 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:47:58.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.863+0000 7f4c49800640 1 -- 172.21.15.2:0/3636269672 >> v1:172.21.15.155:6789/0 conn(0x7f4c440d2e00 legacy=0x7f4c440cf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:58.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.863+0000 7f4c49800640 1 -- 172.21.15.2:0/3636269672 >> v1:172.21.15.2:6789/0 conn(0x7f4c440b5a80 legacy=0x7f4c440d26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:58.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.863+0000 7f4c49800640 1 -- 172.21.15.2:0/3636269672 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c440d13f0 con 0x7f4c44161ce0 2024-09-10T08:47:58.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.864+0000 7f4c49800640 1 --2- 172.21.15.2:0/3636269672 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c44161ce0 0x7f4c440d0d80 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4c380097a0 tx=0x7f4c3802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9205d76332ea4cf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:58.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.864+0000 7f4c43e00640 1 -- 172.21.15.2:0/3636269672 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c38037070 con 0x7f4c44161ce0 2024-09-10T08:47:58.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.864+0000 7f4c43e00640 1 -- 172.21.15.2:0/3636269672 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c3802ae50 con 0x7f4c44161ce0 2024-09-10T08:47:58.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.864+0000 7f4c43e00640 1 -- 172.21.15.2:0/3636269672 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c38032660 con 0x7f4c44161ce0 2024-09-10T08:47:58.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.865+0000 7f4c4c200640 1 -- 172.21.15.2:0/3636269672 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c44161ce0 msgr2=0x7f4c440d0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:58.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.865+0000 7f4c4c200640 1 --2- 172.21.15.2:0/3636269672 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c44161ce0 0x7f4c440d0d80 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4c380097a0 tx=0x7f4c3802a100 comp rx=0 tx=0).stop 2024-09-10T08:47:58.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.865+0000 7f4c4c200640 1 -- 172.21.15.2:0/3636269672 shutdown_connections 2024-09-10T08:47:58.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.865+0000 7f4c4c200640 1 --2- 172.21.15.2:0/3636269672 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c44161ce0 0x7f4c440d0d80 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:58.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.865+0000 7f4c4c200640 1 -- 172.21.15.2:0/3636269672 >> 172.21.15.2:0/3636269672 conn(0x7f4c4408bfd0 msgr2=0x7f4c440d45e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:58.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.865+0000 7f4c4c200640 1 -- 172.21.15.2:0/3636269672 shutdown_connections 2024-09-10T08:47:58.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.865+0000 7f4c4c200640 1 -- 172.21.15.2:0/3636269672 wait complete. 2024-09-10T08:47:58.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.866+0000 7f4c4c200640 1 Processor -- start 2024-09-10T08:47:58.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.866+0000 7f4c4c200640 1 -- start start 2024-09-10T08:47:58.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.867+0000 7f4c4c200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c440b5a80 0x7f4c441f4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:58.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.867+0000 7f4c4c200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c440d2e00 0x7f4c4415f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:58.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.867+0000 7f4c4c200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c44161ce0 0x7f4c4415fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:58.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.867+0000 7f4c4c200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4c440d1c90 con 0x7f4c440b5a80 2024-09-10T08:47:58.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.867+0000 7f4c4c200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4c440d19b0 con 0x7f4c44161ce0 2024-09-10T08:47:58.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.867+0000 7f4c4c200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4c440b3db0 con 0x7f4c440d2e00 2024-09-10T08:47:58.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.868+0000 7f4c49800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c440b5a80 0x7f4c441f4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:58.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.868+0000 7f4c49800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c440b5a80 0x7f4c441f4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55646/0 (socket says 172.21.15.2:55646) 2024-09-10T08:47:58.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.868+0000 7f4c49800640 1 -- 172.21.15.2:0/3791399480 learned_addr learned my addr 172.21.15.2:0/3791399480 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:58.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.868+0000 7f4c4a200640 1 --2- 172.21.15.2:0/3791399480 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c44161ce0 0x7f4c4415fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:58.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.868+0000 7f4c48e00640 1 --2- 172.21.15.2:0/3791399480 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c440d2e00 0x7f4c4415f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:58.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.868+0000 7f4c49800640 1 -- 172.21.15.2:0/3791399480 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c440d2e00 msgr2=0x7f4c4415f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:58.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.868+0000 7f4c49800640 1 --2- 172.21.15.2:0/3791399480 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c440d2e00 0x7f4c4415f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:58.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.868+0000 7f4c49800640 1 -- 172.21.15.2:0/3791399480 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c44161ce0 msgr2=0x7f4c4415fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:58.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.868+0000 7f4c49800640 1 --2- 172.21.15.2:0/3791399480 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c44161ce0 0x7f4c4415fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:58.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.868+0000 7f4c49800640 1 -- 172.21.15.2:0/3791399480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c441f5680 con 0x7f4c440b5a80 2024-09-10T08:47:58.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.868+0000 7f4c48e00640 1 --2- 172.21.15.2:0/3791399480 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c440d2e00 0x7f4c4415f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:47:58.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.868+0000 7f4c49800640 1 --2- 172.21.15.2:0/3791399480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c440b5a80 0x7f4c441f4b90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4c380098c0 tx=0x7f4c380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:58.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.869+0000 7f4c41600640 1 -- 172.21.15.2:0/3791399480 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c38041070 con 0x7f4c440b5a80 2024-09-10T08:47:58.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.869+0000 7f4c41600640 1 -- 172.21.15.2:0/3791399480 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c3803c670 con 0x7f4c440b5a80 2024-09-10T08:47:58.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.869+0000 7f4c41600640 1 -- 172.21.15.2:0/3791399480 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c38037040 con 0x7f4c440b5a80 2024-09-10T08:47:58.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.869+0000 7f4c4c200640 1 -- 172.21.15.2:0/3791399480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c441f5960 con 0x7f4c440b5a80 2024-09-10T08:47:58.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.869+0000 7f4c4c200640 1 -- 172.21.15.2:0/3791399480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c440cbbe0 con 0x7f4c440b5a80 2024-09-10T08:47:58.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.870+0000 7f4c4c200640 1 -- 172.21.15.2:0/3791399480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c44162880 con 0x7f4c440b5a80 2024-09-10T08:47:58.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.871+0000 7f4c41600640 1 -- 172.21.15.2:0/3791399480 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4c38044070 con 0x7f4c440b5a80 2024-09-10T08:47:58.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.871+0000 7f4c41600640 1 --2- 172.21.15.2:0/3791399480 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f4c2406be30 0x7f4c2406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:58.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.872+0000 7f4c41600640 1 -- 172.21.15.2:0/3791399480 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f4c380aba00 con 0x7f4c440b5a80 2024-09-10T08:47:58.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.872+0000 7f4c48e00640 1 --2- 172.21.15.2:0/3791399480 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f4c2406be30 0x7f4c2406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:58.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.873+0000 7f4c48e00640 1 --2- 172.21.15.2:0/3791399480 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f4c2406be30 0x7f4c2406e2f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4c440ca080 tx=0x7f4c30009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:58.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:58.876+0000 7f4c41600640 1 -- 172.21.15.2:0/3791399480 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4c3807a2a0 con 0x7f4c440b5a80 2024-09-10T08:47:58.878 INFO:tasks.ceph.mds.c.smithi002.stderr:2024-09-10T08:47:58.877+0000 7f571da00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T08:47:59.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.135+0000 7f4c4c200640 1 -- 172.21.15.2:0/3791399480 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f4c440ca0b0 con 0x7f4c440b5a80 2024-09-10T08:47:59.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.138+0000 7f4c41600640 1 -- 172.21.15.2:0/3791399480 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v9) ==== 190+0+147 (secure 0 0 0) 0x7f4c38079ba0 con 0x7f4c440b5a80 2024-09-10T08:47:59.139 INFO:teuthology.orchestra.run.smithi002.stdout:[client.0] 2024-09-10T08:47:59.139 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQA1B+Bmtsv1JhAAUIdP6HQM/8FYI9fUbtrLmw== 2024-09-10T08:47:59.139 INFO:teuthology.orchestra.run.smithi002.stdout: caps mds = "allow" 2024-09-10T08:47:59.139 INFO:teuthology.orchestra.run.smithi002.stdout: caps mon = "allow r" 2024-09-10T08:47:59.140 INFO:teuthology.orchestra.run.smithi002.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-10T08:47:59.140 INFO:teuthology.orchestra.run.smithi002.stderr:updated caps for client.0 2024-09-10T08:47:59.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.140+0000 7f4c4c200640 1 -- 172.21.15.2:0/3791399480 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f4c2406be30 msgr2=0x7f4c2406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:59.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.140+0000 7f4c4c200640 1 --2- 172.21.15.2:0/3791399480 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f4c2406be30 0x7f4c2406e2f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4c440ca080 tx=0x7f4c30009040 comp rx=0 tx=0).stop 2024-09-10T08:47:59.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.140+0000 7f4c4c200640 1 -- 172.21.15.2:0/3791399480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c440b5a80 msgr2=0x7f4c441f4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:59.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.140+0000 7f4c4c200640 1 --2- 172.21.15.2:0/3791399480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c440b5a80 0x7f4c441f4b90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4c380098c0 tx=0x7f4c380046c0 comp rx=0 tx=0).stop 2024-09-10T08:47:59.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.140+0000 7f4c4c200640 1 -- 172.21.15.2:0/3791399480 shutdown_connections 2024-09-10T08:47:59.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.140+0000 7f4c4c200640 1 --2- 172.21.15.2:0/3791399480 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c44161ce0 0x7f4c4415fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:59.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.140+0000 7f4c4c200640 1 --2- 172.21.15.2:0/3791399480 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f4c2406be30 0x7f4c2406e2f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:59.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.141+0000 7f4c4c200640 1 --2- 172.21.15.2:0/3791399480 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c440d2e00 0x7f4c4415f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:59.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.141+0000 7f4c4c200640 1 --2- 172.21.15.2:0/3791399480 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4c440b5a80 0x7f4c441f4b90 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:59.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.141+0000 7f4c4c200640 1 -- 172.21.15.2:0/3791399480 >> 172.21.15.2:0/3791399480 conn(0x7f4c4408bfd0 msgr2=0x7f4c4406ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:59.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.141+0000 7f4c4c200640 1 -- 172.21.15.2:0/3791399480 shutdown_connections 2024-09-10T08:47:59.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.141+0000 7f4c4c200640 1 -- 172.21.15.2:0/3791399480 wait complete. 2024-09-10T08:47:59.158 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:47:59.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.312+0000 7fe4a9600640 1 Processor -- start 2024-09-10T08:47:59.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.312+0000 7fe4a9600640 1 -- start start 2024-09-10T08:47:59.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.314+0000 7fe4a9600640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe4a406df80 0x7fe4a415c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:59.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.314+0000 7fe4a9600640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4a406e4d0 con 0x7fe4a4145d20 2024-09-10T08:47:59.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.314+0000 7fe4a9600640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4a406e7b0 con 0x7fe4a40cd460 2024-09-10T08:47:59.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.314+0000 7fe4a9600640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fe4a4146100 con 0x7fe4a406df80 2024-09-10T08:47:59.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.314+0000 7fe4a2a00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fe4a4145d20 0x7fe4a40ccd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41002/0 (socket says 172.21.15.2:41002) 2024-09-10T08:47:59.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.314+0000 7fe4a2a00640 1 -- 172.21.15.2:0/2060511210 learned_addr learned my addr 172.21.15.2:0/2060511210 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:47:59.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.314+0000 7fe4a3400640 1 --2- 172.21.15.2:0/2060511210 >> v2:172.21.15.2:3300/0 conn(0x7fe4a406df80 0x7fe4a415c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:59.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.314+0000 7fe4a2000640 1 -- 172.21.15.2:0/2060511210 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2644563592 0 0) 0x7fe4a406e4d0 con 0x7fe4a4145d20 2024-09-10T08:47:59.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.314+0000 7fe4a2000640 1 -- 172.21.15.2:0/2060511210 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe488003520 con 0x7fe4a4145d20 2024-09-10T08:47:59.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.315+0000 7fe4a3400640 1 -- 172.21.15.2:0/2060511210 >> v1:172.21.15.155:6789/0 conn(0x7fe4a40cd460 legacy=0x7fe4a40ceb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:59.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.315+0000 7fe4a3400640 1 -- 172.21.15.2:0/2060511210 >> v1:172.21.15.2:6789/0 conn(0x7fe4a4145d20 legacy=0x7fe4a40ccd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:59.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.315+0000 7fe4a3400640 1 -- 172.21.15.2:0/2060511210 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4a406ea90 con 0x7fe4a406df80 2024-09-10T08:47:59.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.316+0000 7fe4a3400640 1 --2- 172.21.15.2:0/2060511210 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4a406df80 0x7fe4a415c9e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe49c009d90 tx=0x7fe49c02a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c780d44897e1d396 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:59.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.316+0000 7fe4a2000640 1 -- 172.21.15.2:0/2060511210 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe49c031600 con 0x7fe4a406df80 2024-09-10T08:47:59.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.316+0000 7fe4a2000640 1 -- 172.21.15.2:0/2060511210 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe49c0317a0 con 0x7fe4a406df80 2024-09-10T08:47:59.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.316+0000 7fe4a2000640 1 -- 172.21.15.2:0/2060511210 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe49c031b50 con 0x7fe4a406df80 2024-09-10T08:47:59.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.316+0000 7fe4a9600640 1 -- 172.21.15.2:0/2060511210 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4a406df80 msgr2=0x7fe4a415c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:59.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.316+0000 7fe4a9600640 1 --2- 172.21.15.2:0/2060511210 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4a406df80 0x7fe4a415c9e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe49c009d90 tx=0x7fe49c02a5d0 comp rx=0 tx=0).stop 2024-09-10T08:47:59.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.316+0000 7fe4a9600640 1 -- 172.21.15.2:0/2060511210 shutdown_connections 2024-09-10T08:47:59.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.316+0000 7fe4a9600640 1 --2- 172.21.15.2:0/2060511210 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4a406df80 0x7fe4a415c9e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:59.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.316+0000 7fe4a9600640 1 -- 172.21.15.2:0/2060511210 >> 172.21.15.2:0/2060511210 conn(0x7fe4a406bc10 msgr2=0x7fe4a406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:59.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.317+0000 7fe4a9600640 1 -- 172.21.15.2:0/2060511210 shutdown_connections 2024-09-10T08:47:59.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.317+0000 7fe4a9600640 1 -- 172.21.15.2:0/2060511210 wait complete. 2024-09-10T08:47:59.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.318+0000 7fe4a9600640 1 Processor -- start 2024-09-10T08:47:59.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.318+0000 7fe4a9600640 1 -- start start 2024-09-10T08:47:59.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.319+0000 7fe4a9600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4a406df80 0x7fe4a40cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:59.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.319+0000 7fe4a9600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4a40cd460 0x7fe4a40ab700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:59.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.319+0000 7fe4a9600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe4a4145d20 0x7fe4a41f73d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:59.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.319+0000 7fe4a9600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a4160980 con 0x7fe4a406df80 2024-09-10T08:47:59.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.319+0000 7fe4a9600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a40ce6b0 con 0x7fe4a40cd460 2024-09-10T08:47:59.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.319+0000 7fe4a9600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe4a4160b00 con 0x7fe4a4145d20 2024-09-10T08:47:59.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.319+0000 7fe4a2a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4a406df80 0x7fe4a40cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:59.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.320+0000 7fe4a2a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4a406df80 0x7fe4a40cc6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55668/0 (socket says 172.21.15.2:55668) 2024-09-10T08:47:59.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.320+0000 7fe4a2a00640 1 -- 172.21.15.2:0/2973079315 learned_addr learned my addr 172.21.15.2:0/2973079315 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:47:59.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.320+0000 7fe49a000640 1 --2- 172.21.15.2:0/2973079315 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4a40cd460 0x7fe4a40ab700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:59.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.320+0000 7fe4a3400640 1 --2- 172.21.15.2:0/2973079315 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe4a4145d20 0x7fe4a41f73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:59.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.320+0000 7fe4a2a00640 1 -- 172.21.15.2:0/2973079315 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe4a4145d20 msgr2=0x7fe4a41f73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:59.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.320+0000 7fe4a2a00640 1 --2- 172.21.15.2:0/2973079315 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe4a4145d20 0x7fe4a41f73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:59.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.320+0000 7fe4a2a00640 1 -- 172.21.15.2:0/2973079315 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4a40cd460 msgr2=0x7fe4a40ab700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:59.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.320+0000 7fe4a2a00640 1 --2- 172.21.15.2:0/2973079315 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4a40cd460 0x7fe4a40ab700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:59.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.320+0000 7fe4a2a00640 1 -- 172.21.15.2:0/2973079315 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4a40abc40 con 0x7fe4a406df80 2024-09-10T08:47:59.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.320+0000 7fe4a2a00640 1 --2- 172.21.15.2:0/2973079315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4a406df80 0x7fe4a40cc6e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe49400c440 tx=0x7fe49400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:59.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.321+0000 7fe49b400640 1 -- 172.21.15.2:0/2973079315 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe494017070 con 0x7fe4a406df80 2024-09-10T08:47:59.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.321+0000 7fe49b400640 1 -- 172.21.15.2:0/2973079315 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe494005ce0 con 0x7fe4a406df80 2024-09-10T08:47:59.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.321+0000 7fe49b400640 1 -- 172.21.15.2:0/2973079315 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4940072b0 con 0x7fe4a406df80 2024-09-10T08:47:59.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.321+0000 7fe4a9600640 1 -- 172.21.15.2:0/2973079315 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4a40b3f40 con 0x7fe4a406df80 2024-09-10T08:47:59.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.321+0000 7fe4a9600640 1 -- 172.21.15.2:0/2973079315 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4a40b4500 con 0x7fe4a406df80 2024-09-10T08:47:59.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.322+0000 7fe4a9600640 1 -- 172.21.15.2:0/2973079315 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4a415c9e0 con 0x7fe4a406df80 2024-09-10T08:47:59.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.323+0000 7fe49b400640 1 -- 172.21.15.2:0/2973079315 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe49401a070 con 0x7fe4a406df80 2024-09-10T08:47:59.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.324+0000 7fe49b400640 1 --2- 172.21.15.2:0/2973079315 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fe48006be30 0x7fe48006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:47:59.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.324+0000 7fe49b400640 1 -- 172.21.15.2:0/2973079315 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7fe49408a360 con 0x7fe4a406df80 2024-09-10T08:47:59.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.324+0000 7fe49a000640 1 --2- 172.21.15.2:0/2973079315 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fe48006be30 0x7fe48006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:47:59.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.325+0000 7fe49a000640 1 --2- 172.21.15.2:0/2973079315 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fe48006be30 0x7fe48006e2f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe4a40cf9c0 tx=0x7fe48c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:47:59.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.328+0000 7fe49b400640 1 -- 172.21.15.2:0/2973079315 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe494058550 con 0x7fe4a406df80 2024-09-10T08:47:59.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.551+0000 7fe4a9600640 1 -- 172.21.15.2:0/2973079315 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe4a40b4bc0 con 0x7fe4a406df80 2024-09-10T08:47:59.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.551+0000 7fe49b400640 1 -- 172.21.15.2:0/2973079315 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5217 (secure 0 0 0) 0x7fe49405c850 con 0x7fe4a406df80 2024-09-10T08:47:59.553 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:47:59.553 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":18,"btime":"2024-09-10T08:47:57:038981+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4634,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3082437117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3082437117},{"type":"v1","addr":"172.21.15.155:6837","nonce":3082437117}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4816,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/3193521843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3193521843},{"type":"v1","addr":"172.21.15.2:6834","nonce":3193521843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4822,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/164428463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":164428463},{"type":"v1","addr":"172.21.15.155:6836","nonce":164428463}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:47:53.446893+0000","modified":"2024-09-10T08:47:56.462174+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4824},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4824":{"gid":4824,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6835/464022930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":464022930},{"type":"v1","addr":"172.21.15.2:6835","nonce":464022930}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4824,"qdb_cluster":[4824]},"id":2}]} 2024-09-10T08:47:59.553 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 18 2024-09-10T08:47:59.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.553+0000 7fe4a9600640 1 -- 172.21.15.2:0/2973079315 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fe48006be30 msgr2=0x7fe48006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:59.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.553+0000 7fe4a9600640 1 --2- 172.21.15.2:0/2973079315 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fe48006be30 0x7fe48006e2f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe4a40cf9c0 tx=0x7fe48c009040 comp rx=0 tx=0).stop 2024-09-10T08:47:59.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.553+0000 7fe4a9600640 1 -- 172.21.15.2:0/2973079315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4a406df80 msgr2=0x7fe4a40cc6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:47:59.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.553+0000 7fe4a9600640 1 --2- 172.21.15.2:0/2973079315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4a406df80 0x7fe4a40cc6e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe49400c440 tx=0x7fe49400c900 comp rx=0 tx=0).stop 2024-09-10T08:47:59.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.553+0000 7fe4a9600640 1 -- 172.21.15.2:0/2973079315 shutdown_connections 2024-09-10T08:47:59.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.553+0000 7fe4a9600640 1 --2- 172.21.15.2:0/2973079315 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fe48006be30 0x7fe48006e2f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:59.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.553+0000 7fe4a9600640 1 --2- 172.21.15.2:0/2973079315 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe4a4145d20 0x7fe4a41f73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:59.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.553+0000 7fe4a9600640 1 --2- 172.21.15.2:0/2973079315 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4a40cd460 0x7fe4a40ab700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:59.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.553+0000 7fe4a9600640 1 --2- 172.21.15.2:0/2973079315 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4a406df80 0x7fe4a40cc6e0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:47:59.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.553+0000 7fe4a9600640 1 -- 172.21.15.2:0/2973079315 >> 172.21.15.2:0/2973079315 conn(0x7fe4a406bc10 msgr2=0x7fe4a4144a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:47:59.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.554+0000 7fe4a9600640 1 -- 172.21.15.2:0/2973079315 shutdown_connections 2024-09-10T08:47:59.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:47:59.554+0000 7fe4a9600640 1 -- 172.21.15.2:0/2973079315 wait complete. 2024-09-10T08:47:59.973 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-10T08:47:53.446893+0000', 'modified': '2024-09-10T08:47:56.462174+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4824}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4824': {'gid': 4824, 'name': 'c', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.2:6835/464022930', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.2:6833', 'nonce': 464022930}, {'type': 'v1', 'addr': '172.21.15.2:6835', 'nonce': 464022930}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4824, 'qdb_cluster': [4824]} 2024-09-10T08:47:59.973 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-10T08:47:59.974 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-10T08:48:00.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.132+0000 7f394a600640 1 Processor -- start 2024-09-10T08:48:00.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.133+0000 7f394a600640 1 -- start start 2024-09-10T08:48:00.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.134+0000 7f394a600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f394406df50 0x7f394415d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:00.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.134+0000 7f394a600640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39441603b0 con 0x7f394415c460 2024-09-10T08:48:00.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.134+0000 7f394a600640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3944160690 con 0x7f39440cf310 2024-09-10T08:48:00.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.134+0000 7f394a600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3944161030 con 0x7f394406df50 2024-09-10T08:48:00.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.134+0000 7f3943400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f394415c460 0x7f39440cec00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41004/0 (socket says 172.21.15.2:41004) 2024-09-10T08:48:00.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.134+0000 7f3943400640 1 -- 172.21.15.2:0/1963395537 learned_addr learned my addr 172.21.15.2:0/1963395537 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:48:00.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.134+0000 7f3943e00640 1 --2- 172.21.15.2:0/1963395537 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f394406df50 0x7f394415d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:00.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.134+0000 7f3942a00640 1 -- 172.21.15.2:0/1963395537 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 190578408 0 0) 0x7f39441603b0 con 0x7f394415c460 2024-09-10T08:48:00.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.134+0000 7f3942a00640 1 -- 172.21.15.2:0/1963395537 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3928003520 con 0x7f394415c460 2024-09-10T08:48:00.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.135+0000 7f3942a00640 1 -- 172.21.15.2:0/1963395537 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2658907697 0 0) 0x7f3944160690 con 0x7f39440cf310 2024-09-10T08:48:00.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.135+0000 7f3942a00640 1 -- 172.21.15.2:0/1963395537 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f39441603b0 con 0x7f39440cf310 2024-09-10T08:48:00.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.135+0000 7f3942a00640 1 -- 172.21.15.2:0/1963395537 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3063496613 0 0) 0x7f3928003520 con 0x7f394415c460 2024-09-10T08:48:00.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.135+0000 7f3942a00640 1 -- 172.21.15.2:0/1963395537 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f394406df50 msgr2=0x7f394415d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:48:00.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.135+0000 7f3942a00640 1 --2- 172.21.15.2:0/1963395537 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f394406df50 0x7f394415d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:00.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.135+0000 7f3942a00640 1 -- 172.21.15.2:0/1963395537 >> v1:172.21.15.155:6789/0 conn(0x7f39440cf310 legacy=0x7f39440b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:00.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.135+0000 7f3942a00640 1 -- 172.21.15.2:0/1963395537 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3944160970 con 0x7f394415c460 2024-09-10T08:48:00.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.135+0000 7f3942a00640 1 -- 172.21.15.2:0/1963395537 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2345211856 0 0) 0x7f3934001670 con 0x7f394415c460 2024-09-10T08:48:00.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.135+0000 7f3942a00640 1 -- 172.21.15.2:0/1963395537 >> v1:172.21.15.2:6789/0 conn(0x7f394415c460 legacy=0x7f39440cec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:00.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.135+0000 7f3942a00640 1 --2- 172.21.15.2:0/1963395537 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f394406df50 0x7f3928003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:00.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.135+0000 7f3942a00640 1 --2- 172.21.15.2:0/1963395537 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39280040d0 0x7f3928004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:00.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.135+0000 7f3942a00640 1 --2- 172.21.15.2:0/1963395537 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3928004d40 0x7f39280051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:00.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.135+0000 7f3942a00640 1 -- 172.21.15.2:0/1963395537 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3944161030 con 0x7f39280040d0 2024-09-10T08:48:00.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.135+0000 7f3942a00640 1 -- 172.21.15.2:0/1963395537 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f392800baa0 con 0x7f3928004d40 2024-09-10T08:48:00.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.135+0000 7f3942a00640 1 -- 172.21.15.2:0/1963395537 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f392800bca0 con 0x7f394406df50 2024-09-10T08:48:00.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.135+0000 7f3943400640 1 --2- 172.21.15.2:0/1963395537 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f394406df50 0x7f3928003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:00.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.135+0000 7f393be00640 1 --2- 172.21.15.2:0/1963395537 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39280040d0 0x7f3928004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:00.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.135+0000 7f3943e00640 1 --2- 172.21.15.2:0/1963395537 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3928004d40 0x7f39280051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:00.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.136+0000 7f3943e00640 1 -- 172.21.15.2:0/1963395537 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f394406df50 msgr2=0x7f3928003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:48:00.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.136+0000 7f3943e00640 1 --2- 172.21.15.2:0/1963395537 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f394406df50 0x7f3928003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:00.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.136+0000 7f3943e00640 1 -- 172.21.15.2:0/1963395537 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39280040d0 msgr2=0x7f3928004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:48:00.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.136+0000 7f3943e00640 1 --2- 172.21.15.2:0/1963395537 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39280040d0 0x7f3928004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:00.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.136+0000 7f3943e00640 1 -- 172.21.15.2:0/1963395537 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3928003520 con 0x7f3928004d40 2024-09-10T08:48:00.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.136+0000 7f393be00640 1 --2- 172.21.15.2:0/1963395537 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39280040d0 0x7f3928004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:48:00.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.137+0000 7f3943e00640 1 --2- 172.21.15.2:0/1963395537 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3928004d40 0x7f39280051c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f393c009f90 tx=0x7f3928005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c61dd73689cceb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:00.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.137+0000 7f3942a00640 1 -- 172.21.15.2:0/1963395537 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f393c009c10 con 0x7f3928004d40 2024-09-10T08:48:00.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.137+0000 7f3942a00640 1 -- 172.21.15.2:0/1963395537 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f393c036070 con 0x7f3928004d40 2024-09-10T08:48:00.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.137+0000 7f3942a00640 1 -- 172.21.15.2:0/1963395537 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f393c031810 con 0x7f3928004d40 2024-09-10T08:48:00.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.138+0000 7f394a600640 1 -- 172.21.15.2:0/1963395537 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3928004d40 msgr2=0x7f39280051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:00.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.138+0000 7f394a600640 1 --2- 172.21.15.2:0/1963395537 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3928004d40 0x7f39280051c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f393c009f90 tx=0x7f3928005830 comp rx=0 tx=0).stop 2024-09-10T08:48:00.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.138+0000 7f3943e00640 1 -- 172.21.15.2:0/1963395537 reap_dead start 2024-09-10T08:48:00.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.138+0000 7f394a600640 1 -- 172.21.15.2:0/1963395537 shutdown_connections 2024-09-10T08:48:00.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.138+0000 7f394a600640 1 -- 172.21.15.2:0/1963395537 >> 172.21.15.2:0/1963395537 conn(0x7f39440d02c0 msgr2=0x7f39440d06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:00.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.138+0000 7f394a600640 1 -- 172.21.15.2:0/1963395537 shutdown_connections 2024-09-10T08:48:00.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.138+0000 7f394a600640 1 -- 172.21.15.2:0/1963395537 wait complete. 2024-09-10T08:48:00.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.140+0000 7f394a600640 1 Processor -- start 2024-09-10T08:48:00.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.140+0000 7f394a600640 1 -- start start 2024-09-10T08:48:00.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.141+0000 7f394a600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3928004d40 0x7f39440c9550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:00.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.141+0000 7f394a600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f394414db90 0x7f394414b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:00.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.141+0000 7f394a600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39440ca130 0x7f394414a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:00.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.141+0000 7f394a600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f394415c840 con 0x7f3928004d40 2024-09-10T08:48:00.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.141+0000 7f394a600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3944160080 con 0x7f39440ca130 2024-09-10T08:48:00.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.141+0000 7f394a600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f39440d1050 con 0x7f394414db90 2024-09-10T08:48:00.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.142+0000 7f3943400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3928004d40 0x7f39440c9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:00.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.142+0000 7f3943400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3928004d40 0x7f39440c9550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55688/0 (socket says 172.21.15.2:55688) 2024-09-10T08:48:00.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.142+0000 7f3943400640 1 -- 172.21.15.2:0/2285694227 learned_addr learned my addr 172.21.15.2:0/2285694227 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:00.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.142+0000 7f393be00640 1 --2- 172.21.15.2:0/2285694227 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f394414db90 0x7f394414b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:00.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.142+0000 7f3943e00640 1 --2- 172.21.15.2:0/2285694227 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39440ca130 0x7f394414a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:00.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.142+0000 7f3943400640 1 -- 172.21.15.2:0/2285694227 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f394414db90 msgr2=0x7f394414b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:00.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.142+0000 7f3943400640 1 --2- 172.21.15.2:0/2285694227 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f394414db90 0x7f394414b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:00.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.142+0000 7f3943400640 1 -- 172.21.15.2:0/2285694227 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39440ca130 msgr2=0x7f394414a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:00.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.142+0000 7f3943400640 1 --2- 172.21.15.2:0/2285694227 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39440ca130 0x7f394414a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:00.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.142+0000 7f3943400640 1 -- 172.21.15.2:0/2285694227 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3944159b00 con 0x7f3928004d40 2024-09-10T08:48:00.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.142+0000 7f3943400640 1 --2- 172.21.15.2:0/2285694227 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3928004d40 0x7f39440c9550 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3934007310 tx=0x7f3934007710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:00.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.143+0000 7f393b400640 1 -- 172.21.15.2:0/2285694227 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f393400f960 con 0x7f3928004d40 2024-09-10T08:48:00.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.143+0000 7f393b400640 1 -- 172.21.15.2:0/2285694227 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3934018070 con 0x7f3928004d40 2024-09-10T08:48:00.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.143+0000 7f394a600640 1 -- 172.21.15.2:0/2285694227 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3944159de0 con 0x7f3928004d40 2024-09-10T08:48:00.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.143+0000 7f393b400640 1 -- 172.21.15.2:0/2285694227 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f393400fd80 con 0x7f3928004d40 2024-09-10T08:48:00.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.143+0000 7f394a600640 1 -- 172.21.15.2:0/2285694227 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f394415a3a0 con 0x7f3928004d40 2024-09-10T08:48:00.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.145+0000 7f393b400640 1 -- 172.21.15.2:0/2285694227 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f393401d460 con 0x7f3928004d40 2024-09-10T08:48:00.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.145+0000 7f393b400640 1 --2- 172.21.15.2:0/2285694227 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f392006be60 0x7f392006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:00.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.146+0000 7f393b400640 1 -- 172.21.15.2:0/2285694227 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f393408af30 con 0x7f3928004d40 2024-09-10T08:48:00.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.146+0000 7f393be00640 1 --2- 172.21.15.2:0/2285694227 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f392006be60 0x7f392006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:00.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.146+0000 7f394d486740 1 Processor -- start 2024-09-10T08:48:00.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.147+0000 7f394d486740 1 -- start start 2024-09-10T08:48:00.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.147+0000 7f393be00640 1 --2- 172.21.15.2:0/2285694227 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f392006be60 0x7f392006e320 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3944073c30 tx=0x7f392c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:00.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.148+0000 7f394d486740 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x559d4b6aecf0 0x559d4b6f4490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:00.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.148+0000 7f394d486740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559d4b6ac4b0 0x559d4b6af0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:00.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.148+0000 7f394d486740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d4b6b0480 0x559d4b6a9570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:00.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.148+0000 7f394d486740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x559d4b60d3b0 con 0x559d4b6b0480 2024-09-10T08:48:00.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.148+0000 7f394d486740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x559d4b612410 con 0x559d4b6ac4b0 2024-09-10T08:48:00.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.148+0000 7f394d486740 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x559d4b5ba620 con 0x559d4b6aecf0 2024-09-10T08:48:00.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.148+0000 7f3943e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d4b6b0480 0x559d4b6a9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:00.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.148+0000 7f3943e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d4b6b0480 0x559d4b6a9570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55704/0 (socket says 172.21.15.2:55704) 2024-09-10T08:48:00.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.148+0000 7f3943e00640 1 -- 172.21.15.2:0/633810691 learned_addr learned my addr 172.21.15.2:0/633810691 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:00.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.148+0000 7f393be00640 1 --2- 172.21.15.2:0/633810691 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559d4b6ac4b0 0x559d4b6af0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:00.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.148+0000 7f3943400640 1 --2- 172.21.15.2:0/633810691 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x559d4b6aecf0 0x559d4b6f4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:00.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.148+0000 7f3943e00640 1 -- 172.21.15.2:0/633810691 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x559d4b6aecf0 msgr2=0x559d4b6f4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:48:00.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.148+0000 7f3943e00640 1 --2- 172.21.15.2:0/633810691 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x559d4b6aecf0 0x559d4b6f4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:00.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.148+0000 7f3943e00640 1 -- 172.21.15.2:0/633810691 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559d4b6ac4b0 msgr2=0x559d4b6af0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:48:00.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.148+0000 7f3943e00640 1 --2- 172.21.15.2:0/633810691 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559d4b6ac4b0 0x559d4b6af0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:00.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.148+0000 7f3943e00640 1 -- 172.21.15.2:0/633810691 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d4b3252d0 con 0x559d4b6b0480 2024-09-10T08:48:00.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.149+0000 7f3943e00640 1 --2- 172.21.15.2:0/633810691 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d4b6b0480 0x559d4b6a9570 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f393c00e230 tx=0x7f393c02d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c00ebf2f102e1cd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:00.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.149+0000 7f3933e00640 1 -- 172.21.15.2:0/633810691 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f392c0014f0 con 0x559d4b6b0480 2024-09-10T08:48:00.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.149+0000 7f3933e00640 1 -- 172.21.15.2:0/633810691 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f393c036040 con 0x559d4b6b0480 2024-09-10T08:48:00.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.149+0000 7f3933e00640 1 -- 172.21.15.2:0/633810691 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f393c03c930 con 0x559d4b6b0480 2024-09-10T08:48:00.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.149+0000 7f394d486740 1 -- 172.21.15.2:0/633810691 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d4b6b0480 msgr2=0x559d4b6a9570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:00.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.149+0000 7f394d486740 1 --2- 172.21.15.2:0/633810691 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d4b6b0480 0x559d4b6a9570 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f393c00e230 tx=0x7f393c02d000 comp rx=0 tx=0).stop 2024-09-10T08:48:00.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.150+0000 7f394d486740 1 -- 172.21.15.2:0/633810691 shutdown_connections 2024-09-10T08:48:00.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.150+0000 7f394d486740 1 --2- 172.21.15.2:0/633810691 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d4b6b0480 0x559d4b6a9570 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:00.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.150+0000 7f394d486740 1 --2- 172.21.15.2:0/633810691 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559d4b6ac4b0 0x559d4b6af0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:00.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.150+0000 7f394d486740 1 --2- 172.21.15.2:0/633810691 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x559d4b6aecf0 0x559d4b6f4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:00.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.150+0000 7f394d486740 1 -- 172.21.15.2:0/633810691 >> 172.21.15.2:0/633810691 conn(0x559d4b6ab740 msgr2=0x559d4b6f3960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:00.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.150+0000 7f394d486740 1 -- 172.21.15.2:0/633810691 shutdown_connections 2024-09-10T08:48:00.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.150+0000 7f394d486740 1 -- 172.21.15.2:0/633810691 wait complete. 2024-09-10T08:48:00.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.150+0000 7f394d486740 1 -- start start 2024-09-10T08:48:00.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.151+0000 7f394d486740 1 Processor -- start 2024-09-10T08:48:00.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.151+0000 7f394d486740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d4b6aecf0 0x559d4b6d9220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:00.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.151+0000 7f394d486740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559d4b6b0480 0x559d4b6cd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:00.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.152+0000 7f394d486740 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x559d4b706d90 0x559d4b704030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:00.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.152+0000 7f394d486740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x559d4b5cd780 con 0x559d4b6aecf0 2024-09-10T08:48:00.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.152+0000 7f394d486740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x559d4b60e3d0 con 0x559d4b6b0480 2024-09-10T08:48:00.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.152+0000 7f394d486740 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x559d4b6aabe0 con 0x559d4b706d90 2024-09-10T08:48:00.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.152+0000 7f394d486740 10 client.0 _ll_register_callbacks cb 0x559d4b60b5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:48:00.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.152+0000 7f3943400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d4b6aecf0 0x559d4b6d9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:00.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.152+0000 7f3943400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d4b6aecf0 0x559d4b6d9220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55712/0 (socket says 172.21.15.2:55712) 2024-09-10T08:48:00.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.152+0000 7f3943400640 1 -- 172.21.15.2:0/1873681641 learned_addr learned my addr 172.21.15.2:0/1873681641 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:00.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.152+0000 7f3943e00640 1 --2- 172.21.15.2:0/1873681641 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x559d4b706d90 0x559d4b704030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:00.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.152+0000 7f393be00640 1 --2- 172.21.15.2:0/1873681641 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559d4b6b0480 0x559d4b6cd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:00.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.152+0000 7f3943400640 1 -- 172.21.15.2:0/1873681641 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x559d4b706d90 msgr2=0x559d4b704030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:48:00.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.152+0000 7f3943400640 1 --2- 172.21.15.2:0/1873681641 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x559d4b706d90 0x559d4b704030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:00.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.152+0000 7f3943400640 1 -- 172.21.15.2:0/1873681641 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559d4b6b0480 msgr2=0x559d4b6cd1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:48:00.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.152+0000 7f3943400640 1 --2- 172.21.15.2:0/1873681641 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559d4b6b0480 0x559d4b6cd1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:00.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.152+0000 7f3943400640 1 -- 172.21.15.2:0/1873681641 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d4b3ef6b0 con 0x559d4b6aecf0 2024-09-10T08:48:00.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.152+0000 7f3943400640 1 --2- 172.21.15.2:0/1873681641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d4b6aecf0 0x559d4b6d9220 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f393400f5a0 tx=0x7f3934058a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=284031417bc36e05 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:00.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.152+0000 7f3930c00640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2024-09-10T08:48:00.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.153+0000 7f3930c00640 1 -- 172.21.15.2:0/1873681641 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3934087060 con 0x559d4b6aecf0 2024-09-10T08:48:00.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.153+0000 7f3930c00640 1 -- 172.21.15.2:0/1873681641 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f3934058690 con 0x559d4b6aecf0 2024-09-10T08:48:00.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.153+0000 7f394d486740 1 -- 172.21.15.2:0/1873681641 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f393c036040 con 0x559d4b6aecf0 2024-09-10T08:48:00.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.153+0000 7f3930c00640 1 -- 172.21.15.2:0/1873681641 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f393405d3f0 con 0x559d4b6aecf0 2024-09-10T08:48:00.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.153+0000 7f394d486740 10 client.4980 fetch_fsmap learned FSMap version 18 2024-09-10T08:48:00.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.153+0000 7f394d486740 1 -- 172.21.15.2:0/1873681641 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x559d4b7075c0 con 0x559d4b6aecf0 2024-09-10T08:48:00.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.153+0000 7f3930c00640 1 -- 172.21.15.2:0/1873681641 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f393c036040 con 0x559d4b6aecf0 2024-09-10T08:48:00.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.153+0000 7f3930c00640 1 -- 172.21.15.2:0/1873681641 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 18) ==== 3502+0+0 (secure 0 0 0) 0x7f3934073030 con 0x559d4b6aecf0 2024-09-10T08:48:00.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.153+0000 7f394d486740 10 client.4980 fetch_fsmap finished waiting for FSMap version 18 2024-09-10T08:48:00.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.153+0000 7f394d486740 10 client.4980 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T08:48:00.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.153+0000 7f394d486740 20 client.4980 populate_metadata read hostname 'smithi002' 2024-09-10T08:48:00.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.153+0000 7f394d486740 1 --2- 172.21.15.2:0/1873681641 >> [v2:172.21.15.2:6833/464022930,v1:172.21.15.2:6835/464022930] conn(0x559d4b6ad760 0x559d4b712200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:00.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.153+0000 7f394d486740 4 client.4980 mds_command: new command op to 4824 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-10T08:48:00.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.153+0000 7f394d486740 1 -- 172.21.15.2:0/1873681641 --> [v2:172.21.15.2:6833/464022930,v1:172.21.15.2:6835/464022930] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559d4b61fb40 con 0x559d4b6ad760 2024-09-10T08:48:00.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.154+0000 7f393be00640 1 --2- 172.21.15.2:0/1873681641 >> [v2:172.21.15.2:6833/464022930,v1:172.21.15.2:6835/464022930] conn(0x559d4b6ad760 0x559d4b712200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:00.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.154+0000 7f393be00640 1 --2- 172.21.15.2:0/1873681641 >> [v2:172.21.15.2:6833/464022930,v1:172.21.15.2:6835/464022930] conn(0x559d4b6ad760 0x559d4b712200 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b50da0f44f9f26 server_cookie=a1f5678f64f0cfa7 in_seq=0 out_seq=0 2024-09-10T08:48:00.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.154+0000 7f3930c00640 10 client.4980 ms_handle_connect on v2:172.21.15.2:6833/464022930 2024-09-10T08:48:00.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.155+0000 7f3930c00640 1 -- 172.21.15.2:0/1873681641 <== mds.0 v2:172.21.15.2:6833/464022930 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559d4b61fb40 con 0x559d4b6ad760 2024-09-10T08:48:00.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.155+0000 7f3930c00640 10 client.4980 handle_command_reply: tid=0 2024-09-10T08:48:00.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.155+0000 7f394d486740 1 client.4980 shutdown 2024-09-10T08:48:00.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.155+0000 7f394d486740 1 -- 172.21.15.2:0/1873681641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d4b6aecf0 msgr2=0x559d4b6d9220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:00.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.155+0000 7f394d486740 1 --2- 172.21.15.2:0/1873681641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d4b6aecf0 0x559d4b6d9220 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f393400f5a0 tx=0x7f3934058a20 comp rx=0 tx=0).stop 2024-09-10T08:48:00.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.155+0000 7f394d486740 1 -- 172.21.15.2:0/1873681641 shutdown_connections 2024-09-10T08:48:00.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.155+0000 7f394d486740 1 --2- 172.21.15.2:0/1873681641 >> [v2:172.21.15.2:6833/464022930,v1:172.21.15.2:6835/464022930] conn(0x559d4b6ad760 0x559d4b712200 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:00.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.155+0000 7f394d486740 1 --2- 172.21.15.2:0/1873681641 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x559d4b706d90 0x559d4b704030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:00.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.155+0000 7f3930c00640 0 client.4980 ms_handle_reset on v2:172.21.15.2:6833/464022930 2024-09-10T08:48:00.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.155+0000 7f394d486740 1 --2- 172.21.15.2:0/1873681641 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559d4b6b0480 0x559d4b6cd1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:00.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.155+0000 7f394d486740 1 --2- 172.21.15.2:0/1873681641 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d4b6aecf0 0x559d4b6d9220 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:00.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.155+0000 7f394d486740 1 -- 172.21.15.2:0/1873681641 >> 172.21.15.2:0/1873681641 conn(0x559d4b6ac4b0 msgr2=0x559d4b6f19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:00.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.156+0000 7f394d486740 1 -- 172.21.15.2:0/1873681641 shutdown_connections 2024-09-10T08:48:00.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.156+0000 7f394d486740 1 -- 172.21.15.2:0/1873681641 wait complete. 2024-09-10T08:48:00.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.156+0000 7f394d486740 20 client.4980 trim_cache size 0 max 16384 2024-09-10T08:48:00.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.174+0000 7f394d486740 1 Processor -- start 2024-09-10T08:48:00.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.174+0000 7f394d486740 1 -- start start 2024-09-10T08:48:00.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.175+0000 7f394d486740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559d4b6aecf0 0x559d4b6f2df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:00.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.175+0000 7f394d486740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d4b6b0480 0x559d4b702bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:00.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.175+0000 7f394d486740 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x559d4b706d90 0x559d4b703130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:00.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.175+0000 7f394d486740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3944200860 con 0x559d4b6b0480 2024-09-10T08:48:00.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.175+0000 7f394d486740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3944072a90 con 0x559d4b6aecf0 2024-09-10T08:48:00.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.175+0000 7f394d486740 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3944200210 con 0x559d4b706d90 2024-09-10T08:48:00.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.175+0000 7f393be00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d4b6b0480 0x559d4b702bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:00.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.175+0000 7f393be00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d4b6b0480 0x559d4b702bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55716/0 (socket says 172.21.15.2:55716) 2024-09-10T08:48:00.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.175+0000 7f393be00640 1 -- 172.21.15.2:0/3756993283 learned_addr learned my addr 172.21.15.2:0/3756993283 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:00.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.175+0000 7f3943400640 1 --2- 172.21.15.2:0/3756993283 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559d4b6aecf0 0x559d4b6f2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:00.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.176+0000 7f3943e00640 1 --2- 172.21.15.2:0/3756993283 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x559d4b706d90 0x559d4b703130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:00.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.176+0000 7f393be00640 1 -- 172.21.15.2:0/3756993283 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x559d4b706d90 msgr2=0x559d4b703130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:48:00.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.176+0000 7f393be00640 1 --2- 172.21.15.2:0/3756993283 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x559d4b706d90 0x559d4b703130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:00.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.176+0000 7f393be00640 1 -- 172.21.15.2:0/3756993283 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559d4b6aecf0 msgr2=0x559d4b6f2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:48:00.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.176+0000 7f393be00640 1 --2- 172.21.15.2:0/3756993283 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559d4b6aecf0 0x559d4b6f2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:00.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.176+0000 7f393be00640 1 -- 172.21.15.2:0/3756993283 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d4b6af440 con 0x559d4b6b0480 2024-09-10T08:48:00.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.176+0000 7f3943e00640 1 --2- 172.21.15.2:0/3756993283 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x559d4b706d90 0x559d4b703130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:48:00.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.176+0000 7f393be00640 1 --2- 172.21.15.2:0/3756993283 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d4b6b0480 0x559d4b702bf0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f392c012ff0 tx=0x7f392c00f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80f74d375401c6ba server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:00.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.176+0000 7f3933400640 1 -- 172.21.15.2:0/3756993283 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f392c015a10 con 0x559d4b6b0480 2024-09-10T08:48:00.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.176+0000 7f3933400640 1 -- 172.21.15.2:0/3756993283 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f392c015bb0 con 0x559d4b6b0480 2024-09-10T08:48:00.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.176+0000 7f3933400640 1 -- 172.21.15.2:0/3756993283 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f392c015d60 con 0x559d4b6b0480 2024-09-10T08:48:00.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.177+0000 7f394d486740 1 -- 172.21.15.2:0/3756993283 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d4b6b0480 msgr2=0x559d4b702bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:00.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.177+0000 7f394d486740 1 --2- 172.21.15.2:0/3756993283 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d4b6b0480 0x559d4b702bf0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f392c012ff0 tx=0x7f392c00f000 comp rx=0 tx=0).stop 2024-09-10T08:48:00.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.177+0000 7f394d486740 1 -- 172.21.15.2:0/3756993283 shutdown_connections 2024-09-10T08:48:00.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.177+0000 7f394d486740 1 --2- 172.21.15.2:0/3756993283 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x559d4b706d90 0x559d4b703130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:00.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.177+0000 7f394d486740 1 --2- 172.21.15.2:0/3756993283 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d4b6b0480 0x559d4b702bf0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:00.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.177+0000 7f394d486740 1 --2- 172.21.15.2:0/3756993283 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559d4b6aecf0 0x559d4b6f2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:00.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.177+0000 7f394d486740 1 -- 172.21.15.2:0/3756993283 >> 172.21.15.2:0/3756993283 conn(0x559d4b6ac4b0 msgr2=0x559d4b6f19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:00.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.177+0000 7f394d486740 1 -- 172.21.15.2:0/3756993283 shutdown_connections 2024-09-10T08:48:00.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.177+0000 7f394d486740 1 -- 172.21.15.2:0/3756993283 wait complete. 2024-09-10T08:48:00.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.178+0000 7f394d486740 1 -- start start 2024-09-10T08:48:00.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.178+0000 7f394d486740 1 Processor -- start 2024-09-10T08:48:00.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.179+0000 7f394d486740 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x559d4b6aecf0 0x559d4b7725f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:00.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.179+0000 7f394d486740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559d4b6b0480 0x559d4b702bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:00.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.179+0000 7f394d486740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d4b706d90 0x559d4b703130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:00.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.179+0000 7f394d486740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x559d4b6ad5e0 con 0x559d4b706d90 2024-09-10T08:48:00.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.179+0000 7f394d486740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x559d4b7037c0 con 0x559d4b6b0480 2024-09-10T08:48:00.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.179+0000 7f394d486740 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x559d4b6ce060 con 0x559d4b6aecf0 2024-09-10T08:48:00.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.179+0000 7f394d486740 10 client.0 _ll_register_callbacks cb 0x7f393400ff20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-10T08:48:00.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.179+0000 7f3943e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d4b706d90 0x559d4b703130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:00.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.179+0000 7f3943400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x559d4b6aecf0 0x559d4b7725f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:00.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.179+0000 7f3943e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d4b706d90 0x559d4b703130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55722/0 (socket says 172.21.15.2:55722) 2024-09-10T08:48:00.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.179+0000 7f3943e00640 1 -- 172.21.15.2:0/39785972 learned_addr learned my addr 172.21.15.2:0/39785972 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:00.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.179+0000 7f393be00640 1 --2- 172.21.15.2:0/39785972 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559d4b6b0480 0x559d4b702bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:00.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.179+0000 7f3943400640 1 -- 172.21.15.2:0/39785972 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559d4b6b0480 msgr2=0x559d4b702bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:48:00.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.179+0000 7f3943400640 1 --2- 172.21.15.2:0/39785972 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559d4b6b0480 0x559d4b702bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:00.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.179+0000 7f3943400640 1 -- 172.21.15.2:0/39785972 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d4b706d90 msgr2=0x559d4b703130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:48:00.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.179+0000 7f3943400640 1 --2- 172.21.15.2:0/39785972 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d4b706d90 0x559d4b703130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:00.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.179+0000 7f3943400640 1 -- 172.21.15.2:0/39785972 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x559d4b6ab4e0 con 0x559d4b6aecf0 2024-09-10T08:48:00.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.179+0000 7f3943e00640 1 --2- 172.21.15.2:0/39785972 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d4b706d90 0x559d4b703130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:48:00.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.180+0000 7f3943400640 1 --2- 172.21.15.2:0/39785972 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x559d4b6aecf0 0x559d4b7725f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f39340559c0 tx=0x7f393406f070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3dade482503397ca server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:00.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.180+0000 7f3930c00640 10 client.0 ms_handle_connect on v2:172.21.15.155:3301/0 2024-09-10T08:48:00.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.180+0000 7f3930c00640 1 -- 172.21.15.2:0/39785972 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3934058b80 con 0x559d4b6aecf0 2024-09-10T08:48:00.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.180+0000 7f3930c00640 1 -- 172.21.15.2:0/39785972 <== mon.2 v2:172.21.15.155:3301/0 2 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f393401d750 con 0x559d4b6aecf0 2024-09-10T08:48:00.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.180+0000 7f394d486740 1 -- 172.21.15.2:0/39785972 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f392c015bb0 con 0x559d4b6aecf0 2024-09-10T08:48:00.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.180+0000 7f3930c00640 1 -- 172.21.15.2:0/39785972 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f3934066050 con 0x559d4b6aecf0 2024-09-10T08:48:00.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.180+0000 7f394d486740 10 client.4757 fetch_fsmap learned FSMap version 18 2024-09-10T08:48:00.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.180+0000 7f394d486740 1 -- 172.21.15.2:0/39785972 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x559d4b6d3cf0 con 0x559d4b6aecf0 2024-09-10T08:48:00.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.180+0000 7f3930c00640 1 -- 172.21.15.2:0/39785972 <== mon.2 v2:172.21.15.155:3301/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f392c015bb0 con 0x559d4b6aecf0 2024-09-10T08:48:00.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.181+0000 7f3930c00640 1 -- 172.21.15.2:0/39785972 <== mon.2 v2:172.21.15.155:3301/0 5 ==== fsmap(e 18) ==== 3502+0+0 (secure 0 0 0) 0x7f3934080060 con 0x559d4b6aecf0 2024-09-10T08:48:00.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.181+0000 7f394d486740 10 client.4757 fetch_fsmap finished waiting for FSMap version 18 2024-09-10T08:48:00.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.181+0000 7f394d486740 10 client.4757 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-10T08:48:00.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.181+0000 7f394d486740 20 client.4757 populate_metadata read hostname 'smithi002' 2024-09-10T08:48:00.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.181+0000 7f394d486740 1 --2- 172.21.15.2:0/39785972 >> [v2:172.21.15.2:6833/464022930,v1:172.21.15.2:6835/464022930] conn(0x559d4b70a5c0 0x559d4b70a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:00.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.181+0000 7f394d486740 4 client.4757 mds_command: new command op to 4824 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-10T08:48:00.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.181+0000 7f394d486740 1 -- 172.21.15.2:0/39785972 --> [v2:172.21.15.2:6833/464022930,v1:172.21.15.2:6835/464022930] -- command(tid 0: {"prefix": "status"}) -- 0x559d4b619e90 con 0x559d4b70a5c0 2024-09-10T08:48:00.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.181+0000 7f393be00640 1 --2- 172.21.15.2:0/39785972 >> [v2:172.21.15.2:6833/464022930,v1:172.21.15.2:6835/464022930] conn(0x559d4b70a5c0 0x559d4b70a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:00.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.181+0000 7f393be00640 1 --2- 172.21.15.2:0/39785972 >> [v2:172.21.15.2:6833/464022930,v1:172.21.15.2:6835/464022930] conn(0x559d4b70a5c0 0x559d4b70a9a0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=baf71aeafe36d5e6 server_cookie=cf1104d210663f97 in_seq=0 out_seq=0 2024-09-10T08:48:00.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.181+0000 7f3930c00640 10 client.4757 ms_handle_connect on v2:172.21.15.2:6833/464022930 2024-09-10T08:48:00.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.182+0000 7f3930c00640 1 -- 172.21.15.2:0/39785972 <== mds.0 v2:172.21.15.2:6833/464022930 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x559d4b619e90 con 0x559d4b70a5c0 2024-09-10T08:48:00.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.182+0000 7f3930c00640 10 client.4757 handle_command_reply: tid=0 2024-09-10T08:48:00.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.182+0000 7f394d486740 1 client.4757 shutdown 2024-09-10T08:48:00.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.182+0000 7f394d486740 1 -- 172.21.15.2:0/39785972 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x559d4b6aecf0 msgr2=0x559d4b7725f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:00.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.182+0000 7f394d486740 1 --2- 172.21.15.2:0/39785972 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x559d4b6aecf0 0x559d4b7725f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f39340559c0 tx=0x7f393406f070 comp rx=0 tx=0).stop 2024-09-10T08:48:00.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.182+0000 7f394d486740 1 -- 172.21.15.2:0/39785972 shutdown_connections 2024-09-10T08:48:00.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.182+0000 7f394d486740 1 --2- 172.21.15.2:0/39785972 >> [v2:172.21.15.2:6833/464022930,v1:172.21.15.2:6835/464022930] conn(0x559d4b70a5c0 0x559d4b70a9a0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:00.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.182+0000 7f394d486740 1 --2- 172.21.15.2:0/39785972 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x559d4b706d90 0x559d4b703130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:00.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.182+0000 7f394d486740 1 --2- 172.21.15.2:0/39785972 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559d4b6b0480 0x559d4b702bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:00.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.182+0000 7f394d486740 1 --2- 172.21.15.2:0/39785972 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x559d4b6aecf0 0x559d4b7725f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:00.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.182+0000 7f3930c00640 0 client.4757 ms_handle_reset on v2:172.21.15.2:6833/464022930 2024-09-10T08:48:00.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.182+0000 7f394d486740 1 -- 172.21.15.2:0/39785972 >> 172.21.15.2:0/39785972 conn(0x559d4b6ac4b0 msgr2=0x559d4b6adee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:00.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.182+0000 7f394d486740 1 -- 172.21.15.2:0/39785972 shutdown_connections 2024-09-10T08:48:00.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.182+0000 7f394d486740 1 -- 172.21.15.2:0/39785972 wait complete. 2024-09-10T08:48:00.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.182+0000 7f394d486740 20 client.4757 trim_cache size 0 max 16384 2024-09-10T08:48:00.188 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T08:48:00.189 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "f20a15a7-d363-4d44-98cb-4f4f466b52b8", 2024-09-10T08:48:00.189 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 0, 2024-09-10T08:48:00.189 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 4824, 2024-09-10T08:48:00.189 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2024-09-10T08:48:00.189 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2024-09-10T08:48:00.189 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2024-09-10T08:48:00.189 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 6.1532656460000004, 2024-09-10T08:48:00.189 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 18, 2024-09-10T08:48:00.189 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 38, 2024-09-10T08:48:00.189 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 38, 2024-09-10T08:48:00.189 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 13.103795570999999 2024-09-10T08:48:00.189 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T08:48:00.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.183+0000 7f394a600640 1 -- 172.21.15.2:0/2285694227 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f392006be60 msgr2=0x7f392006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:00.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.183+0000 7f394a600640 1 --2- 172.21.15.2:0/2285694227 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f392006be60 0x7f392006e320 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3944073c30 tx=0x7f392c009040 comp rx=0 tx=0).stop 2024-09-10T08:48:00.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.183+0000 7f394a600640 1 -- 172.21.15.2:0/2285694227 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3928004d40 msgr2=0x7f39440c9550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:00.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.183+0000 7f394a600640 1 --2- 172.21.15.2:0/2285694227 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3928004d40 0x7f39440c9550 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3934007310 tx=0x7f3934007710 comp rx=0 tx=0).stop 2024-09-10T08:48:00.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.183+0000 7f394a600640 1 -- 172.21.15.2:0/2285694227 shutdown_connections 2024-09-10T08:48:00.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.183+0000 7f394a600640 1 --2- 172.21.15.2:0/2285694227 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39440ca130 0x7f394414a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:00.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.183+0000 7f394a600640 1 --2- 172.21.15.2:0/2285694227 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f392006be60 0x7f392006e320 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:00.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.183+0000 7f394a600640 1 --2- 172.21.15.2:0/2285694227 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f394414db90 0x7f394414b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:00.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.183+0000 7f394a600640 1 --2- 172.21.15.2:0/2285694227 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3928004d40 0x7f39440c9550 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:00.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.183+0000 7f394a600640 1 -- 172.21.15.2:0/2285694227 >> 172.21.15.2:0/2285694227 conn(0x7f39440d02c0 msgr2=0x7f394406e430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:00.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.183+0000 7f394a600640 1 -- 172.21.15.2:0/2285694227 shutdown_connections 2024-09-10T08:48:00.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.183+0000 7f394a600640 1 -- 172.21.15.2:0/2285694227 wait complete. 2024-09-10T08:48:00.200 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-10T08:48:00.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.355+0000 7fef2b400640 1 Processor -- start 2024-09-10T08:48:00.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.355+0000 7fef2b400640 1 -- start start 2024-09-10T08:48:00.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.356+0000 7fef2b400640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fef24144250 0x7fef240cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:00.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.356+0000 7fef2b400640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef2406f540 con 0x7fef24144c90 2024-09-10T08:48:00.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.356+0000 7fef2b400640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef2406f820 con 0x7fef240cd480 2024-09-10T08:48:00.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.356+0000 7fef2b400640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fef2406fb00 con 0x7fef24144250 2024-09-10T08:48:00.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.356+0000 7fef23e00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fef24144c90 0x7fef240ccd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41014/0 (socket says 172.21.15.2:41014) 2024-09-10T08:48:00.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.357+0000 7fef23e00640 1 -- 172.21.15.2:0/1098365522 learned_addr learned my addr 172.21.15.2:0/1098365522 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:48:00.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.357+0000 7fef28a00640 1 --2- 172.21.15.2:0/1098365522 >> v2:172.21.15.155:3300/0 conn(0x7fef24144250 0x7fef240cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:00.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.357+0000 7fef23400640 1 -- 172.21.15.2:0/1098365522 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2680963662 0 0) 0x7fef2406f540 con 0x7fef24144c90 2024-09-10T08:48:00.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.357+0000 7fef23400640 1 -- 172.21.15.2:0/1098365522 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef0c003520 con 0x7fef24144c90 2024-09-10T08:48:00.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.357+0000 7fef23400640 1 -- 172.21.15.2:0/1098365522 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 112364673 0 0) 0x7fef2406f820 con 0x7fef240cd480 2024-09-10T08:48:00.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.357+0000 7fef23400640 1 -- 172.21.15.2:0/1098365522 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef2406f540 con 0x7fef240cd480 2024-09-10T08:48:00.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.357+0000 7fef28a00640 1 -- 172.21.15.2:0/1098365522 >> v1:172.21.15.155:6789/0 conn(0x7fef240cd480 legacy=0x7fef240ce420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:00.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.357+0000 7fef28a00640 1 -- 172.21.15.2:0/1098365522 >> v1:172.21.15.2:6789/0 conn(0x7fef24144c90 legacy=0x7fef240ccd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:00.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.357+0000 7fef28a00640 1 -- 172.21.15.2:0/1098365522 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef2406fde0 con 0x7fef24144250 2024-09-10T08:48:00.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.358+0000 7fef28a00640 1 --2- 172.21.15.2:0/1098365522 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef24144250 0x7fef240cf8d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fef180097a0 tx=0x7fef1802a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d6b20b352b63ec server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:00.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.359+0000 7fef23400640 1 -- 172.21.15.2:0/1098365522 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef18037070 con 0x7fef24144250 2024-09-10T08:48:00.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.359+0000 7fef23400640 1 -- 172.21.15.2:0/1098365522 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef18032440 con 0x7fef24144250 2024-09-10T08:48:00.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.359+0000 7fef23400640 1 -- 172.21.15.2:0/1098365522 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef18032810 con 0x7fef24144250 2024-09-10T08:48:00.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.359+0000 7fef2b400640 1 -- 172.21.15.2:0/1098365522 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef24144250 msgr2=0x7fef240cf8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:00.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.359+0000 7fef2b400640 1 --2- 172.21.15.2:0/1098365522 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef24144250 0x7fef240cf8d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fef180097a0 tx=0x7fef1802a230 comp rx=0 tx=0).stop 2024-09-10T08:48:00.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.359+0000 7fef2b400640 1 -- 172.21.15.2:0/1098365522 shutdown_connections 2024-09-10T08:48:00.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.359+0000 7fef2b400640 1 --2- 172.21.15.2:0/1098365522 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef24144250 0x7fef240cf8d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:00.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.359+0000 7fef2b400640 1 -- 172.21.15.2:0/1098365522 >> 172.21.15.2:0/1098365522 conn(0x7fef2406bc10 msgr2=0x7fef2406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:00.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.359+0000 7fef2b400640 1 -- 172.21.15.2:0/1098365522 shutdown_connections 2024-09-10T08:48:00.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.359+0000 7fef2b400640 1 -- 172.21.15.2:0/1098365522 wait complete. 2024-09-10T08:48:00.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.361+0000 7fef2b400640 1 Processor -- start 2024-09-10T08:48:00.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.361+0000 7fef2b400640 1 -- start start 2024-09-10T08:48:00.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.362+0000 7fef2b400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef240cd480 0x7fef241f5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:00.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.362+0000 7fef2b400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef24144250 0x7fef2415af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:00.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.362+0000 7fef2b400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef24144c90 0x7fef240ae3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:00.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.362+0000 7fef2b400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fef240b3390 con 0x7fef24144c90 2024-09-10T08:48:00.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.362+0000 7fef2b400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fef240cfe10 con 0x7fef24144250 2024-09-10T08:48:00.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.362+0000 7fef2b400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fef240ceb30 con 0x7fef240cd480 2024-09-10T08:48:00.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.362+0000 7fef29400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef24144c90 0x7fef240ae3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:00.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.363+0000 7fef29400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef24144c90 0x7fef240ae3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55726/0 (socket says 172.21.15.2:55726) 2024-09-10T08:48:00.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.363+0000 7fef29400640 1 -- 172.21.15.2:0/3495062310 learned_addr learned my addr 172.21.15.2:0/3495062310 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:00.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.363+0000 7fef23e00640 1 --2- 172.21.15.2:0/3495062310 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef24144250 0x7fef2415af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:00.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.363+0000 7fef28a00640 1 --2- 172.21.15.2:0/3495062310 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef240cd480 0x7fef241f5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:00.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.363+0000 7fef29400640 1 -- 172.21.15.2:0/3495062310 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef240cd480 msgr2=0x7fef241f5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:00.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.363+0000 7fef29400640 1 --2- 172.21.15.2:0/3495062310 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef240cd480 0x7fef241f5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:00.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.363+0000 7fef29400640 1 -- 172.21.15.2:0/3495062310 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef24144250 msgr2=0x7fef2415af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:00.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.363+0000 7fef29400640 1 --2- 172.21.15.2:0/3495062310 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef24144250 0x7fef2415af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:00.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.363+0000 7fef29400640 1 -- 172.21.15.2:0/3495062310 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef2415b440 con 0x7fef24144c90 2024-09-10T08:48:00.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.363+0000 7fef28a00640 1 --2- 172.21.15.2:0/3495062310 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef240cd480 0x7fef241f5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:48:00.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.363+0000 7fef29400640 1 --2- 172.21.15.2:0/3495062310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef24144c90 0x7fef240ae3d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fef1c00c730 tx=0x7fef1c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:00.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.363+0000 7fef20c00640 1 -- 172.21.15.2:0/3495062310 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef1c003b70 con 0x7fef24144c90 2024-09-10T08:48:00.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.364+0000 7fef20c00640 1 -- 172.21.15.2:0/3495062310 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef1c003d10 con 0x7fef24144c90 2024-09-10T08:48:00.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.364+0000 7fef2b400640 1 -- 172.21.15.2:0/3495062310 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef240aef90 con 0x7fef24144c90 2024-09-10T08:48:00.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.364+0000 7fef20c00640 1 -- 172.21.15.2:0/3495062310 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef1c00aa90 con 0x7fef24144c90 2024-09-10T08:48:00.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.364+0000 7fef2b400640 1 -- 172.21.15.2:0/3495062310 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef2415c140 con 0x7fef24144c90 2024-09-10T08:48:00.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.365+0000 7fef2b400640 1 -- 172.21.15.2:0/3495062310 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef240cf8d0 con 0x7fef24144c90 2024-09-10T08:48:00.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.366+0000 7fef20c00640 1 -- 172.21.15.2:0/3495062310 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fef1c00ac30 con 0x7fef24144c90 2024-09-10T08:48:00.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.367+0000 7fef20c00640 1 --2- 172.21.15.2:0/3495062310 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fef0406be60 0x7fef0406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:00.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.367+0000 7fef20c00640 1 -- 172.21.15.2:0/3495062310 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7fef1c08afe0 con 0x7fef24144c90 2024-09-10T08:48:00.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.367+0000 7fef28a00640 1 --2- 172.21.15.2:0/3495062310 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fef0406be60 0x7fef0406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:00.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.368+0000 7fef28a00640 1 --2- 172.21.15.2:0/3495062310 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fef0406be60 0x7fef0406e320 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fef18034000 tx=0x7fef1802e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:00.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.371+0000 7fef20c00640 1 -- 172.21.15.2:0/3495062310 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fef2415b440 con 0x7fef24144c90 2024-09-10T08:48:00.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.590+0000 7fef2b400640 1 -- 172.21.15.2:0/3495062310 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fef2406cf40 con 0x7fef24144c90 2024-09-10T08:48:00.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.591+0000 7fef20c00640 1 -- 172.21.15.2:0/3495062310 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) ==== 53+0+73 (secure 0 0 0) 0x7fef1c059780 con 0x7fef24144c90 2024-09-10T08:48:00.592 INFO:teuthology.orchestra.run.smithi002.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-10T08:48:00.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.593+0000 7fef2b400640 1 -- 172.21.15.2:0/3495062310 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fef0406be60 msgr2=0x7fef0406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:00.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.593+0000 7fef2b400640 1 --2- 172.21.15.2:0/3495062310 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fef0406be60 0x7fef0406e320 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fef18034000 tx=0x7fef1802e000 comp rx=0 tx=0).stop 2024-09-10T08:48:00.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.593+0000 7fef2b400640 1 -- 172.21.15.2:0/3495062310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef24144c90 msgr2=0x7fef240ae3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:00.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.593+0000 7fef2b400640 1 --2- 172.21.15.2:0/3495062310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef24144c90 0x7fef240ae3d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fef1c00c730 tx=0x7fef1c00cbf0 comp rx=0 tx=0).stop 2024-09-10T08:48:00.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.593+0000 7fef2b400640 1 -- 172.21.15.2:0/3495062310 shutdown_connections 2024-09-10T08:48:00.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.593+0000 7fef2b400640 1 --2- 172.21.15.2:0/3495062310 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fef24144c90 0x7fef240ae3d0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:00.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.593+0000 7fef2b400640 1 --2- 172.21.15.2:0/3495062310 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef24144250 0x7fef2415af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:00.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.593+0000 7fef2b400640 1 --2- 172.21.15.2:0/3495062310 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fef0406be60 0x7fef0406e320 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:00.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.593+0000 7fef2b400640 1 --2- 172.21.15.2:0/3495062310 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fef240cd480 0x7fef241f5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:00.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.593+0000 7fef2b400640 1 -- 172.21.15.2:0/3495062310 >> 172.21.15.2:0/3495062310 conn(0x7fef2406bc10 msgr2=0x7fef240b3fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:00.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.593+0000 7fef2b400640 1 -- 172.21.15.2:0/3495062310 shutdown_connections 2024-09-10T08:48:00.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00.593+0000 7fef2b400640 1 -- 172.21.15.2:0/3495062310 wait complete. 2024-09-10T08:48:00.610 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-10T08:48:00.610 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-10T08:48:00.610 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi002.front.sepia.ceph.com 2024-09-10T08:48:00.610 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-10T08:48:00.610 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-10T08:48:00.610 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-10T08:48:00.610 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-10T08:48:00.610 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-10T08:48:00.610 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T08:48:00.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:48:00.611 DEBUG:teuthology.orchestra.run.smithi002:> ip addr 2024-09-10T08:48:00.646 INFO:teuthology.orchestra.run.smithi002.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-10T08:48:00.647 INFO:teuthology.orchestra.run.smithi002.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-10T08:48:00.647 INFO:teuthology.orchestra.run.smithi002.stdout: inet 127.0.0.1/8 scope host lo 2024-09-10T08:48:00.647 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:48:00.647 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 ::1/128 scope host 2024-09-10T08:48:00.647 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:48:00.647 INFO:teuthology.orchestra.run.smithi002.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:48:00.647 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:02 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:48:00.647 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f0 2024-09-10T08:48:00.647 INFO:teuthology.orchestra.run.smithi002.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:48:00.647 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:03 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:48:00.648 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f1 2024-09-10T08:48:00.648 INFO:teuthology.orchestra.run.smithi002.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-10T08:48:00.648 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:20 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:48:00.648 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f0 2024-09-10T08:48:00.648 INFO:teuthology.orchestra.run.smithi002.stdout: inet 172.21.15.2/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-10T08:48:00.648 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft 42626sec preferred_lft 42626sec 2024-09-10T08:48:00.648 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::ec4:7aff:febd:1920/64 scope link 2024-09-10T08:48:00.648 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:48:00.648 INFO:teuthology.orchestra.run.smithi002.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-10T08:48:00.648 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:21 brd ff:ff:ff:ff:ff:ff 2024-09-10T08:48:00.648 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f1 2024-09-10T08:48:00.648 INFO:teuthology.orchestra.run.smithi002.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-10T08:48:00.648 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 4a:fe:68:67:28:1a brd ff:ff:ff:ff:ff:ff 2024-09-10T08:48:00.649 INFO:teuthology.orchestra.run.smithi002.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-10T08:48:00.649 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:48:00.649 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::7ccf:c7ff:fe19:c365/64 scope link 2024-09-10T08:48:00.649 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:48:00.649 INFO:teuthology.orchestra.run.smithi002.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T08:48:00.649 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 4a:fe:68:67:28:1a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T08:48:00.649 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::48fe:68ff:fe67:281a/64 scope link 2024-09-10T08:48:00.649 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:48:00.649 INFO:teuthology.orchestra.run.smithi002.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-10T08:48:00.649 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether d6:1c:63:87:35:21 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T08:48:00.649 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::d41c:63ff:fe87:3521/64 scope link 2024-09-10T08:48:00.649 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2024-09-10T08:48:00.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:48:00.650 DEBUG:teuthology.orchestra.run.smithi002:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-10T08:48:00.740 INFO:teuthology.orchestra.run.smithi002.stdout:1 2024-09-10T08:48:00.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:48:00.743 DEBUG:teuthology.orchestra.run.smithi002:> route 2024-09-10T08:48:00.778 INFO:teuthology.orchestra.run.smithi002.stdout:Kernel IP routing table 2024-09-10T08:48:00.779 INFO:teuthology.orchestra.run.smithi002.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-10T08:48:00.779 INFO:teuthology.orchestra.run.smithi002.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-10T08:48:00.779 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-10T08:48:00.779 INFO:teuthology.orchestra.run.smithi002.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-10T08:48:00.779 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-10T08:48:00.779 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2024-09-10T08:48:00.779 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-10T08:48:00.779 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-10T08:48:00.779 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-10T08:48:00.780 DEBUG:teuthology.orchestra.run.smithi002:> ') 2024-09-10T08:48:00.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-10T08:48:00.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:48:00.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:48:00.977 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2024-09-10T08:48:01.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T08:48:01.012 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T08:48:01.012 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-10T08:48:01.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:48:01.013 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set brx.0 up 2024-09-10T08:48:01.109 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T08:48:01.110 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-10T08:48:01.145 INFO:teuthology.orchestra.run.smithi002.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-10T08:48:01.145 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-10T08:48:01.145 DEBUG:teuthology.orchestra.run.smithi002:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-10T08:48:01.219 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-10T08:48:01.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:48:01.220 DEBUG:teuthology.orchestra.run.smithi002:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,snapdirname=.customsnapkernel,nofallback 2024-09-10T08:48:01.349 INFO:teuthology.orchestra.run.smithi002.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,snapdirname=.customsnapkernel,nofallback 2024-09-10T08:48:01.349 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes,snapdirname=.customsnapkernel". 2024-09-10T08:48:01.377 INFO:teuthology.orchestra.run.smithi002.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,snapdirname=.customsnapkernel,nofallback 2024-09-10T08:48:01.377 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes,snapdirname=.customsnapkernel". 2024-09-10T08:48:01.377 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: resolved to: "172.21.15.2:3300,172.21.15.155:3300,172.21.15.155:3301" 2024-09-10T08:48:01.377 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: trying mount with new device syntax: 0@f20a15a7-d363-4d44-98cb-4f4f466b52b8.cephfs=/ 2024-09-10T08:48:01.377 INFO:teuthology.orchestra.run.smithi002.stdout:mount.ceph: options "norequire_active_mds,norbytes,snapdirname=.customsnapkernel,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.2:3300/172.21.15.155:3300/172.21.15.155:3301" will pass to kernel 2024-09-10T08:48:01.379 INFO:teuthology.orchestra.run.smithi002.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-10T08:48:01.379 INFO:teuthology.orchestra.run.smithi002.stdout: You just mounted a file system that supports labels which does not 2024-09-10T08:48:01.379 INFO:teuthology.orchestra.run.smithi002.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-10T08:48:01.379 INFO:teuthology.orchestra.run.smithi002.stdout: applications will generate AVC messages and not be allowed access to 2024-09-10T08:48:01.379 INFO:teuthology.orchestra.run.smithi002.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-10T08:48:01.382 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-10T08:48:01.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:48:01.382 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-10T08:48:01.439 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-10T08:48:01.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-10T08:48:01.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-10T08:48:01.537 INFO:teuthology.orchestra.run.smithi002.stdout:client4995 2024-09-10T08:48:01.537 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T08:48:01.537 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:48:01.573 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-10T08:48:01.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:01.770+0000 7f6b77400640 1 Processor -- start 2024-09-10T08:48:01.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:01.771+0000 7f6b77400640 1 -- start start 2024-09-10T08:48:01.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:01.772+0000 7f6b77400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6b70161be0 0x7f6b700d4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:01.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:01.772+0000 7f6b77400640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6b700b1220 0x7f6b700b16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:01.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:01.772+0000 7f6b77400640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b700b1bf0 con 0x7f6b700d2140 2024-09-10T08:48:01.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:01.772+0000 7f6b77400640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f6b70161fc0 con 0x7f6b70161be0 2024-09-10T08:48:01.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:01.772+0000 7f6b77400640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f6b700b3940 con 0x7f6b700b1220 2024-09-10T08:48:01.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:01.772+0000 7f6b74a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6b70161be0 0x7f6b700d4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:01.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:01.772+0000 7f6b74a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6b70161be0 0x7f6b700d4ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55736/0 (socket says 172.21.15.2:55736) 2024-09-10T08:48:01.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:01.772+0000 7f6b74a00640 1 -- 172.21.15.2:0/3693936510 learned_addr learned my addr 172.21.15.2:0/3693936510 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:01.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:01.772+0000 7f6b75400640 1 --2- 172.21.15.2:0/3693936510 >> v2:172.21.15.155:3300/0 conn(0x7f6b700b1220 0x7f6b700b16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:01.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:01.772+0000 7f6b74a00640 1 -- 172.21.15.2:0/3693936510 >> v2:172.21.15.155:3300/0 conn(0x7f6b700b1220 msgr2=0x7f6b700b16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:48:01.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:01.772+0000 7f6b74a00640 1 --2- 172.21.15.2:0/3693936510 >> v2:172.21.15.155:3300/0 conn(0x7f6b700b1220 0x7f6b700b16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:01.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:01.772+0000 7f6b74a00640 1 -- 172.21.15.2:0/3693936510 >> v1:172.21.15.155:6789/0 conn(0x7f6b700d2140 legacy=0x7f6b700d0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:01.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:01.772+0000 7f6b74a00640 1 -- 172.21.15.2:0/3693936510 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b700d0770 con 0x7f6b70161be0 2024-09-10T08:48:01.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:01.773+0000 7f6b74a00640 1 --2- 172.21.15.2:0/3693936510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b70161be0 0x7f6b700d4ef0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6b7008d4d0 tx=0x7f6b6402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75bf23ead8a4ac4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:01.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:01.774+0000 7f6b6f400640 1 -- 172.21.15.2:0/3693936510 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b64037070 con 0x7f6b70161be0 2024-09-10T08:48:01.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:01.774+0000 7f6b6f400640 1 -- 172.21.15.2:0/3693936510 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b64032440 con 0x7f6b70161be0 2024-09-10T08:48:01.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:01.774+0000 7f6b6f400640 1 -- 172.21.15.2:0/3693936510 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b64032810 con 0x7f6b70161be0 2024-09-10T08:48:01.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:01.774+0000 7f6b77400640 1 -- 172.21.15.2:0/3693936510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b70161be0 msgr2=0x7f6b700d4ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:01.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:01.774+0000 7f6b77400640 1 --2- 172.21.15.2:0/3693936510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b70161be0 0x7f6b700d4ef0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6b7008d4d0 tx=0x7f6b6402a1e0 comp rx=0 tx=0).stop 2024-09-10T08:48:01.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:01.774+0000 7f6b77400640 1 -- 172.21.15.2:0/3693936510 shutdown_connections 2024-09-10T08:48:01.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:01.774+0000 7f6b77400640 1 --2- 172.21.15.2:0/3693936510 >> v2:172.21.15.155:3300/0 conn(0x7f6b700b1220 0x7f6b700b16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:01.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:01.774+0000 7f6b77400640 1 --2- 172.21.15.2:0/3693936510 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b70161be0 0x7f6b700d4ef0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:01.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:01.774+0000 7f6b77400640 1 -- 172.21.15.2:0/3693936510 >> 172.21.15.2:0/3693936510 conn(0x7f6b7008bfd0 msgr2=0x7f6b700d4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:01.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:01.775+0000 7f6b77400640 1 -- 172.21.15.2:0/3693936510 shutdown_connections 2024-09-10T08:48:01.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:01.775+0000 7f6b77400640 1 -- 172.21.15.2:0/3693936510 wait complete. 2024-09-10T08:48:01.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:01.776+0000 7f6b77400640 1 Processor -- start 2024-09-10T08:48:01.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:01.776+0000 7f6b77400640 1 -- start start 2024-09-10T08:48:01.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:01.777+0000 7f6b77400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6b700b1220 0x7f6b7015e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:01.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:01.777+0000 7f6b77400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6b700d2140 0x7f6b700cb640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:01.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:01.777+0000 7f6b77400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b70161be0 0x7f6b70158ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:01.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:01.777+0000 7f6b77400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6b700cf860 con 0x7f6b70161be0 2024-09-10T08:48:01.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:01.777+0000 7f6b77400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6b700cf580 con 0x7f6b700d2140 2024-09-10T08:48:01.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:01.777+0000 7f6b77400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6b700cfb40 con 0x7f6b700b1220 2024-09-10T08:48:01.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:01.778+0000 7f6b75400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b70161be0 0x7f6b70158ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:01.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:01.778+0000 7f6b75400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b70161be0 0x7f6b70158ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55738/0 (socket says 172.21.15.2:55738) 2024-09-10T08:48:01.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:01.778+0000 7f6b75400640 1 -- 172.21.15.2:0/3472784377 learned_addr learned my addr 172.21.15.2:0/3472784377 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:01.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:01.778+0000 7f6b74a00640 1 --2- 172.21.15.2:0/3472784377 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6b700b1220 0x7f6b7015e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:01.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:01.778+0000 7f6b6fe00640 1 --2- 172.21.15.2:0/3472784377 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6b700d2140 0x7f6b700cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:01.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:01.778+0000 7f6b75400640 1 -- 172.21.15.2:0/3472784377 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6b700b1220 msgr2=0x7f6b7015e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:01.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:01.778+0000 7f6b75400640 1 --2- 172.21.15.2:0/3472784377 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6b700b1220 0x7f6b7015e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:01.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:01.778+0000 7f6b75400640 1 -- 172.21.15.2:0/3472784377 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6b700d2140 msgr2=0x7f6b700cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:01.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:01.778+0000 7f6b75400640 1 --2- 172.21.15.2:0/3472784377 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6b700d2140 0x7f6b700cb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:01.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:01.778+0000 7f6b75400640 1 -- 172.21.15.2:0/3472784377 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b70159020 con 0x7f6b70161be0 2024-09-10T08:48:01.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:01.779+0000 7f6b75400640 1 --2- 172.21.15.2:0/3472784377 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b70161be0 0x7f6b70158ae0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6b68007d90 tx=0x7f6b6800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:01.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:01.779+0000 7f6b6cc00640 1 -- 172.21.15.2:0/3472784377 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b68014420 con 0x7f6b70161be0 2024-09-10T08:48:01.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:01.779+0000 7f6b6cc00640 1 -- 172.21.15.2:0/3472784377 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b68019070 con 0x7f6b70161be0 2024-09-10T08:48:01.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:01.779+0000 7f6b6cc00640 1 -- 172.21.15.2:0/3472784377 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b68014820 con 0x7f6b70161be0 2024-09-10T08:48:01.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:01.779+0000 7f6b77400640 1 -- 172.21.15.2:0/3472784377 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b700cbdb0 con 0x7f6b70161be0 2024-09-10T08:48:01.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:01.779+0000 7f6b77400640 1 -- 172.21.15.2:0/3472784377 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b700cc370 con 0x7f6b70161be0 2024-09-10T08:48:01.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:01.780+0000 7f6b77400640 1 -- 172.21.15.2:0/3472784377 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b700cf230 con 0x7f6b70161be0 2024-09-10T08:48:01.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:01.781+0000 7f6b6cc00640 1 -- 172.21.15.2:0/3472784377 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6b680149c0 con 0x7f6b70161be0 2024-09-10T08:48:01.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:01.782+0000 7f6b6cc00640 1 --2- 172.21.15.2:0/3472784377 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f6b5006be30 0x7f6b5006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:01.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:01.782+0000 7f6b6cc00640 1 -- 172.21.15.2:0/3472784377 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f6b6808b6b0 con 0x7f6b70161be0 2024-09-10T08:48:01.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:01.783+0000 7f6b74a00640 1 --2- 172.21.15.2:0/3472784377 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f6b5006be30 0x7f6b5006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:01.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:01.783+0000 7f6b74a00640 1 --2- 172.21.15.2:0/3472784377 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f6b5006be30 0x7f6b5006e2f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6b64034000 tx=0x7f6b6402e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:01.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:01.791+0000 7f6b6cc00640 1 -- 172.21.15.2:0/3472784377 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6b68059870 con 0x7f6b70161be0 2024-09-10T08:48:02.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:01.999+0000 7f6b77400640 1 -- 172.21.15.2:0/3472784377 --> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f6b700d1bb0 con 0x7f6b5006be30 2024-09-10T08:48:02.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:02.001+0000 7f6b6cc00640 1 -- 172.21.15.2:0/3472784377 <== mgr.4099 v2:172.21.15.155:6832/2611418382 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f6b700d1bb0 con 0x7f6b5006be30 2024-09-10T08:48:02.003 INFO:teuthology.orchestra.run.smithi002.stdout:[ 2024-09-10T08:48:02.003 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-10T08:48:02.003 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "cephfs" 2024-09-10T08:48:02.003 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-10T08:48:02.003 INFO:teuthology.orchestra.run.smithi002.stdout:] 2024-09-10T08:48:02.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:02.003+0000 7f6b77400640 1 -- 172.21.15.2:0/3472784377 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f6b5006be30 msgr2=0x7f6b5006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:02.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:02.003+0000 7f6b77400640 1 --2- 172.21.15.2:0/3472784377 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f6b5006be30 0x7f6b5006e2f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6b64034000 tx=0x7f6b6402e000 comp rx=0 tx=0).stop 2024-09-10T08:48:02.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:02.004+0000 7f6b77400640 1 -- 172.21.15.2:0/3472784377 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b70161be0 msgr2=0x7f6b70158ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:02.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:02.004+0000 7f6b77400640 1 --2- 172.21.15.2:0/3472784377 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b70161be0 0x7f6b70158ae0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6b68007d90 tx=0x7f6b6800e4b0 comp rx=0 tx=0).stop 2024-09-10T08:48:02.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:02.004+0000 7f6b77400640 1 -- 172.21.15.2:0/3472784377 shutdown_connections 2024-09-10T08:48:02.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:02.004+0000 7f6b77400640 1 --2- 172.21.15.2:0/3472784377 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b70161be0 0x7f6b70158ae0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:02.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:02.004+0000 7f6b77400640 1 --2- 172.21.15.2:0/3472784377 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6b700d2140 0x7f6b700cb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:02.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:02.004+0000 7f6b77400640 1 --2- 172.21.15.2:0/3472784377 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f6b5006be30 0x7f6b5006e2f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:02.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:02.004+0000 7f6b77400640 1 --2- 172.21.15.2:0/3472784377 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6b700b1220 0x7f6b7015e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:02.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:02.004+0000 7f6b77400640 1 -- 172.21.15.2:0/3472784377 >> 172.21.15.2:0/3472784377 conn(0x7f6b7008bfd0 msgr2=0x7f6b700b73c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:02.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:02.004+0000 7f6b77400640 1 -- 172.21.15.2:0/3472784377 shutdown_connections 2024-09-10T08:48:02.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:02.004+0000 7f6b77400640 1 -- 172.21.15.2:0/3472784377 wait complete. 2024-09-10T08:48:02.021 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2024-09-10T08:48:02.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:02.187+0000 7f6a5d600640 1 Processor -- start 2024-09-10T08:48:02.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:02.187+0000 7f6a5d600640 1 -- start start 2024-09-10T08:48:02.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:02.188+0000 7f6a5d600640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6a58161d90 0x7f6a580d4f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:02.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:02.188+0000 7f6a5d600640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a580d1a30 con 0x7f6a580d1290 2024-09-10T08:48:02.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:02.189+0000 7f6a5d600640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a580d1750 con 0x7f6a5806e260 2024-09-10T08:48:02.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:02.189+0000 7f6a5d600640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f6a580b3820 con 0x7f6a58161d90 2024-09-10T08:48:02.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:02.189+0000 7f6a57e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6a58161d90 0x7f6a580d4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:02.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:02.189+0000 7f6a5cc00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f6a580d1290 0x7f6a580cedb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41016/0 (socket says 172.21.15.2:41016) 2024-09-10T08:48:02.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:02.189+0000 7f6a5cc00640 1 -- 172.21.15.2:0/1430251776 learned_addr learned my addr 172.21.15.2:0/1430251776 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:48:02.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:02.189+0000 7f6a57e00640 1 -- 172.21.15.2:0/1430251776 >> v1:172.21.15.155:6789/0 conn(0x7f6a5806e260 legacy=0x7f6a580d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:02.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:02.189+0000 7f6a57e00640 1 -- 172.21.15.2:0/1430251776 >> v1:172.21.15.2:6789/0 conn(0x7f6a580d1290 legacy=0x7f6a580cedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:02.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:02.189+0000 7f6a57400640 1 -- 172.21.15.2:0/1430251776 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3740828806 0 0) 0x7f6a580d1a30 con 0x7f6a580d1290 2024-09-10T08:48:02.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:02.189+0000 7f6a57e00640 1 -- 172.21.15.2:0/1430251776 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a580b3b00 con 0x7f6a58161d90 2024-09-10T08:48:02.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:02.190+0000 7f6a57e00640 1 --2- 172.21.15.2:0/1430251776 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a58161d90 0x7f6a580d4f60 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6a480097a0 tx=0x7f6a4802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=602da49aa86e4f0f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:02.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:02.191+0000 7f6a57400640 1 -- 172.21.15.2:0/1430251776 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a48037070 con 0x7f6a58161d90 2024-09-10T08:48:02.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:02.191+0000 7f6a57400640 1 -- 172.21.15.2:0/1430251776 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a48032440 con 0x7f6a58161d90 2024-09-10T08:48:02.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:02.191+0000 7f6a57400640 1 -- 172.21.15.2:0/1430251776 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a48032810 con 0x7f6a58161d90 2024-09-10T08:48:02.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:02.191+0000 7f6a5d600640 1 -- 172.21.15.2:0/1430251776 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a58161d90 msgr2=0x7f6a580d4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:02.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:02.191+0000 7f6a5d600640 1 --2- 172.21.15.2:0/1430251776 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a58161d90 0x7f6a580d4f60 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6a480097a0 tx=0x7f6a4802a230 comp rx=0 tx=0).stop 2024-09-10T08:48:02.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:02.191+0000 7f6a5d600640 1 -- 172.21.15.2:0/1430251776 shutdown_connections 2024-09-10T08:48:02.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:02.191+0000 7f6a5d600640 1 --2- 172.21.15.2:0/1430251776 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a58161d90 0x7f6a580d4f60 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:02.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:02.191+0000 7f6a5d600640 1 -- 172.21.15.2:0/1430251776 >> 172.21.15.2:0/1430251776 conn(0x7f6a5809d700 msgr2=0x7f6a580d4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:02.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:02.192+0000 7f6a5d600640 1 -- 172.21.15.2:0/1430251776 shutdown_connections 2024-09-10T08:48:02.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:02.192+0000 7f6a5d600640 1 -- 172.21.15.2:0/1430251776 wait complete. 2024-09-10T08:48:02.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:02.193+0000 7f6a5d600640 1 Processor -- start 2024-09-10T08:48:02.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:02.193+0000 7f6a5d600640 1 -- start start 2024-09-10T08:48:02.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:02.194+0000 7f6a5d600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a580d1290 0x7f6a58151b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:02.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:02.194+0000 7f6a5d600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a58161d90 0x7f6a580cd390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:02.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:02.194+0000 7f6a5d600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a580cc4a0 0x7f6a580c7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:02.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:02.194+0000 7f6a5d600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6a580b33b0 con 0x7f6a580d1290 2024-09-10T08:48:02.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:02.194+0000 7f6a5d600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6a580b3230 con 0x7f6a58161d90 2024-09-10T08:48:02.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:02.194+0000 7f6a5d600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6a580b3530 con 0x7f6a580cc4a0 2024-09-10T08:48:02.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:02.194+0000 7f6a57e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a580d1290 0x7f6a58151b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:02.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:02.194+0000 7f6a57e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a580d1290 0x7f6a58151b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55770/0 (socket says 172.21.15.2:55770) 2024-09-10T08:48:02.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:02.194+0000 7f6a57e00640 1 -- 172.21.15.2:0/3774594491 learned_addr learned my addr 172.21.15.2:0/3774594491 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:02.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:02.195+0000 7f6a5cc00640 1 --2- 172.21.15.2:0/3774594491 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a580cc4a0 0x7f6a580c7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:02.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:02.195+0000 7f6a4fe00640 1 --2- 172.21.15.2:0/3774594491 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a58161d90 0x7f6a580cd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:02.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:02.195+0000 7f6a57e00640 1 -- 172.21.15.2:0/3774594491 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a580cc4a0 msgr2=0x7f6a580c7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:02.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:02.195+0000 7f6a57e00640 1 --2- 172.21.15.2:0/3774594491 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a580cc4a0 0x7f6a580c7eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:02.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:02.195+0000 7f6a57e00640 1 -- 172.21.15.2:0/3774594491 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a58161d90 msgr2=0x7f6a580cd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:02.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:02.195+0000 7f6a57e00640 1 --2- 172.21.15.2:0/3774594491 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a58161d90 0x7f6a580cd390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:02.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:02.195+0000 7f6a57e00640 1 -- 172.21.15.2:0/3774594491 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a580cdc10 con 0x7f6a580d1290 2024-09-10T08:48:02.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:02.195+0000 7f6a57e00640 1 --2- 172.21.15.2:0/3774594491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a580d1290 0x7f6a58151b90 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6a480097a0 tx=0x7f6a480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:02.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:02.196+0000 7f6a54c00640 1 -- 172.21.15.2:0/3774594491 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a48037040 con 0x7f6a580d1290 2024-09-10T08:48:02.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:02.196+0000 7f6a54c00640 1 -- 172.21.15.2:0/3774594491 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a48004250 con 0x7f6a580d1290 2024-09-10T08:48:02.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:02.196+0000 7f6a54c00640 1 -- 172.21.15.2:0/3774594491 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a48032e40 con 0x7f6a580d1290 2024-09-10T08:48:02.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:02.196+0000 7f6a5d600640 1 -- 172.21.15.2:0/3774594491 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a580b4840 con 0x7f6a580d1290 2024-09-10T08:48:02.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:02.196+0000 7f6a5d600640 1 -- 172.21.15.2:0/3774594491 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a580b4e00 con 0x7f6a580d1290 2024-09-10T08:48:02.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:02.197+0000 7f6a5d600640 1 -- 172.21.15.2:0/3774594491 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a580b1d10 con 0x7f6a580d1290 2024-09-10T08:48:02.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:02.198+0000 7f6a54c00640 1 -- 172.21.15.2:0/3774594491 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6a480306f0 con 0x7f6a580d1290 2024-09-10T08:48:02.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:02.199+0000 7f6a54c00640 1 --2- 172.21.15.2:0/3774594491 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f6a3406be30 0x7f6a3406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:02.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:02.199+0000 7f6a54c00640 1 -- 172.21.15.2:0/3774594491 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f6a480ac110 con 0x7f6a580d1290 2024-09-10T08:48:02.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:02.199+0000 7f6a4fe00640 1 --2- 172.21.15.2:0/3774594491 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f6a3406be30 0x7f6a3406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:02.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:02.200+0000 7f6a4fe00640 1 --2- 172.21.15.2:0/3774594491 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f6a3406be30 0x7f6a3406e2f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6a58160d40 tx=0x7f6a40009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:02.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:02.203+0000 7f6a54c00640 1 -- 172.21.15.2:0/3774594491 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6a4807a490 con 0x7f6a580d1290 2024-09-10T08:48:02.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:02.438+0000 7f6a5d600640 1 -- 172.21.15.2:0/3774594491 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) -- 0x7f6a580b45f0 con 0x7f6a580d1290 2024-09-10T08:48:03.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.153+0000 7f6a54c00640 1 -- 172.21.15.2:0/3774594491 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v6) ==== 92+0+0 (secure 0 0 0) 0x7f6a4807e790 con 0x7f6a580d1290 2024-09-10T08:48:03.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.156+0000 7f6a5d600640 1 -- 172.21.15.2:0/3774594491 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f6a3406be30 msgr2=0x7f6a3406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:03.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.156+0000 7f6a5d600640 1 --2- 172.21.15.2:0/3774594491 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f6a3406be30 0x7f6a3406e2f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6a58160d40 tx=0x7f6a40009040 comp rx=0 tx=0).stop 2024-09-10T08:48:03.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.156+0000 7f6a5d600640 1 -- 172.21.15.2:0/3774594491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a580d1290 msgr2=0x7f6a58151b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:03.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.157+0000 7f6a54c00640 1 -- 172.21.15.2:0/3774594491 <== mon.0 v2:172.21.15.2:3300/0 8 ==== mgrmap(e 6) ==== 90515+0+0 (secure 0 0 0) 0x7f6a48076b00 con 0x7f6a580d1290 2024-09-10T08:48:03.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.157+0000 7f6a5d600640 1 --2- 172.21.15.2:0/3774594491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a580d1290 0x7f6a58151b90 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6a480097a0 tx=0x7f6a480046c0 comp rx=0 tx=0).stop 2024-09-10T08:48:03.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.157+0000 7f6a5d600640 1 -- 172.21.15.2:0/3774594491 shutdown_connections 2024-09-10T08:48:03.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.157+0000 7f6a5d600640 1 --2- 172.21.15.2:0/3774594491 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f6a3406be30 0x7f6a3406e2f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:03.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.157+0000 7f6a5d600640 1 --2- 172.21.15.2:0/3774594491 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6a580cc4a0 0x7f6a580c7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:03.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.157+0000 7f6a5d600640 1 --2- 172.21.15.2:0/3774594491 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a58161d90 0x7f6a580cd390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:03.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.157+0000 7f6a5d600640 1 --2- 172.21.15.2:0/3774594491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6a580d1290 0x7f6a58151b90 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:03.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.157+0000 7f6a5d600640 1 -- 172.21.15.2:0/3774594491 >> 172.21.15.2:0/3774594491 conn(0x7f6a5809d700 msgr2=0x7f6a580b23d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:03.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.158+0000 7f6a5d600640 1 -- 172.21.15.2:0/3774594491 shutdown_connections 2024-09-10T08:48:03.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.158+0000 7f6a5d600640 1 -- 172.21.15.2:0/3774594491 wait complete. 2024-09-10T08:48:03.174 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2024-09-10T08:48:03.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.337+0000 7fc875800640 1 Processor -- start 2024-09-10T08:48:03.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.337+0000 7fc875800640 1 -- start start 2024-09-10T08:48:03.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.338+0000 7fc875800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc870161ca0 0x7fc8700d2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:03.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.338+0000 7fc875800640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc8700cf8c0 0x7fc87006d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:03.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.338+0000 7fc875800640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8700cfe50 con 0x7fc8700d2b60 2024-09-10T08:48:03.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.338+0000 7fc875800640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fc8700d34a0 con 0x7fc8700cf8c0 2024-09-10T08:48:03.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.338+0000 7fc875800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc87006cdf0 con 0x7fc870161ca0 2024-09-10T08:48:03.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.339+0000 7fc86e000640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fc8700d2b60 0x7fc8700cf1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41020/0 (socket says 172.21.15.2:41020) 2024-09-10T08:48:03.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.339+0000 7fc86e000640 1 -- 172.21.15.2:0/4214608606 learned_addr learned my addr 172.21.15.2:0/4214608606 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:48:03.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.339+0000 7fc86ea00640 1 --2- 172.21.15.2:0/4214608606 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc870161ca0 0x7fc8700d2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:03.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.339+0000 7fc86f400640 1 --2- 172.21.15.2:0/4214608606 >> v2:172.21.15.155:3300/0 conn(0x7fc8700cf8c0 0x7fc87006d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:03.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.339+0000 7fc86ea00640 1 -- 172.21.15.2:0/4214608606 >> v2:172.21.15.155:3300/0 conn(0x7fc8700cf8c0 msgr2=0x7fc87006d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:48:03.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.339+0000 7fc86ea00640 1 --2- 172.21.15.2:0/4214608606 >> v2:172.21.15.155:3300/0 conn(0x7fc8700cf8c0 0x7fc87006d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:03.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.339+0000 7fc86ea00640 1 -- 172.21.15.2:0/4214608606 >> v1:172.21.15.2:6789/0 conn(0x7fc8700d2b60 legacy=0x7fc8700cf1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:03.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.339+0000 7fc86ea00640 1 -- 172.21.15.2:0/4214608606 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8700d0130 con 0x7fc870161ca0 2024-09-10T08:48:03.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.339+0000 7fc86d600640 1 -- 172.21.15.2:0/4214608606 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3904814825 0 0) 0x7fc8700cfe50 con 0x7fc8700d2b60 2024-09-10T08:48:03.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.340+0000 7fc86ea00640 1 --2- 172.21.15.2:0/4214608606 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc870161ca0 0x7fc8700d2620 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc8600097a0 tx=0x7fc86002a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab49ed4bd7cf38dc server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:03.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.341+0000 7fc86d600640 1 -- 172.21.15.2:0/4214608606 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc860037070 con 0x7fc870161ca0 2024-09-10T08:48:03.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.341+0000 7fc86d600640 1 -- 172.21.15.2:0/4214608606 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc86002ae50 con 0x7fc870161ca0 2024-09-10T08:48:03.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.341+0000 7fc86d600640 1 -- 172.21.15.2:0/4214608606 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc860032660 con 0x7fc870161ca0 2024-09-10T08:48:03.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.341+0000 7fc875800640 1 -- 172.21.15.2:0/4214608606 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc870161ca0 msgr2=0x7fc8700d2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:03.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.341+0000 7fc875800640 1 --2- 172.21.15.2:0/4214608606 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc870161ca0 0x7fc8700d2620 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc8600097a0 tx=0x7fc86002a100 comp rx=0 tx=0).stop 2024-09-10T08:48:03.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.341+0000 7fc875800640 1 -- 172.21.15.2:0/4214608606 shutdown_connections 2024-09-10T08:48:03.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.341+0000 7fc875800640 1 --2- 172.21.15.2:0/4214608606 >> v2:172.21.15.155:3300/0 conn(0x7fc8700cf8c0 0x7fc87006d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:03.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.341+0000 7fc875800640 1 --2- 172.21.15.2:0/4214608606 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc870161ca0 0x7fc8700d2620 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:03.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.341+0000 7fc875800640 1 -- 172.21.15.2:0/4214608606 >> 172.21.15.2:0/4214608606 conn(0x7fc87008bfd0 msgr2=0x7fc8700d45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:03.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.341+0000 7fc875800640 1 -- 172.21.15.2:0/4214608606 shutdown_connections 2024-09-10T08:48:03.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.341+0000 7fc875800640 1 -- 172.21.15.2:0/4214608606 wait complete. 2024-09-10T08:48:03.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.343+0000 7fc875800640 1 Processor -- start 2024-09-10T08:48:03.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.343+0000 7fc875800640 1 -- start start 2024-09-10T08:48:03.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.344+0000 7fc875800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc8700cf8c0 0x7fc87015bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:03.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.344+0000 7fc875800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8700d2b60 0x7fc87015c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:03.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.344+0000 7fc875800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc870161ca0 0x7fc8700c8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:03.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.344+0000 7fc875800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc87006d040 con 0x7fc8700d2b60 2024-09-10T08:48:03.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.344+0000 7fc875800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc8700d2fa0 con 0x7fc870161ca0 2024-09-10T08:48:03.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.344+0000 7fc875800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc87006daa0 con 0x7fc8700cf8c0 2024-09-10T08:48:03.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.344+0000 7fc86e000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8700d2b60 0x7fc87015c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:03.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.344+0000 7fc86ea00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc8700cf8c0 0x7fc87015bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:03.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.344+0000 7fc86ea00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc8700cf8c0 0x7fc87015bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.2:40580/0 (socket says 172.21.15.2:40580) 2024-09-10T08:48:03.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.344+0000 7fc86e000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8700d2b60 0x7fc87015c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55790/0 (socket says 172.21.15.2:55790) 2024-09-10T08:48:03.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.344+0000 7fc86ea00640 1 -- 172.21.15.2:0/2949252250 learned_addr learned my addr 172.21.15.2:0/2949252250 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:03.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.344+0000 7fc86f400640 1 --2- 172.21.15.2:0/2949252250 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc870161ca0 0x7fc8700c8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:03.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.345+0000 7fc86ea00640 1 -- 172.21.15.2:0/2949252250 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc870161ca0 msgr2=0x7fc8700c8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:03.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.345+0000 7fc86ea00640 1 --2- 172.21.15.2:0/2949252250 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc870161ca0 0x7fc8700c8a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:03.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.345+0000 7fc86ea00640 1 -- 172.21.15.2:0/2949252250 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8700d2b60 msgr2=0x7fc87015c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:03.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.345+0000 7fc86ea00640 1 --2- 172.21.15.2:0/2949252250 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8700d2b60 0x7fc87015c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:03.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.345+0000 7fc86ea00640 1 -- 172.21.15.2:0/2949252250 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8700cba10 con 0x7fc8700cf8c0 2024-09-10T08:48:03.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.345+0000 7fc86ea00640 1 --2- 172.21.15.2:0/2949252250 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc8700cf8c0 0x7fc87015bdd0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc8600098c0 tx=0x7fc8600046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:03.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.345+0000 7fc866a00640 1 -- 172.21.15.2:0/2949252250 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc860042070 con 0x7fc8700cf8c0 2024-09-10T08:48:03.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.346+0000 7fc866a00640 1 -- 172.21.15.2:0/2949252250 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc86003d440 con 0x7fc8700cf8c0 2024-09-10T08:48:03.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.346+0000 7fc866a00640 1 -- 172.21.15.2:0/2949252250 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc860037040 con 0x7fc8700cf8c0 2024-09-10T08:48:03.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.346+0000 7fc875800640 1 -- 172.21.15.2:0/2949252250 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8700cbcf0 con 0x7fc8700cf8c0 2024-09-10T08:48:03.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.346+0000 7fc875800640 1 -- 172.21.15.2:0/2949252250 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8700cc2b0 con 0x7fc8700cf8c0 2024-09-10T08:48:03.349 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:48:03.346+0000 7f1ed212b040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-10T08:48:03.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.347+0000 7fc875800640 1 -- 172.21.15.2:0/2949252250 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc87006d560 con 0x7fc8700cf8c0 2024-09-10T08:48:03.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.348+0000 7fc866a00640 1 -- 172.21.15.2:0/2949252250 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 6) ==== 90515+0+0 (secure 0 0 0) 0x7fc860045070 con 0x7fc8700cf8c0 2024-09-10T08:48:03.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.348+0000 7fc866a00640 1 --2- 172.21.15.2:0/2949252250 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fc85006be80 0x7fc85006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:03.350 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:48:03.347+0000 7fa00c120040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-10T08:48:03.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.349+0000 7fc866a00640 1 -- 172.21.15.2:0/2949252250 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7fc8600ab7f0 con 0x7fc8700cf8c0 2024-09-10T08:48:03.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.349+0000 7fc86e000640 1 -- 172.21.15.2:0/2949252250 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fc85006be80 msgr2=0x7fc85006e340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.155:6832/2611418382 2024-09-10T08:48:03.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.349+0000 7fc86e000640 1 --2- 172.21.15.2:0/2949252250 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fc85006be80 0x7fc85006e340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:48:03.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.353+0000 7fc866a00640 1 -- 172.21.15.2:0/2949252250 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc860079a40 con 0x7fc8700cf8c0 2024-09-10T08:48:03.397 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:48:03.396+0000 7fa00c120040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-10T08:48:03.400 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:48:03.399+0000 7f1ed212b040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-10T08:48:03.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.539+0000 7fc875800640 1 -- 172.21.15.2:0/2949252250 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7fc8700d0ce0 con 0x7fc8700cf8c0 2024-09-10T08:48:03.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.545+0000 7fc866a00640 1 -- 172.21.15.2:0/2949252250 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v11)=0 v11) ==== 138+0+0 (secure 0 0 0) 0x7fc86007dd40 con 0x7fc8700cf8c0 2024-09-10T08:48:03.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.547+0000 7fc875800640 1 -- 172.21.15.2:0/2949252250 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fc85006be80 msgr2=0x7fc85006e340 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:48:03.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.547+0000 7fc875800640 1 --2- 172.21.15.2:0/2949252250 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fc85006be80 0x7fc85006e340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:03.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.547+0000 7fc875800640 1 -- 172.21.15.2:0/2949252250 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc8700cf8c0 msgr2=0x7fc87015bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:03.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.547+0000 7fc875800640 1 --2- 172.21.15.2:0/2949252250 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc8700cf8c0 0x7fc87015bdd0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc8600098c0 tx=0x7fc8600046c0 comp rx=0 tx=0).stop 2024-09-10T08:48:03.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.547+0000 7fc875800640 1 -- 172.21.15.2:0/2949252250 shutdown_connections 2024-09-10T08:48:03.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.547+0000 7fc875800640 1 --2- 172.21.15.2:0/2949252250 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc870161ca0 0x7fc8700c8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:03.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.547+0000 7fc875800640 1 --2- 172.21.15.2:0/2949252250 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8700d2b60 0x7fc87015c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:03.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.547+0000 7fc875800640 1 --2- 172.21.15.2:0/2949252250 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fc85006be80 0x7fc85006e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:03.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.547+0000 7fc875800640 1 --2- 172.21.15.2:0/2949252250 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc8700cf8c0 0x7fc87015bdd0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:03.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.547+0000 7fc875800640 1 -- 172.21.15.2:0/2949252250 >> 172.21.15.2:0/2949252250 conn(0x7fc87008bfd0 msgr2=0x7fc8700b1450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:03.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.547+0000 7fc875800640 1 -- 172.21.15.2:0/2949252250 shutdown_connections 2024-09-10T08:48:03.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.547+0000 7fc875800640 1 -- 172.21.15.2:0/2949252250 wait complete. 2024-09-10T08:48:03.557 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:48:03.556+0000 7fa00c120040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-10T08:48:03.564 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2024-09-10T08:48:03.570 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:48:03.569+0000 7f1ed212b040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-10T08:48:03.613 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:48:03.612+0000 7fa00c120040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-10T08:48:03.631 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:48:03.630+0000 7f1ed212b040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-10T08:48:03.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.724+0000 7f3e4e400640 1 Processor -- start 2024-09-10T08:48:03.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.725+0000 7f3e4e400640 1 -- start start 2024-09-10T08:48:03.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.726+0000 7f3e4e400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3e48161ca0 0x7f3e480d2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:03.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.726+0000 7f3e4e400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e480d2b60 0x7f3e480cf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:03.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.726+0000 7f3e4e400640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3e480cf6f0 0x7f3e480d0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:03.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.726+0000 7f3e4e400640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f3e480d34a0 con 0x7f3e48161ca0 2024-09-10T08:48:03.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.726+0000 7f3e4e400640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f3e4806cdf0 con 0x7f3e480cf6f0 2024-09-10T08:48:03.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.726+0000 7f3e4e400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3e480d2fa0 con 0x7f3e480d2b60 2024-09-10T08:48:03.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.726+0000 7f3e47400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3e48161ca0 0x7f3e480d2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:03.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.726+0000 7f3e47400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3e48161ca0 0x7f3e480d2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55792/0 (socket says 172.21.15.2:55792) 2024-09-10T08:48:03.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.726+0000 7f3e47400640 1 -- 172.21.15.2:0/1533920650 learned_addr learned my addr 172.21.15.2:0/1533920650 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:03.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.726+0000 7f3e47e00640 1 --2- 172.21.15.2:0/1533920650 >> v2:172.21.15.155:3300/0 conn(0x7f3e480cf6f0 0x7f3e480d0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:03.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.726+0000 7f3e46a00640 1 --2- 172.21.15.2:0/1533920650 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e480d2b60 0x7f3e480cf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:03.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.727+0000 7f3e47400640 1 -- 172.21.15.2:0/1533920650 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e480d2b60 msgr2=0x7f3e480cf1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:48:03.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.727+0000 7f3e47400640 1 --2- 172.21.15.2:0/1533920650 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e480d2b60 0x7f3e480cf1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:03.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.727+0000 7f3e47400640 1 -- 172.21.15.2:0/1533920650 >> v2:172.21.15.155:3300/0 conn(0x7f3e480cf6f0 msgr2=0x7f3e480d0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:48:03.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.727+0000 7f3e47400640 1 --2- 172.21.15.2:0/1533920650 >> v2:172.21.15.155:3300/0 conn(0x7f3e480cf6f0 0x7f3e480d0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:03.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.727+0000 7f3e47400640 1 -- 172.21.15.2:0/1533920650 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e480cfb80 con 0x7f3e48161ca0 2024-09-10T08:48:03.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.728+0000 7f3e47400640 1 --2- 172.21.15.2:0/1533920650 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e48161ca0 0x7f3e480d2620 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3e480ceb80 tx=0x7f3e3802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9a903a627bd13db server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:03.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.728+0000 7f3e46000640 1 -- 172.21.15.2:0/1533920650 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e38037070 con 0x7f3e48161ca0 2024-09-10T08:48:03.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.728+0000 7f3e46000640 1 -- 172.21.15.2:0/1533920650 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e38032440 con 0x7f3e48161ca0 2024-09-10T08:48:03.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.728+0000 7f3e46000640 1 -- 172.21.15.2:0/1533920650 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e38032810 con 0x7f3e48161ca0 2024-09-10T08:48:03.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.729+0000 7f3e4e400640 1 -- 172.21.15.2:0/1533920650 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e48161ca0 msgr2=0x7f3e480d2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:03.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.729+0000 7f3e4e400640 1 --2- 172.21.15.2:0/1533920650 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e48161ca0 0x7f3e480d2620 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3e480ceb80 tx=0x7f3e3802a140 comp rx=0 tx=0).stop 2024-09-10T08:48:03.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.729+0000 7f3e4e400640 1 -- 172.21.15.2:0/1533920650 shutdown_connections 2024-09-10T08:48:03.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.729+0000 7f3e4e400640 1 --2- 172.21.15.2:0/1533920650 >> v2:172.21.15.155:3300/0 conn(0x7f3e480cf6f0 0x7f3e480d0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:03.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.729+0000 7f3e4e400640 1 --2- 172.21.15.2:0/1533920650 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e480d2b60 0x7f3e480cf1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:03.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.729+0000 7f3e4e400640 1 --2- 172.21.15.2:0/1533920650 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e48161ca0 0x7f3e480d2620 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:03.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.729+0000 7f3e4e400640 1 -- 172.21.15.2:0/1533920650 >> 172.21.15.2:0/1533920650 conn(0x7f3e4808bfd0 msgr2=0x7f3e480d45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:03.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.729+0000 7f3e4e400640 1 -- 172.21.15.2:0/1533920650 shutdown_connections 2024-09-10T08:48:03.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.729+0000 7f3e4e400640 1 -- 172.21.15.2:0/1533920650 wait complete. 2024-09-10T08:48:03.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.731+0000 7f3e4e400640 1 Processor -- start 2024-09-10T08:48:03.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.731+0000 7f3e4e400640 1 -- start start 2024-09-10T08:48:03.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.732+0000 7f3e4e400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e480cf6f0 0x7f3e4814e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:03.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.732+0000 7f3e4e400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e480d2b60 0x7f3e480cb670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:03.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.732+0000 7f3e4e400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e48161ca0 0x7f3e480cbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:03.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.732+0000 7f3e4e400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3e480d0410 con 0x7f3e48161ca0 2024-09-10T08:48:03.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.732+0000 7f3e4e400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3e480d0130 con 0x7f3e480d2b60 2024-09-10T08:48:03.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.732+0000 7f3e4e400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3e4806d040 con 0x7f3e480cf6f0 2024-09-10T08:48:03.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.732+0000 7f3e47e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e48161ca0 0x7f3e480cbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:03.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.732+0000 7f3e47400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e480cf6f0 0x7f3e4814e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:03.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.732+0000 7f3e47400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e480cf6f0 0x7f3e4814e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.2:40596/0 (socket says 172.21.15.2:40596) 2024-09-10T08:48:03.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.732+0000 7f3e47400640 1 -- 172.21.15.2:0/3646532102 learned_addr learned my addr 172.21.15.2:0/3646532102 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:03.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.732+0000 7f3e46a00640 1 --2- 172.21.15.2:0/3646532102 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e480d2b60 0x7f3e480cb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:03.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.732+0000 7f3e47e00640 1 -- 172.21.15.2:0/3646532102 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e480cf6f0 msgr2=0x7f3e4814e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:03.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.732+0000 7f3e47e00640 1 --2- 172.21.15.2:0/3646532102 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e480cf6f0 0x7f3e4814e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:03.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.732+0000 7f3e47e00640 1 -- 172.21.15.2:0/3646532102 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e480d2b60 msgr2=0x7f3e480cb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:03.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.732+0000 7f3e47e00640 1 --2- 172.21.15.2:0/3646532102 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e480d2b60 0x7f3e480cb670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:03.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.733+0000 7f3e47e00640 1 -- 172.21.15.2:0/3646532102 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e480b9190 con 0x7f3e48161ca0 2024-09-10T08:48:03.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.733+0000 7f3e46a00640 1 --2- 172.21.15.2:0/3646532102 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e480d2b60 0x7f3e480cb670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:48:03.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.733+0000 7f3e47e00640 1 --2- 172.21.15.2:0/3646532102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e48161ca0 0x7f3e480cbbb0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f3e4000ef00 tx=0x7f3e4000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:03.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.733+0000 7f3e3f400640 1 -- 172.21.15.2:0/3646532102 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e40018020 con 0x7f3e48161ca0 2024-09-10T08:48:03.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.733+0000 7f3e3f400640 1 -- 172.21.15.2:0/3646532102 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e40014400 con 0x7f3e48161ca0 2024-09-10T08:48:03.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.733+0000 7f3e4e400640 1 -- 172.21.15.2:0/3646532102 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e480b9470 con 0x7f3e48161ca0 2024-09-10T08:48:03.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.733+0000 7f3e3f400640 1 -- 172.21.15.2:0/3646532102 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e40009e60 con 0x7f3e48161ca0 2024-09-10T08:48:03.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.733+0000 7f3e4e400640 1 -- 172.21.15.2:0/3646532102 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e480b9a30 con 0x7f3e48161ca0 2024-09-10T08:48:03.737 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:48:03.735+0000 7fa00c120040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-10T08:48:03.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.735+0000 7f3e4e400640 1 -- 172.21.15.2:0/3646532102 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e480cf1b0 con 0x7f3e48161ca0 2024-09-10T08:48:03.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.735+0000 7f3e3f400640 1 -- 172.21.15.2:0/3646532102 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 6) ==== 90515+0+0 (secure 0 0 0) 0x7f3e40005d10 con 0x7f3e48161ca0 2024-09-10T08:48:03.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.736+0000 7f3e3f400640 1 --2- 172.21.15.2:0/3646532102 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f3e2806be80 0x7f3e2806e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:03.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.736+0000 7f3e3f400640 1 -- 172.21.15.2:0/3646532102 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f3e4008b9e0 con 0x7f3e48161ca0 2024-09-10T08:48:03.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.736+0000 7f3e47400640 1 -- 172.21.15.2:0/3646532102 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f3e2806be80 msgr2=0x7f3e2806e340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.155:6832/2611418382 2024-09-10T08:48:03.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.736+0000 7f3e47400640 1 --2- 172.21.15.2:0/3646532102 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f3e2806be80 0x7f3e2806e340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:48:03.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.741+0000 7f3e3f400640 1 -- 172.21.15.2:0/3646532102 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3e40022030 con 0x7f3e48161ca0 2024-09-10T08:48:03.765 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:48:03.764+0000 7f1ed212b040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-10T08:48:03.846 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:48:03.845+0000 7fa00c120040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-10T08:48:03.882 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:48:03.881+0000 7f1ed212b040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-10T08:48:03.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.926+0000 7f3e4e400640 1 -- 172.21.15.2:0/3646532102 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7f3e480b1170 con 0x7f3e48161ca0 2024-09-10T08:48:03.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.929+0000 7f3e3f400640 1 -- 172.21.15.2:0/3646532102 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v12)=0 v12) ==== 133+0+0 (secure 0 0 0) 0x7f3e4005a1f0 con 0x7f3e48161ca0 2024-09-10T08:48:03.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.932+0000 7f3e4e400640 1 -- 172.21.15.2:0/3646532102 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f3e2806be80 msgr2=0x7f3e2806e340 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:48:03.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.932+0000 7f3e4e400640 1 --2- 172.21.15.2:0/3646532102 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f3e2806be80 0x7f3e2806e340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:03.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.932+0000 7f3e4e400640 1 -- 172.21.15.2:0/3646532102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e48161ca0 msgr2=0x7f3e480cbbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:03.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.932+0000 7f3e4e400640 1 --2- 172.21.15.2:0/3646532102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e48161ca0 0x7f3e480cbbb0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f3e4000ef00 tx=0x7f3e4000b480 comp rx=0 tx=0).stop 2024-09-10T08:48:03.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.932+0000 7f3e4e400640 1 -- 172.21.15.2:0/3646532102 shutdown_connections 2024-09-10T08:48:03.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.932+0000 7f3e4e400640 1 --2- 172.21.15.2:0/3646532102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3e48161ca0 0x7f3e480cbbb0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:03.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.932+0000 7f3e4e400640 1 --2- 172.21.15.2:0/3646532102 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e480d2b60 0x7f3e480cb670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:03.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.932+0000 7f3e4e400640 1 --2- 172.21.15.2:0/3646532102 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7f3e2806be80 0x7f3e2806e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:03.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.932+0000 7f3e4e400640 1 --2- 172.21.15.2:0/3646532102 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3e480cf6f0 0x7f3e4814e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:03.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.932+0000 7f3e4e400640 1 -- 172.21.15.2:0/3646532102 >> 172.21.15.2:0/3646532102 conn(0x7f3e4808bfd0 msgr2=0x7f3e4806e2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:03.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.932+0000 7f3e4e400640 1 -- 172.21.15.2:0/3646532102 shutdown_connections 2024-09-10T08:48:03.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:03.932+0000 7f3e4e400640 1 -- 172.21.15.2:0/3646532102 wait complete. 2024-09-10T08:48:03.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:48:03.950 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2024-09-10T08:48:04.032 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add snap_test_dir1 1m 2024-09-10T08:48:04.147 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:48:04.145+0000 7fa00c120040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-10T08:48:04.199 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:48:04.198+0000 7fa00c120040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-10T08:48:04.205 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:48:04.204+0000 7f1ed212b040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-10T08:48:04.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:04.232+0000 7fc8c5a00640 1 Processor -- start 2024-09-10T08:48:04.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:04.233+0000 7fc8c5a00640 1 -- start start 2024-09-10T08:48:04.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:04.234+0000 7fc8c5a00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc8c006e570 0x7fc8c0169240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:04.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:04.234+0000 7fc8c5a00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8c00cfe50 con 0x7fc8c00d2d30 2024-09-10T08:48:04.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:04.234+0000 7fc8c5a00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8c00d0130 con 0x7fc8c0161ca0 2024-09-10T08:48:04.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:04.234+0000 7fc8c5a00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fc8c00d34a0 con 0x7fc8c006e570 2024-09-10T08:48:04.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:04.234+0000 7fc8b7e00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fc8c00d2d30 0x7fc8c00cf1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41032/0 (socket says 172.21.15.2:41032) 2024-09-10T08:48:04.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:04.234+0000 7fc8b7e00640 1 -- 172.21.15.2:0/3724610574 learned_addr learned my addr 172.21.15.2:0/3724610574 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:48:04.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:04.234+0000 7fc8bf400640 1 --2- 172.21.15.2:0/3724610574 >> v2:172.21.15.155:3300/0 conn(0x7fc8c006e570 0x7fc8c0169240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:04.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:04.235+0000 7fc8be000640 1 -- 172.21.15.2:0/3724610574 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3974332322 0 0) 0x7fc8c00cfe50 con 0x7fc8c00d2d30 2024-09-10T08:48:04.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:04.235+0000 7fc8be000640 1 -- 172.21.15.2:0/3724610574 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc8a4003520 con 0x7fc8c00d2d30 2024-09-10T08:48:04.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:04.235+0000 7fc8be000640 1 -- 172.21.15.2:0/3724610574 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1700826337 0 0) 0x7fc8c00d0130 con 0x7fc8c0161ca0 2024-09-10T08:48:04.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:04.235+0000 7fc8be000640 1 -- 172.21.15.2:0/3724610574 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc8c00cfe50 con 0x7fc8c0161ca0 2024-09-10T08:48:04.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:04.235+0000 7fc8bf400640 1 -- 172.21.15.2:0/3724610574 >> v1:172.21.15.155:6789/0 conn(0x7fc8c0161ca0 legacy=0x7fc8c00d2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:04.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:04.235+0000 7fc8be000640 1 -- 172.21.15.2:0/3724610574 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 672285115 0 0) 0x7fc8a4003520 con 0x7fc8c00d2d30 2024-09-10T08:48:04.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:04.235+0000 7fc8bf400640 1 -- 172.21.15.2:0/3724610574 >> v1:172.21.15.2:6789/0 conn(0x7fc8c00d2d30 legacy=0x7fc8c00cf1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:04.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:04.235+0000 7fc8bf400640 1 -- 172.21.15.2:0/3724610574 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8c00d0410 con 0x7fc8c006e570 2024-09-10T08:48:04.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:04.237+0000 7fc8bf400640 1 --2- 172.21.15.2:0/3724610574 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc8c006e570 0x7fc8c0169240 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc8b8009d90 tx=0x7fc8b802a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=faff26611e6953a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:04.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:04.237+0000 7fc8be000640 1 -- 172.21.15.2:0/3724610574 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a8001670 con 0x7fc8c006e570 2024-09-10T08:48:04.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:04.237+0000 7fc8be000640 1 -- 172.21.15.2:0/3724610574 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8b8007540 con 0x7fc8c006e570 2024-09-10T08:48:04.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:04.237+0000 7fc8be000640 1 -- 172.21.15.2:0/3724610574 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b8007910 con 0x7fc8c006e570 2024-09-10T08:48:04.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:04.238+0000 7fc8c5a00640 1 -- 172.21.15.2:0/3724610574 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc8c006e570 msgr2=0x7fc8c0169240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:04.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:04.238+0000 7fc8c5a00640 1 --2- 172.21.15.2:0/3724610574 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc8c006e570 0x7fc8c0169240 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc8b8009d90 tx=0x7fc8b802a5f0 comp rx=0 tx=0).stop 2024-09-10T08:48:04.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:04.238+0000 7fc8c5a00640 1 -- 172.21.15.2:0/3724610574 shutdown_connections 2024-09-10T08:48:04.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:04.238+0000 7fc8c5a00640 1 --2- 172.21.15.2:0/3724610574 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc8c006e570 0x7fc8c0169240 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:04.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:04.238+0000 7fc8c5a00640 1 -- 172.21.15.2:0/3724610574 >> 172.21.15.2:0/3724610574 conn(0x7fc8c008bfd0 msgr2=0x7fc8c00d45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:04.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:04.238+0000 7fc8c5a00640 1 -- 172.21.15.2:0/3724610574 shutdown_connections 2024-09-10T08:48:04.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:04.238+0000 7fc8c5a00640 1 -- 172.21.15.2:0/3724610574 wait complete. 2024-09-10T08:48:04.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:04.239+0000 7fc8c5a00640 1 Processor -- start 2024-09-10T08:48:04.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:04.240+0000 7fc8c5a00640 1 -- start start 2024-09-10T08:48:04.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:04.240+0000 7fc8c5a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc8c006e570 0x7fc8c01f88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:04.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:04.241+0000 7fc8c5a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8c00d2d30 0x7fc8c015eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:04.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:04.241+0000 7fc8c5a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc8c0161ca0 0x7fc8c01591a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:04.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:04.241+0000 7fc8c5a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c00cf8c0 con 0x7fc8c00d2d30 2024-09-10T08:48:04.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:04.241+0000 7fc8c5a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c006cdf0 con 0x7fc8c0161ca0 2024-09-10T08:48:04.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:04.241+0000 7fc8c5a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc8c00cfa40 con 0x7fc8c006e570 2024-09-10T08:48:04.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:04.241+0000 7fc8b7e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8c00d2d30 0x7fc8c015eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:04.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:04.241+0000 7fc8b7e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8c00d2d30 0x7fc8c015eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55810/0 (socket says 172.21.15.2:55810) 2024-09-10T08:48:04.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:04.241+0000 7fc8b7e00640 1 -- 172.21.15.2:0/1039849846 learned_addr learned my addr 172.21.15.2:0/1039849846 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:04.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:04.241+0000 7fc8bea00640 1 --2- 172.21.15.2:0/1039849846 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc8c006e570 0x7fc8c01f88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:04.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:04.241+0000 7fc8b7e00640 1 -- 172.21.15.2:0/1039849846 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc8c006e570 msgr2=0x7fc8c01f88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:04.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:04.241+0000 7fc8b7e00640 1 --2- 172.21.15.2:0/1039849846 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc8c006e570 0x7fc8c01f88a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:04.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:04.241+0000 7fc8b7e00640 1 -- 172.21.15.2:0/1039849846 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc8c0161ca0 msgr2=0x7fc8c01591a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:04.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:04.241+0000 7fc8b7e00640 1 --2- 172.21.15.2:0/1039849846 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc8c0161ca0 0x7fc8c01591a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:04.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:04.241+0000 7fc8b7e00640 1 -- 172.21.15.2:0/1039849846 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8c01f8de0 con 0x7fc8c00d2d30 2024-09-10T08:48:04.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:04.242+0000 7fc8b7e00640 1 --2- 172.21.15.2:0/1039849846 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8c00d2d30 0x7fc8c015eee0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc8a80011e0 tx=0x7fc8a800cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:04.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:04.242+0000 7fc8b6a00640 1 -- 172.21.15.2:0/1039849846 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a8017070 con 0x7fc8c00d2d30 2024-09-10T08:48:04.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:04.242+0000 7fc8b6a00640 1 -- 172.21.15.2:0/1039849846 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8a8005af0 con 0x7fc8c00d2d30 2024-09-10T08:48:04.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:04.242+0000 7fc8b6a00640 1 -- 172.21.15.2:0/1039849846 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a8007070 con 0x7fc8c00d2d30 2024-09-10T08:48:04.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:04.242+0000 7fc8c5a00640 1 -- 172.21.15.2:0/1039849846 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8c01f4aa0 con 0x7fc8c00d2d30 2024-09-10T08:48:04.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:04.242+0000 7fc8c5a00640 1 -- 172.21.15.2:0/1039849846 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8c01f52e0 con 0x7fc8c00d2d30 2024-09-10T08:48:04.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:04.243+0000 7fc8c5a00640 1 -- 172.21.15.2:0/1039849846 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8c00cf1b0 con 0x7fc8c00d2d30 2024-09-10T08:48:04.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:04.244+0000 7fc8b6a00640 1 -- 172.21.15.2:0/1039849846 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 6) ==== 90515+0+0 (secure 0 0 0) 0x7fc8a801a070 con 0x7fc8c00d2d30 2024-09-10T08:48:04.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:04.245+0000 7fc8b6a00640 1 --2- 172.21.15.2:0/1039849846 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fc89c06be80 0x7fc89c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:04.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:04.245+0000 7fc8b6a00640 1 -- 172.21.15.2:0/1039849846 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7fc8a808a690 con 0x7fc8c00d2d30 2024-09-10T08:48:04.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:04.245+0000 7fc8bea00640 1 -- 172.21.15.2:0/1039849846 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fc89c06be80 msgr2=0x7fc89c06e340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.155:6832/2611418382 2024-09-10T08:48:04.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:04.245+0000 7fc8bea00640 1 --2- 172.21.15.2:0/1039849846 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fc89c06be80 0x7fc89c06e340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:48:04.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:04.249+0000 7fc8b6a00640 1 -- 172.21.15.2:0/1039849846 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc8c01f4aa0 con 0x7fc8c00d2d30 2024-09-10T08:48:04.262 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:48:04.261+0000 7f1ed212b040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-10T08:48:04.332 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:48:04.331+0000 7fa00c120040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-10T08:48:04.403 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:48:04.401+0000 7f1ed212b040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-10T08:48:04.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:04.446+0000 7fc8bea00640 1 -- 172.21.15.2:0/1039849846 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fc89c06be80 msgr2=0x7fc89c06e340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.155:6832/2611418382 2024-09-10T08:48:04.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:04.446+0000 7fc8bea00640 1 --2- 172.21.15.2:0/1039849846 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fc89c06be80 0x7fc89c06e340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:48:04.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:04.458+0000 7fc8c5a00640 1 -- 172.21.15.2:0/1039849846 --> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "path": "snap_test_dir1", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7fc8c00b4830 con 0x7fc89c06be80 2024-09-10T08:48:04.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:04.847+0000 7fc8bea00640 1 -- 172.21.15.2:0/1039849846 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fc89c06be80 msgr2=0x7fc89c06e340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.155:6832/2611418382 2024-09-10T08:48:04.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:04.847+0000 7fc8bea00640 1 --2- 172.21.15.2:0/1039849846 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fc89c06be80 0x7fc89c06e340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-10T08:48:05.190 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:48:05.189+0000 7fa00c120040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-10T08:48:05.241 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:48:05.239+0000 7fa00c120040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-10T08:48:05.309 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:48:05.308+0000 7f1ed212b040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-10T08:48:05.363 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:48:05.362+0000 7f1ed212b040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-10T08:48:05.611 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:48:05.609+0000 7fa00c120040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-10T08:48:05.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:05.648+0000 7fc8bea00640 1 -- 172.21.15.2:0/1039849846 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fc89c06be80 msgr2=0x7fc89c06e340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.155:6832/2611418382 2024-09-10T08:48:05.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:05.648+0000 7fc8bea00640 1 --2- 172.21.15.2:0/1039849846 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fc89c06be80 0x7fc89c06e340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-10T08:48:05.707 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:48:05.705+0000 7fa00c120040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-10T08:48:05.757 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:48:05.756+0000 7f1ed212b040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-10T08:48:05.826 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:48:05.824+0000 7fa00c120040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-10T08:48:05.859 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:48:05.858+0000 7f1ed212b040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-10T08:48:05.875 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:48:05.873+0000 7fa00c120040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-10T08:48:05.986 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:48:05.985+0000 7f1ed212b040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-10T08:48:05.998 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:48:05.996+0000 7fa00c120040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-10T08:48:06.038 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:48:06.037+0000 7f1ed212b040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-10T08:48:06.057 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:48:06.056+0000 7fa00c120040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-10T08:48:06.105 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:48:06.104+0000 7fa00c120040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-10T08:48:06.169 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:48:06.168+0000 7f1ed212b040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-10T08:48:06.232 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:48:06.231+0000 7fa00c120040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-10T08:48:06.233 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:48:06.232+0000 7f1ed212b040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-10T08:48:06.285 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:48:06.284+0000 7f1ed212b040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-10T08:48:06.289 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:48:06.287+0000 7fa00c120040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-10T08:48:06.344 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:48:06.342+0000 7fa00c120040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-10T08:48:06.404 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:48:06.403+0000 7fa00c120040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-10T08:48:06.417 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:48:06.416+0000 7f1ed212b040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-10T08:48:06.453 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:48:06.452+0000 7fa00c120040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-10T08:48:06.476 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:48:06.475+0000 7f1ed212b040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-10T08:48:06.502 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:48:06.501+0000 7fa00c120040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-10T08:48:06.535 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:48:06.534+0000 7f1ed212b040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-10T08:48:06.601 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:48:06.600+0000 7f1ed212b040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-10T08:48:06.653 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:48:06.652+0000 7f1ed212b040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-10T08:48:06.705 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:48:06.704+0000 7f1ed212b040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-10T08:48:07.139 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:48:07.138+0000 7fa00c120040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-10T08:48:07.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:07.150+0000 7fc8b6a00640 1 -- 172.21.15.2:0/1039849846 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mgrmap(e 7) ==== 90226+0+0 (secure 0 0 0) 0x7fc8a8054d80 con 0x7fc8c00d2d30 2024-09-10T08:48:07.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:07.150+0000 7fc8b6a00640 1 -- 172.21.15.2:0/1039849846 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fc89c06be80 msgr2=0x7fc89c06e340 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:48:07.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:07.150+0000 7fc8b6a00640 1 --2- 172.21.15.2:0/1039849846 >> [v2:172.21.15.155:6832/2611418382,v1:172.21.15.155:6833/2611418382] conn(0x7fc89c06be80 0x7fc89c06e340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:07.339 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:48:07.339+0000 7f9f7e000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T08:48:07.340 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:48:07.339+0000 7f9f7e000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T08:48:07.340 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:48:07.339+0000 7f9f7e000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T08:48:07.340 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:48:07.339+0000 7f9f7e000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T08:48:07.340 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:48:07.339+0000 7f9f7e000640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T08:48:07.340 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:48:07.339+0000 7f9f81c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T08:48:07.340 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:48:07.339+0000 7f9f81c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T08:48:07.340 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:48:07.339+0000 7f9f81c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T08:48:07.340 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:48:07.339+0000 7f9f81c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T08:48:07.340 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:48:07.339+0000 7f9f81c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T08:48:07.410 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:48:07.409+0000 7f1ed212b040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-10T08:48:08.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.157+0000 7fc8b6a00640 1 -- 172.21.15.2:0/1039849846 <== mon.0 v2:172.21.15.2:3300/0 8 ==== mgrmap(e 8) ==== 90353+0+0 (secure 0 0 0) 0x7fc8a8058970 con 0x7fc8c00d2d30 2024-09-10T08:48:08.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.157+0000 7fc8b6a00640 1 --2- 172.21.15.2:0/1039849846 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7fc89c074380 0x7fc89c076770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:08.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.157+0000 7fc8b6a00640 1 -- 172.21.15.2:0/1039849846 --> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "path": "snap_test_dir1", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7fc8c00b4830 con 0x7fc89c074380 2024-09-10T08:48:08.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.158+0000 7fc8bea00640 1 --2- 172.21.15.2:0/1039849846 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7fc89c074380 0x7fc89c076770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:08.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.161+0000 7fc8bea00640 1 --2- 172.21.15.2:0/1039849846 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7fc89c074380 0x7fc89c076770 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc8b00011e0 tx=0x7fc8b0009040 comp rx=0 tx=0).ready entity=mgr.5017 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:08.239 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:48:08.244 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:48:08.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.255+0000 7fc8b6a00640 1 -- 172.21.15.2:0/1039849846 <== mgr.5017 v2:172.21.15.155:6832/3369759420 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc8c00b4830 con 0x7fc89c074380 2024-09-10T08:48:08.255 INFO:teuthology.orchestra.run.smithi002.stdout:Schedule set for path snap_test_dir1 2024-09-10T08:48:08.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.258+0000 7fc8c5a00640 1 -- 172.21.15.2:0/1039849846 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7fc89c074380 msgr2=0x7fc89c076770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:08.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.258+0000 7fc8c5a00640 1 --2- 172.21.15.2:0/1039849846 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7fc89c074380 0x7fc89c076770 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc8b00011e0 tx=0x7fc8b0009040 comp rx=0 tx=0).stop 2024-09-10T08:48:08.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.258+0000 7fc8c5a00640 1 -- 172.21.15.2:0/1039849846 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8c00d2d30 msgr2=0x7fc8c015eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:08.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.258+0000 7fc8c5a00640 1 --2- 172.21.15.2:0/1039849846 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8c00d2d30 0x7fc8c015eee0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc8a80011e0 tx=0x7fc8a800cbe0 comp rx=0 tx=0).stop 2024-09-10T08:48:08.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.258+0000 7fc8bf400640 1 -- 172.21.15.2:0/1039849846 reap_dead start 2024-09-10T08:48:08.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.258+0000 7fc8c5a00640 1 -- 172.21.15.2:0/1039849846 shutdown_connections 2024-09-10T08:48:08.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.258+0000 7fc8c5a00640 1 -- 172.21.15.2:0/1039849846 >> 172.21.15.2:0/1039849846 conn(0x7fc8c008bfd0 msgr2=0x7fc8c00d1510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:08.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.258+0000 7fc8c5a00640 1 -- 172.21.15.2:0/1039849846 shutdown_connections 2024-09-10T08:48:08.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.258+0000 7fc8c5a00640 1 -- 172.21.15.2:0/1039849846 wait complete. 2024-09-10T08:48:08.277 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2024-09-10T08:48:08.277 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule retention add snap_test_dir1 1m 2024-09-10T08:48:08.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.479+0000 7fbdfda00640 1 Processor -- start 2024-09-10T08:48:08.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.480+0000 7fbdfda00640 1 -- start start 2024-09-10T08:48:08.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.481+0000 7fbdfda00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbdf815c460 0x7fbdf815d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:08.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.481+0000 7fbdfda00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdf81603b0 con 0x7fbdf806df50 2024-09-10T08:48:08.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.481+0000 7fbdfda00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdf8160690 con 0x7fbdf80cf310 2024-09-10T08:48:08.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.481+0000 7fbdfda00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fbdf8161030 con 0x7fbdf815c460 2024-09-10T08:48:08.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.481+0000 7fbdefe00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fbdf806df50 0x7fbdf80cec00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:60056/0 (socket says 172.21.15.2:60056) 2024-09-10T08:48:08.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.481+0000 7fbdefe00640 1 -- 172.21.15.2:0/2050156142 learned_addr learned my addr 172.21.15.2:0/2050156142 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:48:08.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.481+0000 7fbdf6a00640 1 --2- 172.21.15.2:0/2050156142 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbdf815c460 0x7fbdf815d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:08.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.482+0000 7fbdf6000640 1 -- 172.21.15.2:0/2050156142 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1718435373 0 0) 0x7fbdf81603b0 con 0x7fbdf806df50 2024-09-10T08:48:08.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.482+0000 7fbdf6000640 1 -- 172.21.15.2:0/2050156142 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbddc003520 con 0x7fbdf806df50 2024-09-10T08:48:08.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.482+0000 7fbdf6000640 1 -- 172.21.15.2:0/2050156142 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 826979806 0 0) 0x7fbdf8160690 con 0x7fbdf80cf310 2024-09-10T08:48:08.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.482+0000 7fbdf6000640 1 -- 172.21.15.2:0/2050156142 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbdf81603b0 con 0x7fbdf80cf310 2024-09-10T08:48:08.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.482+0000 7fbdf6a00640 1 -- 172.21.15.2:0/2050156142 >> v1:172.21.15.155:6789/0 conn(0x7fbdf80cf310 legacy=0x7fbdf80b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:08.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.482+0000 7fbdf6a00640 1 -- 172.21.15.2:0/2050156142 >> v1:172.21.15.2:6789/0 conn(0x7fbdf806df50 legacy=0x7fbdf80cec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:08.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.482+0000 7fbdf6a00640 1 -- 172.21.15.2:0/2050156142 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdf8160970 con 0x7fbdf815c460 2024-09-10T08:48:08.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.483+0000 7fbdf6a00640 1 --2- 172.21.15.2:0/2050156142 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbdf815c460 0x7fbdf815d530 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbde80097d0 tx=0x7fbde802a200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac557eb99093946 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:08.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.483+0000 7fbdf6000640 1 -- 172.21.15.2:0/2050156142 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde8037070 con 0x7fbdf815c460 2024-09-10T08:48:08.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.483+0000 7fbdf6000640 1 -- 172.21.15.2:0/2050156142 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbde8032440 con 0x7fbdf815c460 2024-09-10T08:48:08.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.483+0000 7fbdf6000640 1 -- 172.21.15.2:0/2050156142 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde8032810 con 0x7fbdf815c460 2024-09-10T08:48:08.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.484+0000 7fbdfda00640 1 -- 172.21.15.2:0/2050156142 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbdf815c460 msgr2=0x7fbdf815d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:08.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.484+0000 7fbdfda00640 1 --2- 172.21.15.2:0/2050156142 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbdf815c460 0x7fbdf815d530 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbde80097d0 tx=0x7fbde802a200 comp rx=0 tx=0).stop 2024-09-10T08:48:08.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.484+0000 7fbdfda00640 1 -- 172.21.15.2:0/2050156142 shutdown_connections 2024-09-10T08:48:08.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.484+0000 7fbdfda00640 1 --2- 172.21.15.2:0/2050156142 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbdf815c460 0x7fbdf815d530 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:08.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.484+0000 7fbdfda00640 1 -- 172.21.15.2:0/2050156142 >> 172.21.15.2:0/2050156142 conn(0x7fbdf80d02c0 msgr2=0x7fbdf80d06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:08.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.484+0000 7fbdfda00640 1 -- 172.21.15.2:0/2050156142 shutdown_connections 2024-09-10T08:48:08.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.484+0000 7fbdfda00640 1 -- 172.21.15.2:0/2050156142 wait complete. 2024-09-10T08:48:08.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.485+0000 7fbdfda00640 1 Processor -- start 2024-09-10T08:48:08.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.486+0000 7fbdfda00640 1 -- start start 2024-09-10T08:48:08.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.486+0000 7fbdfda00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdf806df50 0x7fbdf8146630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:08.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.486+0000 7fbdfda00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbdf80cf310 0x7fbdf8147110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:08.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.486+0000 7fbdfda00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbdf815c460 0x7fbdf80c9550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:08.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.487+0000 7fbdfda00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf8160080 con 0x7fbdf806df50 2024-09-10T08:48:08.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.487+0000 7fbdfda00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf815da70 con 0x7fbdf80cf310 2024-09-10T08:48:08.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.487+0000 7fbdfda00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fbdf815c840 con 0x7fbdf815c460 2024-09-10T08:48:08.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.487+0000 7fbdf6a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdf806df50 0x7fbdf8146630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:08.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.487+0000 7fbdf6a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdf806df50 0x7fbdf8146630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35982/0 (socket says 172.21.15.2:35982) 2024-09-10T08:48:08.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.487+0000 7fbdf6a00640 1 -- 172.21.15.2:0/941949039 learned_addr learned my addr 172.21.15.2:0/941949039 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:08.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.487+0000 7fbdf6a00640 1 -- 172.21.15.2:0/941949039 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbdf815c460 msgr2=0x7fbdf80c9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:08.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.487+0000 7fbdf6a00640 1 --2- 172.21.15.2:0/941949039 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbdf815c460 0x7fbdf80c9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:08.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.487+0000 7fbdf6a00640 1 -- 172.21.15.2:0/941949039 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbdf80cf310 msgr2=0x7fbdf8147110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:08.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.487+0000 7fbdf6a00640 1 --2- 172.21.15.2:0/941949039 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbdf80cf310 0x7fbdf8147110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:08.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.487+0000 7fbdf6a00640 1 -- 172.21.15.2:0/941949039 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdf80ad390 con 0x7fbdf806df50 2024-09-10T08:48:08.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.487+0000 7fbdf6a00640 1 --2- 172.21.15.2:0/941949039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdf806df50 0x7fbdf8146630 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fbde8035040 tx=0x7fbde80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:08.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.488+0000 7fbdeea00640 1 -- 172.21.15.2:0/941949039 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde8037050 con 0x7fbdf806df50 2024-09-10T08:48:08.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.488+0000 7fbdeea00640 1 -- 172.21.15.2:0/941949039 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbde8043070 con 0x7fbdf806df50 2024-09-10T08:48:08.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.488+0000 7fbdeea00640 1 -- 172.21.15.2:0/941949039 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde803cb10 con 0x7fbdf806df50 2024-09-10T08:48:08.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.488+0000 7fbdfda00640 1 -- 172.21.15.2:0/941949039 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdf80ad670 con 0x7fbdf806df50 2024-09-10T08:48:08.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.488+0000 7fbdfda00640 1 -- 172.21.15.2:0/941949039 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdf80adc30 con 0x7fbdf806df50 2024-09-10T08:48:08.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.489+0000 7fbdfda00640 1 -- 172.21.15.2:0/941949039 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdf80d1050 con 0x7fbdf806df50 2024-09-10T08:48:08.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.490+0000 7fbdeea00640 1 -- 172.21.15.2:0/941949039 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 8) ==== 90353+0+0 (secure 0 0 0) 0x7fbde803ccb0 con 0x7fbdf806df50 2024-09-10T08:48:08.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.491+0000 7fbdeea00640 1 --2- 172.21.15.2:0/941949039 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7fbdd406bcd0 0x7fbdd406e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:08.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.491+0000 7fbdeea00640 1 -- 172.21.15.2:0/941949039 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6359+0+0 (secure 0 0 0) 0x7fbde80abbe0 con 0x7fbdf806df50 2024-09-10T08:48:08.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.491+0000 7fbdefe00640 1 --2- 172.21.15.2:0/941949039 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7fbdd406bcd0 0x7fbdd406e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:08.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.492+0000 7fbdefe00640 1 --2- 172.21.15.2:0/941949039 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7fbdd406bcd0 0x7fbdd406e190 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fbdf80b1dd0 tx=0x7fbde0007970 comp rx=0 tx=0).ready entity=mgr.5017 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:08.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.495+0000 7fbdeea00640 1 -- 172.21.15.2:0/941949039 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbde8046360 con 0x7fbdf806df50 2024-09-10T08:48:08.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.700+0000 7fbdfda00640 1 -- 172.21.15.2:0/941949039 --> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "path": "snap_test_dir1", "retention_spec_or_period": "1m", "target": ["mon-mgr", ""]}) -- 0x7fbdf80ad140 con 0x7fbdd406bcd0 2024-09-10T08:48:08.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.772+0000 7fbdeea00640 1 -- 172.21.15.2:0/941949039 <== mgr.5017 v2:172.21.15.155:6832/3369759420 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+39 (secure 0 0 0) 0x7fbdf80ad140 con 0x7fbdd406bcd0 2024-09-10T08:48:08.773 INFO:teuthology.orchestra.run.smithi002.stdout:Retention added to path snap_test_dir1 2024-09-10T08:48:08.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.774+0000 7fbdfda00640 1 -- 172.21.15.2:0/941949039 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7fbdd406bcd0 msgr2=0x7fbdd406e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:08.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.774+0000 7fbdfda00640 1 --2- 172.21.15.2:0/941949039 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7fbdd406bcd0 0x7fbdd406e190 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fbdf80b1dd0 tx=0x7fbde0007970 comp rx=0 tx=0).stop 2024-09-10T08:48:08.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.774+0000 7fbdfda00640 1 -- 172.21.15.2:0/941949039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdf806df50 msgr2=0x7fbdf8146630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:08.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.774+0000 7fbdfda00640 1 --2- 172.21.15.2:0/941949039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdf806df50 0x7fbdf8146630 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fbde8035040 tx=0x7fbde80046c0 comp rx=0 tx=0).stop 2024-09-10T08:48:08.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.774+0000 7fbdfda00640 1 -- 172.21.15.2:0/941949039 shutdown_connections 2024-09-10T08:48:08.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.774+0000 7fbdfda00640 1 --2- 172.21.15.2:0/941949039 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7fbdd406bcd0 0x7fbdd406e190 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:08.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.774+0000 7fbdfda00640 1 --2- 172.21.15.2:0/941949039 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbdf815c460 0x7fbdf80c9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:08.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.774+0000 7fbdfda00640 1 --2- 172.21.15.2:0/941949039 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbdf80cf310 0x7fbdf8147110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:08.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.774+0000 7fbdfda00640 1 --2- 172.21.15.2:0/941949039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbdf806df50 0x7fbdf8146630 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:08.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.774+0000 7fbdfda00640 1 -- 172.21.15.2:0/941949039 >> 172.21.15.2:0/941949039 conn(0x7fbdf80d02c0 msgr2=0x7fbdf815b4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:08.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.775+0000 7fbdfda00640 1 -- 172.21.15.2:0/941949039 shutdown_connections 2024-09-10T08:48:08.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.775+0000 7fbdfda00640 1 -- 172.21.15.2:0/941949039 wait complete. 2024-09-10T08:48:08.791 DEBUG:tasks.cephfs.test_snap_schedules:res=Retention added to path snap_test_dir1 2024-09-10T08:48:08.791 INFO:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.customsnapkernel/scheduled-2024-09-10-08_49_00 in ~52s... 2024-09-10T08:48:08.791 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1m'], expected_retention: [{'m': 1}] 2024-09-10T08:48:08.792 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --format json snap_test_dir1 2024-09-10T08:48:08.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.950+0000 7ff377200640 1 Processor -- start 2024-09-10T08:48:08.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.950+0000 7ff377200640 1 -- start start 2024-09-10T08:48:08.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.951+0000 7ff377200640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff3700d1510 0x7ff3700cf040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:08.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.951+0000 7ff377200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3700b59e0 0x7ff3700cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:08.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.951+0000 7ff377200640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3700d0550 con 0x7ff370161cb0 2024-09-10T08:48:08.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.951+0000 7ff377200640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7ff3700d3090 con 0x7ff3700d1510 2024-09-10T08:48:08.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.951+0000 7ff377200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff3700d2760 con 0x7ff3700b59e0 2024-09-10T08:48:08.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.952+0000 7ff376800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3700b59e0 0x7ff3700cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:08.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.952+0000 7ff375400640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff3700d1510 0x7ff3700cf040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:08.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.952+0000 7ff375400640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff3700d1510 0x7ff3700cf040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.2:52498/0 (socket says 172.21.15.2:52498) 2024-09-10T08:48:08.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.952+0000 7ff375400640 1 -- 172.21.15.2:0/387596834 learned_addr learned my addr 172.21.15.2:0/387596834 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:08.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.952+0000 7ff375e00640 1 --1- 172.21.15.2:0/387596834 >> v1:172.21.15.155:6789/0 conn(0x7ff370161cb0 0x7ff3700d0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.2:47544/0 (socket says 172.21.15.2:47544) 2024-09-10T08:48:08.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.952+0000 7ff376800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3700b59e0 0x7ff3700cf580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.2:45890/0 (socket says 172.21.15.2:45890) 2024-09-10T08:48:08.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.952+0000 7ff375400640 1 -- 172.21.15.2:0/387596834 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3700b59e0 msgr2=0x7ff3700cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:48:08.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.952+0000 7ff375400640 1 --2- 172.21.15.2:0/387596834 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3700b59e0 0x7ff3700cf580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:08.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.952+0000 7ff375400640 1 -- 172.21.15.2:0/387596834 >> v1:172.21.15.155:6789/0 conn(0x7ff370161cb0 legacy=0x7ff3700d0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:08.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.952+0000 7ff375400640 1 -- 172.21.15.2:0/387596834 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3700d2a40 con 0x7ff3700d1510 2024-09-10T08:48:08.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.952+0000 7ff374a00640 1 -- 172.21.15.2:0/387596834 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1043704194 0 0) 0x7ff3700d0550 con 0x7ff370161cb0 2024-09-10T08:48:08.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.952+0000 7ff376800640 1 --2- 172.21.15.2:0/387596834 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3700b59e0 0x7ff3700cf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:48:08.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.953+0000 7ff375400640 1 --2- 172.21.15.2:0/387596834 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3700d1510 0x7ff3700cf040 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff360009870 tx=0x7ff36002a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9eadeccade74c1fd server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:08.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.953+0000 7ff374a00640 1 -- 172.21.15.2:0/387596834 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff360037070 con 0x7ff3700d1510 2024-09-10T08:48:08.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.953+0000 7ff374a00640 1 -- 172.21.15.2:0/387596834 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff360032440 con 0x7ff3700d1510 2024-09-10T08:48:08.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.953+0000 7ff374a00640 1 -- 172.21.15.2:0/387596834 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff360032810 con 0x7ff3700d1510 2024-09-10T08:48:08.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.954+0000 7ff377200640 1 -- 172.21.15.2:0/387596834 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3700d1510 msgr2=0x7ff3700cf040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:08.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.954+0000 7ff377200640 1 --2- 172.21.15.2:0/387596834 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3700d1510 0x7ff3700cf040 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff360009870 tx=0x7ff36002a250 comp rx=0 tx=0).stop 2024-09-10T08:48:08.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.954+0000 7ff377200640 1 -- 172.21.15.2:0/387596834 shutdown_connections 2024-09-10T08:48:08.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.954+0000 7ff377200640 1 --2- 172.21.15.2:0/387596834 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff3700b59e0 0x7ff3700cf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:08.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.954+0000 7ff377200640 1 --2- 172.21.15.2:0/387596834 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3700d1510 0x7ff3700cf040 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:08.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.954+0000 7ff377200640 1 -- 172.21.15.2:0/387596834 >> 172.21.15.2:0/387596834 conn(0x7ff37009d700 msgr2=0x7ff3700d4430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:08.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.954+0000 7ff377200640 1 -- 172.21.15.2:0/387596834 shutdown_connections 2024-09-10T08:48:08.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.954+0000 7ff377200640 1 -- 172.21.15.2:0/387596834 wait complete. 2024-09-10T08:48:08.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.956+0000 7ff377200640 1 Processor -- start 2024-09-10T08:48:08.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.956+0000 7ff377200640 1 -- start start 2024-09-10T08:48:08.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.957+0000 7ff377200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3700b59e0 0x7ff370153750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:08.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.957+0000 7ff377200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3700d1510 0x7ff370150dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:08.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.957+0000 7ff377200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff370161cb0 0x7ff3700b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:08.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.957+0000 7ff377200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ff3700b4d40 con 0x7ff3700d1510 2024-09-10T08:48:08.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.957+0000 7ff377200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff3700b4bc0 con 0x7ff3700b59e0 2024-09-10T08:48:08.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.957+0000 7ff377200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ff370162090 con 0x7ff370161cb0 2024-09-10T08:48:08.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.957+0000 7ff375e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3700b59e0 0x7ff370153750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:08.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.957+0000 7ff375400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3700d1510 0x7ff370150dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:08.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.957+0000 7ff375e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3700b59e0 0x7ff370153750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.2:52500/0 (socket says 172.21.15.2:52500) 2024-09-10T08:48:08.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.957+0000 7ff375e00640 1 -- 172.21.15.2:0/1611713286 learned_addr learned my addr 172.21.15.2:0/1611713286 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:08.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.957+0000 7ff376800640 1 --2- 172.21.15.2:0/1611713286 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff370161cb0 0x7ff3700b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:08.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.958+0000 7ff375e00640 1 -- 172.21.15.2:0/1611713286 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff370161cb0 msgr2=0x7ff3700b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:08.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.958+0000 7ff375e00640 1 --2- 172.21.15.2:0/1611713286 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff370161cb0 0x7ff3700b3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:08.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.958+0000 7ff375e00640 1 -- 172.21.15.2:0/1611713286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3700d1510 msgr2=0x7ff370150dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:08.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.958+0000 7ff375e00640 1 --2- 172.21.15.2:0/1611713286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3700d1510 0x7ff370150dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:08.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.958+0000 7ff375e00640 1 -- 172.21.15.2:0/1611713286 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff370153ef0 con 0x7ff3700b59e0 2024-09-10T08:48:08.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.958+0000 7ff375400640 1 --2- 172.21.15.2:0/1611713286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3700d1510 0x7ff370150dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:48:08.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.958+0000 7ff375e00640 1 --2- 172.21.15.2:0/1611713286 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3700b59e0 0x7ff370153750 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff36400c430 tx=0x7ff36400c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:08.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.958+0000 7ff36a000640 1 -- 172.21.15.2:0/1611713286 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3640074e0 con 0x7ff3700b59e0 2024-09-10T08:48:08.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.958+0000 7ff36a000640 1 -- 172.21.15.2:0/1611713286 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3640047e0 con 0x7ff3700b59e0 2024-09-10T08:48:08.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.958+0000 7ff36a000640 1 -- 172.21.15.2:0/1611713286 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff364004bd0 con 0x7ff3700b59e0 2024-09-10T08:48:08.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.958+0000 7ff377200640 1 -- 172.21.15.2:0/1611713286 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3701541d0 con 0x7ff3700b59e0 2024-09-10T08:48:08.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.958+0000 7ff377200640 1 -- 172.21.15.2:0/1611713286 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff370151910 con 0x7ff3700b59e0 2024-09-10T08:48:08.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.959+0000 7ff377200640 1 -- 172.21.15.2:0/1611713286 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3700b3080 con 0x7ff3700b59e0 2024-09-10T08:48:08.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.960+0000 7ff36a000640 1 -- 172.21.15.2:0/1611713286 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 8) ==== 90353+0+0 (secure 0 0 0) 0x7ff364011070 con 0x7ff3700b59e0 2024-09-10T08:48:08.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.961+0000 7ff36a000640 1 --2- 172.21.15.2:0/1611713286 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7ff35406bcd0 0x7ff35406e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:08.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.961+0000 7ff36a000640 1 -- 172.21.15.2:0/1611713286 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6359+0+0 (secure 0 0 0) 0x7ff36408a970 con 0x7ff3700b59e0 2024-09-10T08:48:08.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.962+0000 7ff375400640 1 --2- 172.21.15.2:0/1611713286 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7ff35406bcd0 0x7ff35406e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:08.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.962+0000 7ff375400640 1 --2- 172.21.15.2:0/1611713286 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7ff35406bcd0 0x7ff35406e190 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff360034000 tx=0x7ff36002e000 comp rx=0 tx=0).ready entity=mgr.5017 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:08.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:08.971+0000 7ff36a000640 1 -- 172.21.15.2:0/1611713286 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff364059300 con 0x7ff3700b59e0 2024-09-10T08:48:09.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.177+0000 7ff377200640 1 -- 172.21.15.2:0/1611713286 --> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff370153c90 con 0x7ff35406bcd0 2024-09-10T08:48:09.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.186+0000 7ff36a000640 1 -- 172.21.15.2:0/1611713286 <== mgr.5017 v2:172.21.15.155:6832/3369759420 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+72 (secure 0 0 0) 0x7ff3600041c0 con 0x7ff35406bcd0 2024-09-10T08:48:09.207 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:48:09.207 INFO:teuthology.orchestra.run.smithi002.stdout:{"path": "snap_test_dir1", "schedule": ["1m"], "retention": [{"m": 1}]} 2024-09-10T08:48:09.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.188+0000 7ff377200640 1 -- 172.21.15.2:0/1611713286 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7ff35406bcd0 msgr2=0x7ff35406e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:09.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.188+0000 7ff377200640 1 --2- 172.21.15.2:0/1611713286 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7ff35406bcd0 0x7ff35406e190 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff360034000 tx=0x7ff36002e000 comp rx=0 tx=0).stop 2024-09-10T08:48:09.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.188+0000 7ff377200640 1 -- 172.21.15.2:0/1611713286 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3700b59e0 msgr2=0x7ff370153750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:09.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.188+0000 7ff377200640 1 --2- 172.21.15.2:0/1611713286 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3700b59e0 0x7ff370153750 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff36400c430 tx=0x7ff36400c830 comp rx=0 tx=0).stop 2024-09-10T08:48:09.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.188+0000 7ff377200640 1 -- 172.21.15.2:0/1611713286 shutdown_connections 2024-09-10T08:48:09.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.188+0000 7ff377200640 1 --2- 172.21.15.2:0/1611713286 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7ff35406bcd0 0x7ff35406e190 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:09.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.188+0000 7ff377200640 1 --2- 172.21.15.2:0/1611713286 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff370161cb0 0x7ff3700b3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:09.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.188+0000 7ff377200640 1 --2- 172.21.15.2:0/1611713286 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff3700d1510 0x7ff370150dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:09.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.188+0000 7ff377200640 1 --2- 172.21.15.2:0/1611713286 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3700b59e0 0x7ff370153750 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:09.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.188+0000 7ff377200640 1 -- 172.21.15.2:0/1611713286 >> 172.21.15.2:0/1611713286 conn(0x7ff37009d700 msgr2=0x7ff3700cf000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:09.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.188+0000 7ff377200640 1 -- 172.21.15.2:0/1611713286 shutdown_connections 2024-09-10T08:48:09.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.188+0000 7ff377200640 1 -- 172.21.15.2:0/1611713286 wait complete. 2024-09-10T08:48:09.211 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1m"], "retention": [{"m": 1}]} 2024-09-10T08:48:09.211 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1m'], 'retention': [{'m': 1}]} 2024-09-10T08:48:09.212 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove snap_test_dir1 2024-09-10T08:48:09.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.390+0000 7fae7fe00640 1 Processor -- start 2024-09-10T08:48:09.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.391+0000 7fae7fe00640 1 -- start start 2024-09-10T08:48:09.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.392+0000 7fae7fe00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae780cf6d0 0x7fae780af590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:09.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.392+0000 7fae7fe00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae780ad390 con 0x7fae7806f770 2024-09-10T08:48:09.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.392+0000 7fae7fe00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae780ad670 con 0x7fae7815b4c0 2024-09-10T08:48:09.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.392+0000 7fae7fe00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fae780d1130 con 0x7fae780cf6d0 2024-09-10T08:48:09.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.392+0000 7fae7ca00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fae7806f770 0x7fae780ae150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:60072/0 (socket says 172.21.15.2:60072) 2024-09-10T08:48:09.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.392+0000 7fae7ca00640 1 -- 172.21.15.2:0/14996888 learned_addr learned my addr 172.21.15.2:0/14996888 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:48:09.394 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.392+0000 7fae7de00640 1 --2- 172.21.15.2:0/14996888 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae780cf6d0 0x7fae780af590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:09.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.392+0000 7fae77e00640 1 -- 172.21.15.2:0/14996888 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2018271517 0 0) 0x7fae780ad390 con 0x7fae7806f770 2024-09-10T08:48:09.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.393+0000 7fae77e00640 1 -- 172.21.15.2:0/14996888 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae60005730 con 0x7fae7806f770 2024-09-10T08:48:09.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.393+0000 7fae7de00640 1 -- 172.21.15.2:0/14996888 >> v1:172.21.15.155:6789/0 conn(0x7fae7815b4c0 legacy=0x7fae7806f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:09.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.393+0000 7fae7de00640 1 -- 172.21.15.2:0/14996888 >> v1:172.21.15.2:6789/0 conn(0x7fae7806f770 legacy=0x7fae780ae150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:09.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.393+0000 7fae77e00640 1 -- 172.21.15.2:0/14996888 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 810965392 0 0) 0x7fae780ad670 con 0x7fae7815b4c0 2024-09-10T08:48:09.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.393+0000 7fae7de00640 1 -- 172.21.15.2:0/14996888 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae780ad950 con 0x7fae780cf6d0 2024-09-10T08:48:09.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.394+0000 7fae7de00640 1 --2- 172.21.15.2:0/14996888 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae780cf6d0 0x7fae780af590 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fae70009dc0 tx=0x7fae7002a640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4115e5c384e8be5f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:09.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.394+0000 7fae77e00640 1 -- 172.21.15.2:0/14996888 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae7002ae60 con 0x7fae780cf6d0 2024-09-10T08:48:09.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.394+0000 7fae77e00640 1 -- 172.21.15.2:0/14996888 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae70007740 con 0x7fae780cf6d0 2024-09-10T08:48:09.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.394+0000 7fae77e00640 1 -- 172.21.15.2:0/14996888 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae70007b10 con 0x7fae780cf6d0 2024-09-10T08:48:09.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.394+0000 7fae7fe00640 1 -- 172.21.15.2:0/14996888 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae780cf6d0 msgr2=0x7fae780af590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:09.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.394+0000 7fae7fe00640 1 --2- 172.21.15.2:0/14996888 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae780cf6d0 0x7fae780af590 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fae70009dc0 tx=0x7fae7002a640 comp rx=0 tx=0).stop 2024-09-10T08:48:09.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.395+0000 7fae7fe00640 1 -- 172.21.15.2:0/14996888 shutdown_connections 2024-09-10T08:48:09.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.395+0000 7fae7fe00640 1 --2- 172.21.15.2:0/14996888 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae780cf6d0 0x7fae780af590 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:09.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.395+0000 7fae7fe00640 1 -- 172.21.15.2:0/14996888 >> 172.21.15.2:0/14996888 conn(0x7fae780d02c0 msgr2=0x7fae780d06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:09.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.395+0000 7fae7fe00640 1 -- 172.21.15.2:0/14996888 shutdown_connections 2024-09-10T08:48:09.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.395+0000 7fae7fe00640 1 -- 172.21.15.2:0/14996888 wait complete. 2024-09-10T08:48:09.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.396+0000 7fae7fe00640 1 Processor -- start 2024-09-10T08:48:09.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.396+0000 7fae7fe00640 1 -- start start 2024-09-10T08:48:09.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.397+0000 7fae7fe00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae7806f770 0x7fae7815e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:09.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.397+0000 7fae7fe00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fae780cf6d0 0x7fae7814a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:09.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.397+0000 7fae7fe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae7815b4c0 0x7fae781549d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:09.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.397+0000 7fae7fe00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fae78071ef0 con 0x7fae7815b4c0 2024-09-10T08:48:09.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.397+0000 7fae7fe00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fae780ad140 con 0x7fae780cf6d0 2024-09-10T08:48:09.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.397+0000 7fae7fe00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fae78072070 con 0x7fae7806f770 2024-09-10T08:48:09.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.398+0000 7fae7de00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae7815b4c0 0x7fae781549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:09.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.398+0000 7fae7de00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae7815b4c0 0x7fae781549d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36010/0 (socket says 172.21.15.2:36010) 2024-09-10T08:48:09.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.398+0000 7fae7de00640 1 -- 172.21.15.2:0/2991307900 learned_addr learned my addr 172.21.15.2:0/2991307900 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:09.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.398+0000 7fae7ca00640 1 --2- 172.21.15.2:0/2991307900 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fae780cf6d0 0x7fae7814a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:09.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.398+0000 7fae7d400640 1 --2- 172.21.15.2:0/2991307900 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae7806f770 0x7fae7815e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:09.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.398+0000 7fae7de00640 1 -- 172.21.15.2:0/2991307900 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae7806f770 msgr2=0x7fae7815e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:09.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.398+0000 7fae7de00640 1 --2- 172.21.15.2:0/2991307900 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae7806f770 0x7fae7815e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:09.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.398+0000 7fae7de00640 1 -- 172.21.15.2:0/2991307900 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fae780cf6d0 msgr2=0x7fae7814a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:09.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.398+0000 7fae7de00640 1 --2- 172.21.15.2:0/2991307900 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fae780cf6d0 0x7fae7814a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:09.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.398+0000 7fae7de00640 1 -- 172.21.15.2:0/2991307900 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae7815bb50 con 0x7fae7815b4c0 2024-09-10T08:48:09.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.398+0000 7fae7de00640 1 --2- 172.21.15.2:0/2991307900 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae7815b4c0 0x7fae781549d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fae7002ac30 tx=0x7fae70004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:09.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.399+0000 7fae75600640 1 -- 172.21.15.2:0/2991307900 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae70040070 con 0x7fae7815b4c0 2024-09-10T08:48:09.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.399+0000 7fae75600640 1 -- 172.21.15.2:0/2991307900 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae70031940 con 0x7fae7815b4c0 2024-09-10T08:48:09.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.399+0000 7fae75600640 1 -- 172.21.15.2:0/2991307900 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae70031af0 con 0x7fae7815b4c0 2024-09-10T08:48:09.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.399+0000 7fae7fe00640 1 -- 172.21.15.2:0/2991307900 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae78150aa0 con 0x7fae7815b4c0 2024-09-10T08:48:09.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.399+0000 7fae7fe00640 1 -- 172.21.15.2:0/2991307900 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae78154140 con 0x7fae7815b4c0 2024-09-10T08:48:09.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.400+0000 7fae7fe00640 1 -- 172.21.15.2:0/2991307900 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae7815e650 con 0x7fae7815b4c0 2024-09-10T08:48:09.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.401+0000 7fae75600640 1 -- 172.21.15.2:0/2991307900 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 9) ==== 90618+0+0 (secure 0 0 0) 0x7fae70039040 con 0x7fae7815b4c0 2024-09-10T08:48:09.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.401+0000 7fae75600640 1 --2- 172.21.15.2:0/2991307900 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7fae5806bfd0 0x7fae5806e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:09.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.402+0000 7fae75600640 1 -- 172.21.15.2:0/2991307900 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6359+0+0 (secure 0 0 0) 0x7fae700ac950 con 0x7fae7815b4c0 2024-09-10T08:48:09.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.402+0000 7fae7d400640 1 --2- 172.21.15.2:0/2991307900 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7fae5806bfd0 0x7fae5806e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:09.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.403+0000 7fae7d400640 1 --2- 172.21.15.2:0/2991307900 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7fae5806bfd0 0x7fae5806e490 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fae6c000f60 tx=0x7fae6c009040 comp rx=0 tx=0).ready entity=mgr.5017 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:09.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.406+0000 7fae75600640 1 -- 172.21.15.2:0/2991307900 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fae78150aa0 con 0x7fae7815b4c0 2024-09-10T08:48:09.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.611+0000 7fae7fe00640 1 -- 172.21.15.2:0/2991307900 --> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) -- 0x7fae780b3600 con 0x7fae5806bfd0 2024-09-10T08:48:09.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.684+0000 7fae75600640 1 -- 172.21.15.2:0/2991307900 <== mgr.5017 v2:172.21.15.155:6832/3369759420 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7fae780b3600 con 0x7fae5806bfd0 2024-09-10T08:48:09.684 INFO:teuthology.orchestra.run.smithi002.stdout:Schedule removed for path snap_test_dir1 2024-09-10T08:48:09.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.686+0000 7fae7fe00640 1 -- 172.21.15.2:0/2991307900 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7fae5806bfd0 msgr2=0x7fae5806e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:09.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.686+0000 7fae7fe00640 1 --2- 172.21.15.2:0/2991307900 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7fae5806bfd0 0x7fae5806e490 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fae6c000f60 tx=0x7fae6c009040 comp rx=0 tx=0).stop 2024-09-10T08:48:09.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.686+0000 7fae7fe00640 1 -- 172.21.15.2:0/2991307900 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae7815b4c0 msgr2=0x7fae781549d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:09.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.686+0000 7fae7fe00640 1 --2- 172.21.15.2:0/2991307900 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae7815b4c0 0x7fae781549d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fae7002ac30 tx=0x7fae70004a40 comp rx=0 tx=0).stop 2024-09-10T08:48:09.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.686+0000 7fae7fe00640 1 -- 172.21.15.2:0/2991307900 shutdown_connections 2024-09-10T08:48:09.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.686+0000 7fae7fe00640 1 --2- 172.21.15.2:0/2991307900 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7fae5806bfd0 0x7fae5806e490 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:09.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.686+0000 7fae7fe00640 1 --2- 172.21.15.2:0/2991307900 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fae7815b4c0 0x7fae781549d0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:09.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.686+0000 7fae7fe00640 1 --2- 172.21.15.2:0/2991307900 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fae780cf6d0 0x7fae7814a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:09.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.686+0000 7fae7fe00640 1 --2- 172.21.15.2:0/2991307900 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae7806f770 0x7fae7815e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:09.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.686+0000 7fae7fe00640 1 -- 172.21.15.2:0/2991307900 >> 172.21.15.2:0/2991307900 conn(0x7fae780d02c0 msgr2=0x7fae7806efc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:09.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.686+0000 7fae7fe00640 1 -- 172.21.15.2:0/2991307900 shutdown_connections 2024-09-10T08:48:09.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:09.686+0000 7fae7fe00640 1 -- 172.21.15.2:0/2991307900 wait complete. 2024-09-10T08:48:09.702 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2024-09-10T08:48:09.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:48:09.703 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.customsnapkernel) 2024-09-10T08:48:09.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:48:09.744 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2024-09-10T08:48:09.826 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2024-09-10T08:48:10.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:10.025+0000 7f24d6c00640 1 Processor -- start 2024-09-10T08:48:10.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:10.025+0000 7f24d6c00640 1 -- start start 2024-09-10T08:48:10.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:10.026+0000 7f24d6c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24d00d1090 0x7f24d00d30e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:10.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:10.026+0000 7f24d6c00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24d00d52a0 con 0x7f24d00d4b20 2024-09-10T08:48:10.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:10.026+0000 7f24d6c00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24d00d4fc0 con 0x7f24d00d1470 2024-09-10T08:48:10.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:10.026+0000 7f24d6c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f24d00cf1c0 con 0x7f24d00d1090 2024-09-10T08:48:10.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:10.026+0000 7f24d4e00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f24d00d4b20 0x7f24d00b0f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:60074/0 (socket says 172.21.15.2:60074) 2024-09-10T08:48:10.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:10.026+0000 7f24d4e00640 1 -- 172.21.15.2:0/2463465721 learned_addr learned my addr 172.21.15.2:0/2463465721 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:48:10.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:10.026+0000 7f24d5800640 1 --2- 172.21.15.2:0/2463465721 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24d00d1090 0x7f24d00d30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:10.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:10.027+0000 7f24cfe00640 1 -- 172.21.15.2:0/2463465721 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1286755355 0 0) 0x7f24d00d52a0 con 0x7f24d00d4b20 2024-09-10T08:48:10.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:10.027+0000 7f24cfe00640 1 -- 172.21.15.2:0/2463465721 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f24b8003520 con 0x7f24d00d4b20 2024-09-10T08:48:10.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:10.027+0000 7f24d5800640 1 -- 172.21.15.2:0/2463465721 >> v1:172.21.15.155:6789/0 conn(0x7f24d00d1470 legacy=0x7f24d00cfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:10.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:10.027+0000 7f24cfe00640 1 -- 172.21.15.2:0/2463465721 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3854202952 0 0) 0x7f24d00d4fc0 con 0x7f24d00d1470 2024-09-10T08:48:10.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:10.027+0000 7f24d5800640 1 -- 172.21.15.2:0/2463465721 >> v1:172.21.15.2:6789/0 conn(0x7f24d00d4b20 legacy=0x7f24d00b0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:10.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:10.027+0000 7f24d5800640 1 -- 172.21.15.2:0/2463465721 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24d00cf4a0 con 0x7f24d00d1090 2024-09-10T08:48:10.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:10.028+0000 7f24d5800640 1 --2- 172.21.15.2:0/2463465721 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24d00d1090 0x7f24d00d30e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f24c40097d0 tx=0x7f24c402a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d6d4091a9a02283 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:10.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:10.028+0000 7f24cfe00640 1 -- 172.21.15.2:0/2463465721 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c4037070 con 0x7f24d00d1090 2024-09-10T08:48:10.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:10.028+0000 7f24cfe00640 1 -- 172.21.15.2:0/2463465721 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24c4032440 con 0x7f24d00d1090 2024-09-10T08:48:10.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:10.028+0000 7f24cfe00640 1 -- 172.21.15.2:0/2463465721 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c4032810 con 0x7f24d00d1090 2024-09-10T08:48:10.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:10.029+0000 7f24d6c00640 1 -- 172.21.15.2:0/2463465721 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24d00d1090 msgr2=0x7f24d00d30e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:10.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:10.029+0000 7f24d6c00640 1 --2- 172.21.15.2:0/2463465721 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24d00d1090 0x7f24d00d30e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f24c40097d0 tx=0x7f24c402a210 comp rx=0 tx=0).stop 2024-09-10T08:48:10.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:10.029+0000 7f24d6c00640 1 -- 172.21.15.2:0/2463465721 shutdown_connections 2024-09-10T08:48:10.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:10.029+0000 7f24d6c00640 1 --2- 172.21.15.2:0/2463465721 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24d00d1090 0x7f24d00d30e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:10.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:10.029+0000 7f24d6c00640 1 -- 172.21.15.2:0/2463465721 >> 172.21.15.2:0/2463465721 conn(0x7f24d009d6e0 msgr2=0x7f24d00d4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:10.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:10.029+0000 7f24d6c00640 1 -- 172.21.15.2:0/2463465721 shutdown_connections 2024-09-10T08:48:10.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:10.029+0000 7f24d6c00640 1 -- 172.21.15.2:0/2463465721 wait complete. 2024-09-10T08:48:10.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:10.031+0000 7f24d6c00640 1 Processor -- start 2024-09-10T08:48:10.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:10.031+0000 7f24d6c00640 1 -- start start 2024-09-10T08:48:10.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:10.032+0000 7f24d6c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24d00d1090 0x7f24d015cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:10.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:10.032+0000 7f24d6c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24d00d1470 0x7f24d006de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:10.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:10.032+0000 7f24d6c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24d00d4b20 0x7f24d006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:10.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:10.032+0000 7f24d6c00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f24d00b3240 con 0x7f24d00d1470 2024-09-10T08:48:10.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:10.032+0000 7f24d6c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f24d00b1650 con 0x7f24d00d4b20 2024-09-10T08:48:10.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:10.032+0000 7f24d6c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f24d00b33c0 con 0x7f24d00d1090 2024-09-10T08:48:10.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:10.032+0000 7f24d4e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24d00d1470 0x7f24d006de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:10.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:10.032+0000 7f24d4e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24d00d1470 0x7f24d006de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36026/0 (socket says 172.21.15.2:36026) 2024-09-10T08:48:10.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:10.032+0000 7f24d4e00640 1 -- 172.21.15.2:0/1166915948 learned_addr learned my addr 172.21.15.2:0/1166915948 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:10.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:10.032+0000 7f24d5800640 1 --2- 172.21.15.2:0/1166915948 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24d00d1090 0x7f24d015cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:10.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:10.032+0000 7f24d6200640 1 --2- 172.21.15.2:0/1166915948 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24d00d4b20 0x7f24d006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:10.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:10.033+0000 7f24d4e00640 1 -- 172.21.15.2:0/1166915948 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24d00d1090 msgr2=0x7f24d015cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:10.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:10.033+0000 7f24d4e00640 1 --2- 172.21.15.2:0/1166915948 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24d00d1090 0x7f24d015cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:10.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:10.033+0000 7f24d4e00640 1 -- 172.21.15.2:0/1166915948 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24d00d4b20 msgr2=0x7f24d006e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:10.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:10.033+0000 7f24d4e00640 1 --2- 172.21.15.2:0/1166915948 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24d00d4b20 0x7f24d006e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:10.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:10.033+0000 7f24d4e00640 1 -- 172.21.15.2:0/1166915948 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24d00cb680 con 0x7f24d00d1470 2024-09-10T08:48:10.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:10.033+0000 7f24d4e00640 1 --2- 172.21.15.2:0/1166915948 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24d00d1470 0x7f24d006de30 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f24bc00c390 tx=0x7f24bc00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:10.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:10.033+0000 7f24cd600640 1 -- 172.21.15.2:0/1166915948 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24bc017070 con 0x7f24d00d1470 2024-09-10T08:48:10.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:10.033+0000 7f24cd600640 1 -- 172.21.15.2:0/1166915948 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24bc005d00 con 0x7f24d00d1470 2024-09-10T08:48:10.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:10.033+0000 7f24cd600640 1 -- 172.21.15.2:0/1166915948 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24bc007310 con 0x7f24d00d1470 2024-09-10T08:48:10.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:10.033+0000 7f24d6c00640 1 -- 172.21.15.2:0/1166915948 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24d00cb960 con 0x7f24d00d1470 2024-09-10T08:48:10.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:10.033+0000 7f24d6c00640 1 -- 172.21.15.2:0/1166915948 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24d00cbf20 con 0x7f24d00d1470 2024-09-10T08:48:10.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:10.034+0000 7f24d6c00640 1 -- 172.21.15.2:0/1166915948 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24d00d30e0 con 0x7f24d00d1470 2024-09-10T08:48:10.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:10.035+0000 7f24cd600640 1 -- 172.21.15.2:0/1166915948 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 9) ==== 90618+0+0 (secure 0 0 0) 0x7f24bc01a070 con 0x7f24d00d1470 2024-09-10T08:48:10.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:10.036+0000 7f24cd600640 1 --2- 172.21.15.2:0/1166915948 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7f24b006bfa0 0x7f24b006e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:10.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:10.037+0000 7f24cd600640 1 -- 172.21.15.2:0/1166915948 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6359+0+0 (secure 0 0 0) 0x7f24bc08a610 con 0x7f24d00d1470 2024-09-10T08:48:10.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:10.037+0000 7f24d5800640 1 --2- 172.21.15.2:0/1166915948 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7f24b006bfa0 0x7f24b006e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:10.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:10.037+0000 7f24d5800640 1 --2- 172.21.15.2:0/1166915948 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7f24b006bfa0 0x7f24b006e460 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f24c4034000 tx=0x7f24c402e000 comp rx=0 tx=0).ready entity=mgr.5017 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:10.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:10.041+0000 7f24cd600640 1 -- 172.21.15.2:0/1166915948 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f24bc0585c0 con 0x7f24d00d1470 2024-09-10T08:48:10.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:10.276+0000 7f24d6c00640 1 -- 172.21.15.2:0/1166915948 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) -- 0x7f24d00b3660 con 0x7f24d00d1470 2024-09-10T08:48:11.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.216+0000 7f24cd600640 1 -- 172.21.15.2:0/1166915948 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v10) ==== 93+0+0 (secure 0 0 0) 0x7f24bc05c8c0 con 0x7f24d00d1470 2024-09-10T08:48:11.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.220+0000 7f24d6c00640 1 -- 172.21.15.2:0/1166915948 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7f24b006bfa0 msgr2=0x7f24b006e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:11.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.220+0000 7f24d6c00640 1 --2- 172.21.15.2:0/1166915948 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7f24b006bfa0 0x7f24b006e460 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f24c4034000 tx=0x7f24c402e000 comp rx=0 tx=0).stop 2024-09-10T08:48:11.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.220+0000 7f24d6c00640 1 -- 172.21.15.2:0/1166915948 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24d00d1470 msgr2=0x7f24d006de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:11.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.220+0000 7f24cd600640 1 -- 172.21.15.2:0/1166915948 <== mon.0 v2:172.21.15.2:3300/0 8 ==== mgrmap(e 10) ==== 90657+0+0 (secure 0 0 0) 0x7f24bc054c30 con 0x7f24d00d1470 2024-09-10T08:48:11.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.221+0000 7f24d6c00640 1 --2- 172.21.15.2:0/1166915948 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24d00d1470 0x7f24d006de30 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f24bc00c390 tx=0x7f24bc00c850 comp rx=0 tx=0).stop 2024-09-10T08:48:11.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.221+0000 7f24d6c00640 1 -- 172.21.15.2:0/1166915948 shutdown_connections 2024-09-10T08:48:11.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.221+0000 7f24d6c00640 1 --2- 172.21.15.2:0/1166915948 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7f24b006bfa0 0x7f24b006e460 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:11.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.221+0000 7f24d6c00640 1 --2- 172.21.15.2:0/1166915948 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24d00d4b20 0x7f24d006e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:11.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.221+0000 7f24d6c00640 1 --2- 172.21.15.2:0/1166915948 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24d00d1470 0x7f24d006de30 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:11.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.221+0000 7f24d6c00640 1 --2- 172.21.15.2:0/1166915948 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24d00d1090 0x7f24d015cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:11.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.221+0000 7f24d6c00640 1 -- 172.21.15.2:0/1166915948 >> 172.21.15.2:0/1166915948 conn(0x7f24d009d6e0 msgr2=0x7f24d00b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:11.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.221+0000 7f24cd600640 1 --2- 172.21.15.2:0/1166915948 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7f24b0034800 0x7f24b00749b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:11.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.221+0000 7f24d6c00640 1 -- 172.21.15.2:0/1166915948 shutdown_connections 2024-09-10T08:48:11.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.221+0000 7f24d6c00640 1 --2- 172.21.15.2:0/1166915948 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7f24b0034800 0x7f24b00749b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:11.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.221+0000 7f24d6c00640 1 -- 172.21.15.2:0/1166915948 wait complete. 2024-09-10T08:48:11.240 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-10T08:48:11.240 DEBUG:teuthology.orchestra.run.smithi002:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T08:48:11.327 DEBUG:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-10T08:48:11.414 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:48:11.414+0000 7fc2a191e040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-10T08:48:11.415 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:48:11.415+0000 7f68143ef040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-10T08:48:11.416 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-10T08:48:11.416 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T08:48:11.417 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T08:48:11.417 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:48:11.452 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T08:48:11.453 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:48:11.466 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:48:11.466+0000 7fc2a191e040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-10T08:48:11.467 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:48:11.465+0000 7f68143ef040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-10T08:48:11.502 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-10T08:48:11.626 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:48:11.626+0000 7f68143ef040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-10T08:48:11.634 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:48:11.634+0000 7fc2a191e040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-10T08:48:11.683 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:48:11.682+0000 7f68143ef040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-10T08:48:11.695 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:48:11.695+0000 7fc2a191e040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-10T08:48:11.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.700+0000 7f7555400640 1 Processor -- start 2024-09-10T08:48:11.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.701+0000 7f7555400640 1 -- start start 2024-09-10T08:48:11.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.702+0000 7f7555400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f755015b4c0 0x7f75500cf6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:11.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.702+0000 7f7555400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f75500af590 0x7f755006f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:11.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.702+0000 7f7555400640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75500af160 con 0x7f755006f5a0 2024-09-10T08:48:11.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.702+0000 7f7555400640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f75500d1130 con 0x7f75500af590 2024-09-10T08:48:11.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.702+0000 7f7555400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f75500ad140 con 0x7f755015b4c0 2024-09-10T08:48:11.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.702+0000 7f7547e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f75500af590 0x7f755006f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:11.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.702+0000 7f7547e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f75500af590 0x7f755006f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36042/0 (socket says 172.21.15.2:36042) 2024-09-10T08:48:11.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.702+0000 7f754f200640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f755006f5a0 0x7f75500ce5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:60076/0 (socket says 172.21.15.2:60076) 2024-09-10T08:48:11.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.702+0000 7f7547e00640 1 -- 172.21.15.2:0/3656854843 learned_addr learned my addr 172.21.15.2:0/3656854843 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:11.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.702+0000 7f754e800640 1 --2- 172.21.15.2:0/3656854843 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f755015b4c0 0x7f75500cf6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:11.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.703+0000 7f7547e00640 1 -- 172.21.15.2:0/3656854843 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f755015b4c0 msgr2=0x7f75500cf6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:48:11.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.703+0000 7f7547e00640 1 --2- 172.21.15.2:0/3656854843 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f755015b4c0 0x7f75500cf6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:11.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.703+0000 7f7547e00640 1 -- 172.21.15.2:0/3656854843 >> v1:172.21.15.2:6789/0 conn(0x7f755006f5a0 legacy=0x7f75500ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:11.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.703+0000 7f7547e00640 1 -- 172.21.15.2:0/3656854843 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75500ad390 con 0x7f75500af590 2024-09-10T08:48:11.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.703+0000 7f754de00640 1 -- 172.21.15.2:0/3656854843 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 183076266 0 0) 0x7f75500af160 con 0x7f755006f5a0 2024-09-10T08:48:11.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.704+0000 7f7547e00640 1 --2- 172.21.15.2:0/3656854843 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75500af590 0x7f755006f060 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7538009870 tx=0x7f753802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bdb317bb7af2012 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:11.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.705+0000 7f754de00640 1 -- 172.21.15.2:0/3656854843 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7538037070 con 0x7f75500af590 2024-09-10T08:48:11.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.705+0000 7f754de00640 1 -- 172.21.15.2:0/3656854843 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7538032440 con 0x7f75500af590 2024-09-10T08:48:11.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.705+0000 7f754de00640 1 -- 172.21.15.2:0/3656854843 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7538032810 con 0x7f75500af590 2024-09-10T08:48:11.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.705+0000 7f7555400640 1 -- 172.21.15.2:0/3656854843 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75500af590 msgr2=0x7f755006f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:11.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.705+0000 7f7555400640 1 --2- 172.21.15.2:0/3656854843 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75500af590 0x7f755006f060 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7538009870 tx=0x7f753802a1c0 comp rx=0 tx=0).stop 2024-09-10T08:48:11.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.705+0000 7f7555400640 1 -- 172.21.15.2:0/3656854843 shutdown_connections 2024-09-10T08:48:11.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.705+0000 7f7555400640 1 --2- 172.21.15.2:0/3656854843 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f75500af590 0x7f755006f060 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:11.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.705+0000 7f7555400640 1 --2- 172.21.15.2:0/3656854843 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f755015b4c0 0x7f75500cf6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:11.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.705+0000 7f7555400640 1 -- 172.21.15.2:0/3656854843 >> 172.21.15.2:0/3656854843 conn(0x7f75500d02c0 msgr2=0x7f75500d06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:11.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.705+0000 7f7555400640 1 -- 172.21.15.2:0/3656854843 shutdown_connections 2024-09-10T08:48:11.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.705+0000 7f7555400640 1 -- 172.21.15.2:0/3656854843 wait complete. 2024-09-10T08:48:11.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.707+0000 7f7555400640 1 Processor -- start 2024-09-10T08:48:11.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.707+0000 7f7555400640 1 -- start start 2024-09-10T08:48:11.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.708+0000 7f7555400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f755006f5a0 0x7f7550149a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:11.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.708+0000 7f7555400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75500af590 0x7f75500739a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:11.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.708+0000 7f7555400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f755015b4c0 0x7f75501576c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:11.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.708+0000 7f7555400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f75500af9d0 con 0x7f755006f5a0 2024-09-10T08:48:11.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.708+0000 7f7555400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f755006fa10 con 0x7f75500af590 2024-09-10T08:48:11.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.708+0000 7f7555400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f75500ad950 con 0x7f755015b4c0 2024-09-10T08:48:11.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.708+0000 7f754e800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f755006f5a0 0x7f7550149a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:11.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.708+0000 7f754e800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f755006f5a0 0x7f7550149a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36056/0 (socket says 172.21.15.2:36056) 2024-09-10T08:48:11.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.708+0000 7f754e800640 1 -- 172.21.15.2:0/1666012439 learned_addr learned my addr 172.21.15.2:0/1666012439 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:11.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.709+0000 7f7547e00640 1 --2- 172.21.15.2:0/1666012439 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75500af590 0x7f75500739a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:11.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.709+0000 7f754f200640 1 --2- 172.21.15.2:0/1666012439 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f755015b4c0 0x7f75501576c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:11.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.709+0000 7f754e800640 1 -- 172.21.15.2:0/1666012439 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f755015b4c0 msgr2=0x7f75501576c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:11.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.709+0000 7f754e800640 1 --2- 172.21.15.2:0/1666012439 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f755015b4c0 0x7f75501576c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:11.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.709+0000 7f754e800640 1 -- 172.21.15.2:0/1666012439 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75500af590 msgr2=0x7f75500739a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:11.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.709+0000 7f754e800640 1 --2- 172.21.15.2:0/1666012439 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75500af590 0x7f75500739a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:11.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.709+0000 7f754e800640 1 -- 172.21.15.2:0/1666012439 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7550146970 con 0x7f755006f5a0 2024-09-10T08:48:11.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.709+0000 7f754e800640 1 --2- 172.21.15.2:0/1666012439 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f755006f5a0 0x7f7550149a30 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f754000e8a0 tx=0x7f754000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:11.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.709+0000 7f7546a00640 1 -- 172.21.15.2:0/1666012439 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7540017070 con 0x7f755006f5a0 2024-09-10T08:48:11.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.709+0000 7f7546a00640 1 -- 172.21.15.2:0/1666012439 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f754000c8e0 con 0x7f755006f5a0 2024-09-10T08:48:11.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.709+0000 7f7546a00640 1 -- 172.21.15.2:0/1666012439 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f754000ccd0 con 0x7f755006f5a0 2024-09-10T08:48:11.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.709+0000 7f7555400640 1 -- 172.21.15.2:0/1666012439 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7550146c50 con 0x7f755006f5a0 2024-09-10T08:48:11.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.710+0000 7f7555400640 1 -- 172.21.15.2:0/1666012439 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7550147210 con 0x7f755006f5a0 2024-09-10T08:48:11.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.711+0000 7f7555400640 1 -- 172.21.15.2:0/1666012439 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75500adc30 con 0x7f755006f5a0 2024-09-10T08:48:11.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.712+0000 7f7546a00640 1 -- 172.21.15.2:0/1666012439 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 10) ==== 90657+0+0 (secure 0 0 0) 0x7f754001a070 con 0x7f755006f5a0 2024-09-10T08:48:11.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.713+0000 7f7546a00640 1 --2- 172.21.15.2:0/1666012439 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7f752c06bfe0 0x7f752c06e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:11.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.713+0000 7f7546a00640 1 -- 172.21.15.2:0/1666012439 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6359+0+0 (secure 0 0 0) 0x7f754008b4c0 con 0x7f755006f5a0 2024-09-10T08:48:11.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.713+0000 7f7547e00640 1 -- 172.21.15.2:0/1666012439 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7f752c06bfe0 msgr2=0x7f752c06e4a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.155:6832/3369759420 2024-09-10T08:48:11.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.713+0000 7f7547e00640 1 --2- 172.21.15.2:0/1666012439 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7f752c06bfe0 0x7f752c06e4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:48:11.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.718+0000 7f7546a00640 1 -- 172.21.15.2:0/1666012439 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f75400593a0 con 0x7f755006f5a0 2024-09-10T08:48:11.807 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:48:11.807+0000 7f68143ef040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-10T08:48:11.828 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:48:11.828+0000 7fc2a191e040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-10T08:48:11.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.914+0000 7f7547e00640 1 -- 172.21.15.2:0/1666012439 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7f752c06bfe0 msgr2=0x7f752c06e4a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.155:6832/3369759420 2024-09-10T08:48:11.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.914+0000 7f7547e00640 1 --2- 172.21.15.2:0/1666012439 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7f752c06bfe0 0x7f752c06e4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:48:11.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.916+0000 7f7555400640 1 -- 172.21.15.2:0/1666012439 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f75500b3760 con 0x7f755006f5a0 2024-09-10T08:48:11.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.916+0000 7f7546a00640 1 -- 172.21.15.2:0/1666012439 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 6 entries v39) ==== 80+0+358 (secure 0 0 0) 0x7f754005d6a0 con 0x7f755006f5a0 2024-09-10T08:48:11.917 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.155:0/41896583 2024-09-11T08:48:07.142887+0000 2024-09-10T08:48:11.917 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.155:0/1305551464 2024-09-11T08:48:07.142887+0000 2024-09-10T08:48:11.917 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.155:0/3560911645 2024-09-11T08:48:07.142887+0000 2024-09-10T08:48:11.917 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.155:0/1872766231 2024-09-11T08:48:07.142887+0000 2024-09-10T08:48:11.917 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.155:6833/2611418382 2024-09-11T08:48:07.142887+0000 2024-09-10T08:48:11.917 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.155:6832/2611418382 2024-09-11T08:48:07.142887+0000 2024-09-10T08:48:11.917 INFO:teuthology.orchestra.run.smithi002.stderr:listed 6 entries 2024-09-10T08:48:11.918 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:48:11.917+0000 7f68143ef040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-10T08:48:11.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.918+0000 7f7555400640 1 -- 172.21.15.2:0/1666012439 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7f752c06bfe0 msgr2=0x7f752c06e4a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:48:11.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.918+0000 7f7555400640 1 --2- 172.21.15.2:0/1666012439 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7f752c06bfe0 0x7f752c06e4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:11.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.918+0000 7f7555400640 1 -- 172.21.15.2:0/1666012439 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f755006f5a0 msgr2=0x7f7550149a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:11.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.918+0000 7f7555400640 1 --2- 172.21.15.2:0/1666012439 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f755006f5a0 0x7f7550149a30 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f754000e8a0 tx=0x7f754000ed60 comp rx=0 tx=0).stop 2024-09-10T08:48:11.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.918+0000 7f7555400640 1 -- 172.21.15.2:0/1666012439 shutdown_connections 2024-09-10T08:48:11.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.918+0000 7f7555400640 1 --2- 172.21.15.2:0/1666012439 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7f752c06bfe0 0x7f752c06e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:11.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.918+0000 7f7555400640 1 --2- 172.21.15.2:0/1666012439 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f755015b4c0 0x7f75501576c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:11.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.918+0000 7f7555400640 1 --2- 172.21.15.2:0/1666012439 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75500af590 0x7f75500739a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:11.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.918+0000 7f7555400640 1 --2- 172.21.15.2:0/1666012439 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f755006f5a0 0x7f7550149a30 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:11.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.918+0000 7f7555400640 1 -- 172.21.15.2:0/1666012439 >> 172.21.15.2:0/1666012439 conn(0x7f75500d02c0 msgr2=0x7f75500cea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:11.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.919+0000 7f7555400640 1 -- 172.21.15.2:0/1666012439 shutdown_connections 2024-09-10T08:48:11.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:11.919+0000 7f7555400640 1 -- 172.21.15.2:0/1666012439 wait complete. 2024-09-10T08:48:11.934 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-10T08:48:11.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:48:11.935 DEBUG:teuthology.orchestra.run.smithi002:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-10T08:48:11.945 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:48:11.945+0000 7fc2a191e040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-10T08:48:12.002 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi002.front.sepia.ceph.com 2024-09-10T08:48:12.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:48:12.002 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-10T08:48:12.080 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T08:48:12.080 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-10T08:48:12.081 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:48:12.117 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052629,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T08:48:12.117 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T08:48:12.117 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T08:48:12.117 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:48:12.156 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T08:48:12.156 INFO:tasks.cephfs.mount:Terminating background process 2024-09-10T08:48:12.156 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-10T08:48:12.156 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:48:12.192 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052629,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T08:48:12.193 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:48:12.228 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:48:12.227+0000 7f68143ef040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-10T08:48:12.270 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:48:12.270+0000 7fc2a191e040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-10T08:48:12.281 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:48:12.280+0000 7f68143ef040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-10T08:48:12.325 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:48:12.325+0000 7fc2a191e040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-10T08:48:12.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.354+0000 7f27b9c00640 1 Processor -- start 2024-09-10T08:48:12.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.354+0000 7f27b9c00640 1 -- start start 2024-09-10T08:48:12.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.355+0000 7f27b9c00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f27b415e6b0 0x7f27b40d4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:12.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.355+0000 7f27b9c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27b40d32b0 0x7f27b40cf7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:12.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.356+0000 7f27b9c00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27b40d1120 con 0x7f27b40d5210 2024-09-10T08:48:12.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.356+0000 7f27b9c00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f27b40d1a50 con 0x7f27b415e6b0 2024-09-10T08:48:12.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.356+0000 7f27b9c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f27b40d1400 con 0x7f27b40d32b0 2024-09-10T08:48:12.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.356+0000 7f27b2a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f27b415e6b0 0x7f27b40d4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:12.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.356+0000 7f27abe00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f27b40d5210 0x7f27b40d2ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:60092/0 (socket says 172.21.15.2:60092) 2024-09-10T08:48:12.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.356+0000 7f27abe00640 1 -- 172.21.15.2:0/4239693685 learned_addr learned my addr 172.21.15.2:0/4239693685 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:48:12.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.356+0000 7f27b3400640 1 --2- 172.21.15.2:0/4239693685 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27b40d32b0 0x7f27b40cf7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:12.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.356+0000 7f27b2a00640 1 -- 172.21.15.2:0/4239693685 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27b40d32b0 msgr2=0x7f27b40cf7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:48:12.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.356+0000 7f27b2a00640 1 --2- 172.21.15.2:0/4239693685 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27b40d32b0 0x7f27b40cf7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:12.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.356+0000 7f27b2a00640 1 -- 172.21.15.2:0/4239693685 >> v1:172.21.15.2:6789/0 conn(0x7f27b40d5210 legacy=0x7f27b40d2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:12.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.356+0000 7f27b2a00640 1 -- 172.21.15.2:0/4239693685 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27b40d16e0 con 0x7f27b415e6b0 2024-09-10T08:48:12.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.356+0000 7f27b2000640 1 -- 172.21.15.2:0/4239693685 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2529893382 0 0) 0x7f27b40d1120 con 0x7f27b40d5210 2024-09-10T08:48:12.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.356+0000 7f27b3400640 1 --2- 172.21.15.2:0/4239693685 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27b40d32b0 0x7f27b40cf7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:48:12.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.357+0000 7f27b2a00640 1 --2- 172.21.15.2:0/4239693685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27b415e6b0 0x7f27b40d4cd0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f27a40097a0 tx=0x7f27a402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=582451d49060c5ef server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:12.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.358+0000 7f27b2000640 1 -- 172.21.15.2:0/4239693685 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a4037070 con 0x7f27b415e6b0 2024-09-10T08:48:12.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.358+0000 7f27b2000640 1 -- 172.21.15.2:0/4239693685 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27a402ae50 con 0x7f27b415e6b0 2024-09-10T08:48:12.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.358+0000 7f27b2000640 1 -- 172.21.15.2:0/4239693685 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a4032660 con 0x7f27b415e6b0 2024-09-10T08:48:12.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.358+0000 7f27b9c00640 1 -- 172.21.15.2:0/4239693685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27b415e6b0 msgr2=0x7f27b40d4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:12.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.358+0000 7f27b9c00640 1 --2- 172.21.15.2:0/4239693685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27b415e6b0 0x7f27b40d4cd0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f27a40097a0 tx=0x7f27a402a100 comp rx=0 tx=0).stop 2024-09-10T08:48:12.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.358+0000 7f27b9c00640 1 -- 172.21.15.2:0/4239693685 shutdown_connections 2024-09-10T08:48:12.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.358+0000 7f27b9c00640 1 --2- 172.21.15.2:0/4239693685 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27b40d32b0 0x7f27b40cf7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:12.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.358+0000 7f27b9c00640 1 --2- 172.21.15.2:0/4239693685 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27b415e6b0 0x7f27b40d4cd0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:12.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.358+0000 7f27b9c00640 1 -- 172.21.15.2:0/4239693685 >> 172.21.15.2:0/4239693685 conn(0x7f27b408bfd0 msgr2=0x7f27b40d45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:12.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.358+0000 7f27b9c00640 1 -- 172.21.15.2:0/4239693685 shutdown_connections 2024-09-10T08:48:12.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.358+0000 7f27b9c00640 1 -- 172.21.15.2:0/4239693685 wait complete. 2024-09-10T08:48:12.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.361+0000 7f27b9c00640 1 Processor -- start 2024-09-10T08:48:12.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.361+0000 7f27b9c00640 1 -- start start 2024-09-10T08:48:12.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.363+0000 7f27b9c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27b40d32b0 0x7f27b4154930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:12.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.363+0000 7f27b9c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27b40d5210 0x7f27b40cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:12.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.363+0000 7f27b9c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27b415e6b0 0x7f27b40ce250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:12.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.363+0000 7f27b9c00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f27b40d0db0 con 0x7f27b40d32b0 2024-09-10T08:48:12.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.363+0000 7f27b9c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f27b40cf210 con 0x7f27b415e6b0 2024-09-10T08:48:12.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.363+0000 7f27b9c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f27b406ce60 con 0x7f27b40d5210 2024-09-10T08:48:12.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.363+0000 7f27b2a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27b40d32b0 0x7f27b4154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:12.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.363+0000 7f27b2a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27b40d32b0 0x7f27b4154930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36074/0 (socket says 172.21.15.2:36074) 2024-09-10T08:48:12.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.363+0000 7f27b2a00640 1 -- 172.21.15.2:0/3903760498 learned_addr learned my addr 172.21.15.2:0/3903760498 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:12.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.363+0000 7f27abe00640 1 --2- 172.21.15.2:0/3903760498 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27b40d5210 0x7f27b40cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:12.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.363+0000 7f27b3400640 1 --2- 172.21.15.2:0/3903760498 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27b415e6b0 0x7f27b40ce250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:12.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.363+0000 7f27b2a00640 1 -- 172.21.15.2:0/3903760498 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27b40d5210 msgr2=0x7f27b40cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:12.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.363+0000 7f27b2a00640 1 --2- 172.21.15.2:0/3903760498 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27b40d5210 0x7f27b40cdd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:12.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.363+0000 7f27b2a00640 1 -- 172.21.15.2:0/3903760498 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27b415e6b0 msgr2=0x7f27b40ce250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:12.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.363+0000 7f27b2a00640 1 --2- 172.21.15.2:0/3903760498 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27b415e6b0 0x7f27b40ce250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:12.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.364+0000 7f27b2a00640 1 -- 172.21.15.2:0/3903760498 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27b40b6100 con 0x7f27b40d32b0 2024-09-10T08:48:12.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.364+0000 7f27b3400640 1 --2- 172.21.15.2:0/3903760498 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27b415e6b0 0x7f27b40ce250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:48:12.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.364+0000 7f27b2a00640 1 --2- 172.21.15.2:0/3903760498 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27b40d32b0 0x7f27b4154930 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f27a40098c0 tx=0x7f27a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:12.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.364+0000 7f27aaa00640 1 -- 172.21.15.2:0/3903760498 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a4041030 con 0x7f27b40d32b0 2024-09-10T08:48:12.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.364+0000 7f27aaa00640 1 -- 172.21.15.2:0/3903760498 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27a402ac50 con 0x7f27b40d32b0 2024-09-10T08:48:12.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.364+0000 7f27aaa00640 1 -- 172.21.15.2:0/3903760498 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a4037040 con 0x7f27b40d32b0 2024-09-10T08:48:12.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.364+0000 7f27b9c00640 1 -- 172.21.15.2:0/3903760498 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27b40b63e0 con 0x7f27b40d32b0 2024-09-10T08:48:12.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.364+0000 7f27b9c00640 1 -- 172.21.15.2:0/3903760498 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27b40b69a0 con 0x7f27b40d32b0 2024-09-10T08:48:12.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.365+0000 7f27b9c00640 1 -- 172.21.15.2:0/3903760498 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27b40d4cd0 con 0x7f27b40d32b0 2024-09-10T08:48:12.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.366+0000 7f27aaa00640 1 -- 172.21.15.2:0/3903760498 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 10) ==== 90657+0+0 (secure 0 0 0) 0x7f27a4044070 con 0x7f27b40d32b0 2024-09-10T08:48:12.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.368+0000 7f27aaa00640 1 --2- 172.21.15.2:0/3903760498 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7f279006bfe0 0x7f279006e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:12.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.368+0000 7f27abe00640 1 -- 172.21.15.2:0/3903760498 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7f279006bfe0 msgr2=0x7f279006e4a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.155:6832/3369759420 2024-09-10T08:48:12.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.368+0000 7f27aaa00640 1 -- 172.21.15.2:0/3903760498 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6359+0+0 (secure 0 0 0) 0x7f27a40aba70 con 0x7f27b40d32b0 2024-09-10T08:48:12.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.368+0000 7f27abe00640 1 --2- 172.21.15.2:0/3903760498 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7f279006bfe0 0x7f279006e4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:48:12.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.372+0000 7f27aaa00640 1 -- 172.21.15.2:0/3903760498 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f27a4079f90 con 0x7f27b40d32b0 2024-09-10T08:48:12.413 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:48:12.413+0000 7f68143ef040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-10T08:48:12.469 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:48:12.469+0000 7fc2a191e040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-10T08:48:12.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.569+0000 7f27abe00640 1 -- 172.21.15.2:0/3903760498 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7f279006bfe0 msgr2=0x7f279006e4a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.155:6832/3369759420 2024-09-10T08:48:12.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.569+0000 7f27abe00640 1 --2- 172.21.15.2:0/3903760498 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7f279006bfe0 0x7f279006e4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:48:12.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.594+0000 7f27b9c00640 1 -- 172.21.15.2:0/3903760498 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f27b40b8790 con 0x7f27b40d32b0 2024-09-10T08:48:12.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.595+0000 7f27aaa00640 1 -- 172.21.15.2:0/3903760498 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5217 (secure 0 0 0) 0x7f27a4079890 con 0x7f27b40d32b0 2024-09-10T08:48:12.595 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:48:12.595 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":18,"btime":"2024-09-10T08:47:57:038981+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4634,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3082437117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3082437117},{"type":"v1","addr":"172.21.15.155:6837","nonce":3082437117}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4816,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/3193521843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3193521843},{"type":"v1","addr":"172.21.15.2:6834","nonce":3193521843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4822,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/164428463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":164428463},{"type":"v1","addr":"172.21.15.155:6836","nonce":164428463}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:47:53.446893+0000","modified":"2024-09-10T08:47:56.462174+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4824},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4824":{"gid":4824,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6835/464022930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":464022930},{"type":"v1","addr":"172.21.15.2:6835","nonce":464022930}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4824,"qdb_cluster":[4824]},"id":2}]} 2024-09-10T08:48:12.596 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 18 2024-09-10T08:48:12.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.597+0000 7f27b9c00640 1 -- 172.21.15.2:0/3903760498 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7f279006bfe0 msgr2=0x7f279006e4a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:48:12.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.597+0000 7f27b9c00640 1 --2- 172.21.15.2:0/3903760498 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7f279006bfe0 0x7f279006e4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:12.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.597+0000 7f27b9c00640 1 -- 172.21.15.2:0/3903760498 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27b40d32b0 msgr2=0x7f27b4154930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:12.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.597+0000 7f27b9c00640 1 --2- 172.21.15.2:0/3903760498 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27b40d32b0 0x7f27b4154930 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f27a40098c0 tx=0x7f27a40046c0 comp rx=0 tx=0).stop 2024-09-10T08:48:12.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.597+0000 7f27b9c00640 1 -- 172.21.15.2:0/3903760498 shutdown_connections 2024-09-10T08:48:12.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.597+0000 7f27b9c00640 1 --2- 172.21.15.2:0/3903760498 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7f279006bfe0 0x7f279006e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:12.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.597+0000 7f27b9c00640 1 --2- 172.21.15.2:0/3903760498 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27b415e6b0 0x7f27b40ce250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:12.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.597+0000 7f27b9c00640 1 --2- 172.21.15.2:0/3903760498 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27b40d5210 0x7f27b40cdd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:12.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.597+0000 7f27b9c00640 1 --2- 172.21.15.2:0/3903760498 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f27b40d32b0 0x7f27b4154930 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:12.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.597+0000 7f27b9c00640 1 -- 172.21.15.2:0/3903760498 >> 172.21.15.2:0/3903760498 conn(0x7f27b408bfd0 msgr2=0x7f27b415ece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:12.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.597+0000 7f27b9c00640 1 -- 172.21.15.2:0/3903760498 shutdown_connections 2024-09-10T08:48:12.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.598+0000 7f27b9c00640 1 -- 172.21.15.2:0/3903760498 wait complete. 2024-09-10T08:48:12.614 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:48:12.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.772+0000 7f4b13c00640 1 Processor -- start 2024-09-10T08:48:12.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.772+0000 7f4b13c00640 1 -- start start 2024-09-10T08:48:12.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.773+0000 7f4b13c00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4b0c06ce60 0x7f4b0c0d2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:12.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.773+0000 7f4b13c00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4b0c0d30e0 0x7f4b0c0cf7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:12.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.773+0000 7f4b13c00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b0c0d1120 con 0x7f4b0c15e6b0 2024-09-10T08:48:12.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.774+0000 7f4b13c00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f4b0c0d3550 con 0x7f4b0c0d30e0 2024-09-10T08:48:12.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.774+0000 7f4b13c00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f4b0c0d1a50 con 0x7f4b0c06ce60 2024-09-10T08:48:12.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.774+0000 7f4b11c00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4b0c0d30e0 0x7f4b0c0cf7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:12.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.774+0000 7f4b11c00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4b0c0d30e0 0x7f4b0c0cf7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36078/0 (socket says 172.21.15.2:36078) 2024-09-10T08:48:12.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.774+0000 7f4b11c00640 1 -- 172.21.15.2:0/1539366240 learned_addr learned my addr 172.21.15.2:0/1539366240 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:12.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.774+0000 7f4b0be00640 1 --2- 172.21.15.2:0/1539366240 >> v2:172.21.15.155:3300/0 conn(0x7f4b0c06ce60 0x7f4b0c0d2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:12.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.774+0000 7f4b11c00640 1 -- 172.21.15.2:0/1539366240 >> v2:172.21.15.155:3300/0 conn(0x7f4b0c06ce60 msgr2=0x7f4b0c0d2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:48:12.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.774+0000 7f4b11c00640 1 --2- 172.21.15.2:0/1539366240 >> v2:172.21.15.155:3300/0 conn(0x7f4b0c06ce60 0x7f4b0c0d2ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:12.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.774+0000 7f4b11c00640 1 -- 172.21.15.2:0/1539366240 >> v1:172.21.15.155:6789/0 conn(0x7f4b0c15e6b0 legacy=0x7f4b0c0d4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:12.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.774+0000 7f4b11c00640 1 -- 172.21.15.2:0/1539366240 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b0c0d1400 con 0x7f4b0c0d30e0 2024-09-10T08:48:12.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.775+0000 7f4b11c00640 1 --2- 172.21.15.2:0/1539366240 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b0c0d30e0 0x7f4b0c0cf7a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c0c7c40 tx=0x7f4b0402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bcd011f70d7dcf6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:12.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.776+0000 7f4b0b400640 1 -- 172.21.15.2:0/1539366240 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b04036070 con 0x7f4b0c0d30e0 2024-09-10T08:48:12.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.776+0000 7f4b0b400640 1 -- 172.21.15.2:0/1539366240 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b04031600 con 0x7f4b0c0d30e0 2024-09-10T08:48:12.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.776+0000 7f4b0b400640 1 -- 172.21.15.2:0/1539366240 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b040319d0 con 0x7f4b0c0d30e0 2024-09-10T08:48:12.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.776+0000 7f4b13c00640 1 -- 172.21.15.2:0/1539366240 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b0c0d30e0 msgr2=0x7f4b0c0cf7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:12.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.776+0000 7f4b13c00640 1 --2- 172.21.15.2:0/1539366240 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b0c0d30e0 0x7f4b0c0cf7a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c0c7c40 tx=0x7f4b0402a6a0 comp rx=0 tx=0).stop 2024-09-10T08:48:12.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.777+0000 7f4b13c00640 1 -- 172.21.15.2:0/1539366240 shutdown_connections 2024-09-10T08:48:12.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.777+0000 7f4b13c00640 1 --2- 172.21.15.2:0/1539366240 >> v2:172.21.15.155:3300/0 conn(0x7f4b0c06ce60 0x7f4b0c0d2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:12.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.777+0000 7f4b13c00640 1 --2- 172.21.15.2:0/1539366240 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b0c0d30e0 0x7f4b0c0cf7a0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:12.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.777+0000 7f4b13c00640 1 -- 172.21.15.2:0/1539366240 >> 172.21.15.2:0/1539366240 conn(0x7f4b0c08bfd0 msgr2=0x7f4b0c0d45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:12.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.777+0000 7f4b13c00640 1 -- 172.21.15.2:0/1539366240 shutdown_connections 2024-09-10T08:48:12.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.777+0000 7f4b13c00640 1 -- 172.21.15.2:0/1539366240 wait complete. 2024-09-10T08:48:12.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.779+0000 7f4b13c00640 1 Processor -- start 2024-09-10T08:48:12.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.779+0000 7f4b13c00640 1 -- start start 2024-09-10T08:48:12.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.780+0000 7f4b13c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4b0c06ce60 0x7f4b0c0c7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:12.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.780+0000 7f4b13c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4b0c0d30e0 0x7f4b0c154730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:12.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.780+0000 7f4b13c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b0c15e6b0 0x7f4b0c160710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:12.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.780+0000 7f4b13c00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f4b0c0cf210 con 0x7f4b0c15e6b0 2024-09-10T08:48:12.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.780+0000 7f4b13c00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4b0c15ea90 con 0x7f4b0c06ce60 2024-09-10T08:48:12.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.780+0000 7f4b13c00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f4b0c0d53e0 con 0x7f4b0c0d30e0 2024-09-10T08:48:12.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.780+0000 7f4b11c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b0c15e6b0 0x7f4b0c160710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:12.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.780+0000 7f4b11c00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b0c15e6b0 0x7f4b0c160710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36084/0 (socket says 172.21.15.2:36084) 2024-09-10T08:48:12.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.780+0000 7f4b11c00640 1 -- 172.21.15.2:0/970784064 learned_addr learned my addr 172.21.15.2:0/970784064 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:12.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.780+0000 7f4b11200640 1 --2- 172.21.15.2:0/970784064 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4b0c06ce60 0x7f4b0c0c7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:12.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.780+0000 7f4b0be00640 1 --2- 172.21.15.2:0/970784064 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4b0c0d30e0 0x7f4b0c154730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:12.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.781+0000 7f4b11c00640 1 -- 172.21.15.2:0/970784064 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4b0c0d30e0 msgr2=0x7f4b0c154730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:12.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.781+0000 7f4b11c00640 1 --2- 172.21.15.2:0/970784064 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4b0c0d30e0 0x7f4b0c154730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:12.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.781+0000 7f4b11c00640 1 -- 172.21.15.2:0/970784064 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4b0c06ce60 msgr2=0x7f4b0c0c7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:12.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.781+0000 7f4b11c00640 1 --2- 172.21.15.2:0/970784064 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4b0c06ce60 0x7f4b0c0c7e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:12.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.781+0000 7f4b11c00640 1 -- 172.21.15.2:0/970784064 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b0c156930 con 0x7f4b0c15e6b0 2024-09-10T08:48:12.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.781+0000 7f4b11200640 1 --2- 172.21.15.2:0/970784064 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4b0c06ce60 0x7f4b0c0c7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:48:12.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.781+0000 7f4b11c00640 1 --2- 172.21.15.2:0/970784064 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b0c15e6b0 0x7f4b0c160710 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f4b0402ac90 tx=0x7f4b04004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:12.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.781+0000 7f4b08c00640 1 -- 172.21.15.2:0/970784064 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b0403f020 con 0x7f4b0c15e6b0 2024-09-10T08:48:12.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.781+0000 7f4b08c00640 1 -- 172.21.15.2:0/970784064 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b04037040 con 0x7f4b0c15e6b0 2024-09-10T08:48:12.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.781+0000 7f4b08c00640 1 -- 172.21.15.2:0/970784064 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b04036070 con 0x7f4b0c15e6b0 2024-09-10T08:48:12.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.781+0000 7f4b13c00640 1 -- 172.21.15.2:0/970784064 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b0c0b56f0 con 0x7f4b0c15e6b0 2024-09-10T08:48:12.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.781+0000 7f4b13c00640 1 -- 172.21.15.2:0/970784064 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b0c0b5cb0 con 0x7f4b0c15e6b0 2024-09-10T08:48:12.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.783+0000 7f4b13c00640 1 -- 172.21.15.2:0/970784064 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b0c0b5eb0 con 0x7f4b0c15e6b0 2024-09-10T08:48:12.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.784+0000 7f4b08c00640 1 -- 172.21.15.2:0/970784064 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 10) ==== 90657+0+0 (secure 0 0 0) 0x7f4b04042020 con 0x7f4b0c15e6b0 2024-09-10T08:48:12.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.784+0000 7f4b08c00640 1 --2- 172.21.15.2:0/970784064 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7f4aec06bfe0 0x7f4aec06e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:12.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.785+0000 7f4b08c00640 1 -- 172.21.15.2:0/970784064 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6359+0+0 (secure 0 0 0) 0x7f4b040abb50 con 0x7f4b0c15e6b0 2024-09-10T08:48:12.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.785+0000 7f4b11200640 1 -- 172.21.15.2:0/970784064 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7f4aec06bfe0 msgr2=0x7f4aec06e4a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.155:6832/3369759420 2024-09-10T08:48:12.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.785+0000 7f4b11200640 1 --2- 172.21.15.2:0/970784064 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7f4aec06bfe0 0x7f4aec06e4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:48:12.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.789+0000 7f4b08c00640 1 -- 172.21.15.2:0/970784064 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4b0c0b5eb0 con 0x7f4b0c15e6b0 2024-09-10T08:48:12.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.986+0000 7f4b11200640 1 -- 172.21.15.2:0/970784064 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7f4aec06bfe0 msgr2=0x7f4aec06e4a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.155:6832/3369759420 2024-09-10T08:48:12.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:12.986+0000 7f4b11200640 1 --2- 172.21.15.2:0/970784064 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7f4aec06bfe0 0x7f4aec06e4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:48:13.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.012+0000 7f4b13c00640 1 -- 172.21.15.2:0/970784064 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4b0c0d0db0 con 0x7f4b0c15e6b0 2024-09-10T08:48:13.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.013+0000 7f4b08c00640 1 -- 172.21.15.2:0/970784064 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5217 (secure 0 0 0) 0x7f4b04049020 con 0x7f4b0c15e6b0 2024-09-10T08:48:13.013 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:48:13.013 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":18,"btime":"2024-09-10T08:47:57:038981+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4634,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3082437117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3082437117},{"type":"v1","addr":"172.21.15.155:6837","nonce":3082437117}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4816,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/3193521843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3193521843},{"type":"v1","addr":"172.21.15.2:6834","nonce":3193521843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4822,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/164428463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":164428463},{"type":"v1","addr":"172.21.15.155:6836","nonce":164428463}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:47:53.446893+0000","modified":"2024-09-10T08:47:56.462174+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4824},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4824":{"gid":4824,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6835/464022930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":464022930},{"type":"v1","addr":"172.21.15.2:6835","nonce":464022930}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4824,"qdb_cluster":[4824]},"id":2}]} 2024-09-10T08:48:13.014 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 18 2024-09-10T08:48:13.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.015+0000 7f4b13c00640 1 -- 172.21.15.2:0/970784064 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7f4aec06bfe0 msgr2=0x7f4aec06e4a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:48:13.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.015+0000 7f4b13c00640 1 --2- 172.21.15.2:0/970784064 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7f4aec06bfe0 0x7f4aec06e4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:13.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.015+0000 7f4b13c00640 1 -- 172.21.15.2:0/970784064 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b0c15e6b0 msgr2=0x7f4b0c160710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:13.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.015+0000 7f4b13c00640 1 --2- 172.21.15.2:0/970784064 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b0c15e6b0 0x7f4b0c160710 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f4b0402ac90 tx=0x7f4b04004a40 comp rx=0 tx=0).stop 2024-09-10T08:48:13.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.015+0000 7f4b13c00640 1 -- 172.21.15.2:0/970784064 shutdown_connections 2024-09-10T08:48:13.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.015+0000 7f4b13c00640 1 --2- 172.21.15.2:0/970784064 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7f4aec06bfe0 0x7f4aec06e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:13.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.015+0000 7f4b13c00640 1 --2- 172.21.15.2:0/970784064 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b0c15e6b0 0x7f4b0c160710 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:13.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.015+0000 7f4b13c00640 1 --2- 172.21.15.2:0/970784064 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4b0c0d30e0 0x7f4b0c154730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:13.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.015+0000 7f4b13c00640 1 --2- 172.21.15.2:0/970784064 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4b0c06ce60 0x7f4b0c0c7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:13.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.015+0000 7f4b13c00640 1 -- 172.21.15.2:0/970784064 >> 172.21.15.2:0/970784064 conn(0x7f4b0c08bfd0 msgr2=0x7f4b0c0d2040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:13.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.016+0000 7f4b13c00640 1 -- 172.21.15.2:0/970784064 shutdown_connections 2024-09-10T08:48:13.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.016+0000 7f4b13c00640 1 -- 172.21.15.2:0/970784064 wait complete. 2024-09-10T08:48:13.032 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:48:13.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.193+0000 7f18a0800640 1 Processor -- start 2024-09-10T08:48:13.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.193+0000 7f18a0800640 1 -- start start 2024-09-10T08:48:13.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.194+0000 7f18a0800640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f18980cd460 0x7f189815c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:13.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.194+0000 7f18a0800640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f189806e4d0 con 0x7f189806df80 2024-09-10T08:48:13.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.194+0000 7f18a0800640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f189806e7b0 con 0x7f1898145d20 2024-09-10T08:48:13.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.194+0000 7f18a0800640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f1898146100 con 0x7f18980cd460 2024-09-10T08:48:13.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.195+0000 7f189e800640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f189806df80 0x7f18980ceb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:60094/0 (socket says 172.21.15.2:60094) 2024-09-10T08:48:13.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.195+0000 7f189e800640 1 -- 172.21.15.2:0/1669990238 learned_addr learned my addr 172.21.15.2:0/1669990238 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:48:13.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.195+0000 7f189d400640 1 --2- 172.21.15.2:0/1669990238 >> v2:172.21.15.155:3300/0 conn(0x7f18980cd460 0x7f189815c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:13.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.195+0000 7f189ca00640 1 -- 172.21.15.2:0/1669990238 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3558473465 0 0) 0x7f189806e4d0 con 0x7f189806df80 2024-09-10T08:48:13.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.195+0000 7f189ca00640 1 -- 172.21.15.2:0/1669990238 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1880003520 con 0x7f189806df80 2024-09-10T08:48:13.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.195+0000 7f189ca00640 1 -- 172.21.15.2:0/1669990238 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1194230249 0 0) 0x7f189806e7b0 con 0x7f1898145d20 2024-09-10T08:48:13.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.195+0000 7f189d400640 1 -- 172.21.15.2:0/1669990238 >> v1:172.21.15.155:6789/0 conn(0x7f1898145d20 legacy=0x7f18980ccd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:13.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.195+0000 7f189d400640 1 -- 172.21.15.2:0/1669990238 >> v1:172.21.15.2:6789/0 conn(0x7f189806df80 legacy=0x7f18980ceb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:13.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.195+0000 7f189d400640 1 -- 172.21.15.2:0/1669990238 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f189806ea90 con 0x7f18980cd460 2024-09-10T08:48:13.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.196+0000 7f189d400640 1 --2- 172.21.15.2:0/1669990238 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18980cd460 0x7f189815c9e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f18880097a0 tx=0x7f188802a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9fb2822c0238d5b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:13.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.197+0000 7f189ca00640 1 -- 172.21.15.2:0/1669990238 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1888037070 con 0x7f18980cd460 2024-09-10T08:48:13.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.197+0000 7f189ca00640 1 -- 172.21.15.2:0/1669990238 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1888032440 con 0x7f18980cd460 2024-09-10T08:48:13.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.197+0000 7f189ca00640 1 -- 172.21.15.2:0/1669990238 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f188802ae60 con 0x7f18980cd460 2024-09-10T08:48:13.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.197+0000 7f18a0800640 1 -- 172.21.15.2:0/1669990238 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18980cd460 msgr2=0x7f189815c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:13.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.197+0000 7f18a0800640 1 --2- 172.21.15.2:0/1669990238 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18980cd460 0x7f189815c9e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f18880097a0 tx=0x7f188802a110 comp rx=0 tx=0).stop 2024-09-10T08:48:13.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.198+0000 7f18a0800640 1 -- 172.21.15.2:0/1669990238 shutdown_connections 2024-09-10T08:48:13.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.198+0000 7f18a0800640 1 --2- 172.21.15.2:0/1669990238 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18980cd460 0x7f189815c9e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:13.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.198+0000 7f18a0800640 1 -- 172.21.15.2:0/1669990238 >> 172.21.15.2:0/1669990238 conn(0x7f189806bc10 msgr2=0x7f189806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:13.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.198+0000 7f18a0800640 1 -- 172.21.15.2:0/1669990238 shutdown_connections 2024-09-10T08:48:13.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.198+0000 7f18a0800640 1 -- 172.21.15.2:0/1669990238 wait complete. 2024-09-10T08:48:13.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.199+0000 7f18a0800640 1 Processor -- start 2024-09-10T08:48:13.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.200+0000 7f18a0800640 1 -- start start 2024-09-10T08:48:13.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.200+0000 7f18a0800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f189806df80 0x7f18981f4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:13.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.200+0000 7f18a0800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f18980cd460 0x7f189813dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:13.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.201+0000 7f18a0800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1898145d20 0x7f189813e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:13.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.201+0000 7f18a0800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1898160980 con 0x7f1898145d20 2024-09-10T08:48:13.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.201+0000 7f18a0800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f18980ce6b0 con 0x7f189806df80 2024-09-10T08:48:13.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.201+0000 7f18a0800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1898160b00 con 0x7f18980cd460 2024-09-10T08:48:13.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.201+0000 7f189e800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1898145d20 0x7f189813e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:13.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.201+0000 7f189de00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f189806df80 0x7f18981f4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:13.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.201+0000 7f189d400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f18980cd460 0x7f189813dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:13.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.201+0000 7f189d400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f18980cd460 0x7f189813dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.2:46000/0 (socket says 172.21.15.2:46000) 2024-09-10T08:48:13.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.201+0000 7f189de00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f189806df80 0x7f18981f4810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.2:52586/0 (socket says 172.21.15.2:52586) 2024-09-10T08:48:13.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.201+0000 7f189d400640 1 -- 172.21.15.2:0/4167653290 learned_addr learned my addr 172.21.15.2:0/4167653290 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:13.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.201+0000 7f189e800640 1 --2- 172.21.15.2:0/4167653290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1898145d20 0x7f189813e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36090/0 (socket says 172.21.15.2:36090) 2024-09-10T08:48:13.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.201+0000 7f189de00640 1 -- 172.21.15.2:0/4167653290 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f18980cd460 msgr2=0x7f189813dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:13.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.201+0000 7f189de00640 1 --2- 172.21.15.2:0/4167653290 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f18980cd460 0x7f189813dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:13.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.201+0000 7f189de00640 1 -- 172.21.15.2:0/4167653290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1898145d20 msgr2=0x7f189813e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:13.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.201+0000 7f189de00640 1 --2- 172.21.15.2:0/4167653290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1898145d20 0x7f189813e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:13.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.201+0000 7f189de00640 1 -- 172.21.15.2:0/4167653290 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18981f3da0 con 0x7f189806df80 2024-09-10T08:48:13.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.202+0000 7f189de00640 1 --2- 172.21.15.2:0/4167653290 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f189806df80 0x7f18981f4810 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f188c00c3e0 tx=0x7f188c00c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:13.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.202+0000 7f1892000640 1 -- 172.21.15.2:0/4167653290 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f188c017070 con 0x7f189806df80 2024-09-10T08:48:13.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.202+0000 7f1892000640 1 -- 172.21.15.2:0/4167653290 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f188c0035f0 con 0x7f189806df80 2024-09-10T08:48:13.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.202+0000 7f1892000640 1 -- 172.21.15.2:0/4167653290 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f188c0039e0 con 0x7f189806df80 2024-09-10T08:48:13.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.202+0000 7f18a0800640 1 -- 172.21.15.2:0/4167653290 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f189813f140 con 0x7f189806df80 2024-09-10T08:48:13.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.202+0000 7f18a0800640 1 -- 172.21.15.2:0/4167653290 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f189813e920 con 0x7f189806df80 2024-09-10T08:48:13.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.203+0000 7f18a0800640 1 -- 172.21.15.2:0/4167653290 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f189815c9e0 con 0x7f189806df80 2024-09-10T08:48:13.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.204+0000 7f1892000640 1 -- 172.21.15.2:0/4167653290 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 10) ==== 90657+0+0 (secure 0 0 0) 0x7f188c01a070 con 0x7f189806df80 2024-09-10T08:48:13.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.205+0000 7f1892000640 1 --2- 172.21.15.2:0/4167653290 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7f187c06bfe0 0x7f187c06e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:13.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.205+0000 7f1892000640 1 -- 172.21.15.2:0/4167653290 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6359+0+0 (secure 0 0 0) 0x7f188c08a770 con 0x7f189806df80 2024-09-10T08:48:13.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.205+0000 7f189d400640 1 -- 172.21.15.2:0/4167653290 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7f187c06bfe0 msgr2=0x7f187c06e4a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.155:6832/3369759420 2024-09-10T08:48:13.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.205+0000 7f189d400640 1 --2- 172.21.15.2:0/4167653290 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7f187c06bfe0 0x7f187c06e4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:48:13.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.210+0000 7f1892000640 1 -- 172.21.15.2:0/4167653290 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f188c058520 con 0x7f189806df80 2024-09-10T08:48:13.281 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:48:13.281+0000 7f68143ef040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-10T08:48:13.332 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:48:13.332+0000 7f68143ef040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-10T08:48:13.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.397+0000 7f18a0800640 1 -- 172.21.15.2:0/4167653290 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f189806f170 con 0x7f189806df80 2024-09-10T08:48:13.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.399+0000 7f1892000640 1 -- 172.21.15.2:0/4167653290 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+17323 (secure 0 0 0) 0x7f188c05c820 con 0x7f189806df80 2024-09-10T08:48:13.399 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:48:13.400 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":39,"fsid":"f20a15a7-d363-4d44-98cb-4f4f466b52b8","created":"2024-09-10T08:46:26.481619+0000","modified":"2024-09-10T08:48:07.142981+0000","last_up_change":"2024-09-10T08:46:39.323912+0000","last_in_change":"2024-09-10T08:46:29.499894+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:46:39.426180+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:47:51.804125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-10T08:47:52.436532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c90be333-506b-46d1-b00a-10d089a84776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6822","nonce":298678486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6823","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6826","nonce":298678486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6831","nonce":298678486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6829","nonce":298678486}]},"public_addr":"172.21.15.2:6822/298678486","cluster_addr":"172.21.15.2:6826/298678486","heartbeat_back_addr":"172.21.15.2:6831/298678486","heartbeat_front_addr":"172.21.15.2:6829/298678486","state":["exists","up"]},{"osd":1,"uuid":"3f8bdde8-6cd3-4112-8939-a876191c7368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6809","nonce":1619566025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6811","nonce":1619566025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6815","nonce":1619566025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6813","nonce":1619566025}]},"public_addr":"172.21.15.2:6809/1619566025","cluster_addr":"172.21.15.2:6811/1619566025","heartbeat_back_addr":"172.21.15.2:6815/1619566025","heartbeat_front_addr":"172.21.15.2:6813/1619566025","state":["exists","up"]},{"osd":2,"uuid":"3835f5ab-ed3a-4f46-ae6c-f0edf21708d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6801","nonce":3992427579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6803","nonce":3992427579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6807","nonce":3992427579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6805","nonce":3992427579}]},"public_addr":"172.21.15.2:6801/3992427579","cluster_addr":"172.21.15.2:6803/3992427579","heartbeat_back_addr":"172.21.15.2:6807/3992427579","heartbeat_front_addr":"172.21.15.2:6805/3992427579","state":["exists","up"]},{"osd":3,"uuid":"add6ad27-b411-4a82-9622-b0c1c1782cf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6817","nonce":1270626884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6819","nonce":1270626884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6827","nonce":1270626884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6824","nonce":1270626884}]},"public_addr":"172.21.15.2:6817/1270626884","cluster_addr":"172.21.15.2:6819/1270626884","heartbeat_back_addr":"172.21.15.2:6827/1270626884","heartbeat_front_addr":"172.21.15.2:6824/1270626884","state":["exists","up"]},{"osd":4,"uuid":"c7b642f4-8bd2-4262-9a82-ee1061cfab7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6803","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6806","nonce":553254873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6813","nonce":553254873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6822","nonce":553254873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6819","nonce":553254873}]},"public_addr":"172.21.15.155:6806/553254873","cluster_addr":"172.21.15.155:6813/553254873","heartbeat_back_addr":"172.21.15.155:6822/553254873","heartbeat_front_addr":"172.21.15.155:6819/553254873","state":["exists","up"]},{"osd":5,"uuid":"fb53289a-419f-46d8-9e3a-384ac529dc57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6805","nonce":2107688472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6811","nonce":2107688472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6823","nonce":2107688472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6817","nonce":2107688472}]},"public_addr":"172.21.15.155:6805/2107688472","cluster_addr":"172.21.15.155:6811/2107688472","heartbeat_back_addr":"172.21.15.155:6823/2107688472","heartbeat_front_addr":"172.21.15.155:6817/2107688472","state":["exists","up"]},{"osd":6,"uuid":"3f9ddd54-ede4-4565-aff6-ae1c07e7c678","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6825","nonce":944542383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6827","nonce":944542383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6831","nonce":944542383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6829","nonce":944542383}]},"public_addr":"172.21.15.155:6825/944542383","cluster_addr":"172.21.15.155:6827/944542383","heartbeat_back_addr":"172.21.15.155:6831/944542383","heartbeat_front_addr":"172.21.15.155:6829/944542383","state":["exists","up"]},{"osd":7,"uuid":"328d0681-eef4-4556-94e1-9745bd4adbe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6801","nonce":2220093913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6807","nonce":2220093913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6818","nonce":2220093913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6812","nonce":2220093913}]},"public_addr":"172.21.15.155:6801/2220093913","cluster_addr":"172.21.15.155:6807/2220093913","heartbeat_back_addr":"172.21.15.155:6818/2220093913","heartbeat_front_addr":"172.21.15.155:6812/2220093913","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.052980+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.104550+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.025661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:35.784354+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:35.863363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.322312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.100890+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:35.763584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.155:0/41896583":"2024-09-11T08:48:07.142887+0000","172.21.15.155:0/1305551464":"2024-09-11T08:48:07.142887+0000","172.21.15.155:0/3560911645":"2024-09-11T08:48:07.142887+0000","172.21.15.155:0/1872766231":"2024-09-11T08:48:07.142887+0000","172.21.15.155:6833/2611418382":"2024-09-11T08:48:07.142887+0000","172.21.15.155:6832/2611418382":"2024-09-11T08:48:07.142887+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:48:13.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.402+0000 7f18a0800640 1 -- 172.21.15.2:0/4167653290 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7f187c06bfe0 msgr2=0x7f187c06e4a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:48:13.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.402+0000 7f18a0800640 1 --2- 172.21.15.2:0/4167653290 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7f187c06bfe0 0x7f187c06e4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:13.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.402+0000 7f18a0800640 1 -- 172.21.15.2:0/4167653290 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f189806df80 msgr2=0x7f18981f4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:13.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.402+0000 7f18a0800640 1 --2- 172.21.15.2:0/4167653290 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f189806df80 0x7f18981f4810 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f188c00c3e0 tx=0x7f188c00c8a0 comp rx=0 tx=0).stop 2024-09-10T08:48:13.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.402+0000 7f18a0800640 1 -- 172.21.15.2:0/4167653290 shutdown_connections 2024-09-10T08:48:13.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.402+0000 7f18a0800640 1 --2- 172.21.15.2:0/4167653290 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7f187c06bfe0 0x7f187c06e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:13.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.402+0000 7f18a0800640 1 --2- 172.21.15.2:0/4167653290 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1898145d20 0x7f189813e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:13.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.402+0000 7f18a0800640 1 --2- 172.21.15.2:0/4167653290 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f18980cd460 0x7f189813dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:13.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.402+0000 7f18a0800640 1 --2- 172.21.15.2:0/4167653290 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f189806df80 0x7f18981f4810 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:13.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.402+0000 7f18a0800640 1 -- 172.21.15.2:0/4167653290 >> 172.21.15.2:0/4167653290 conn(0x7f189806bc10 msgr2=0x7f18980b0000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:13.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.402+0000 7f18a0800640 1 -- 172.21.15.2:0/4167653290 shutdown_connections 2024-09-10T08:48:13.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.402+0000 7f18a0800640 1 -- 172.21.15.2:0/4167653290 wait complete. 2024-09-10T08:48:13.424 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:48:13.424+0000 7fc2a191e040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-10T08:48:13.427 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T08:48:13.427 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:48:13.479 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:48:13.479+0000 7fc2a191e040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-10T08:48:13.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.584+0000 7f1c3e000640 1 Processor -- start 2024-09-10T08:48:13.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.584+0000 7f1c3e000640 1 -- start start 2024-09-10T08:48:13.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.585+0000 7f1c3e000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1c38145d20 0x7f1c3815c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:13.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.585+0000 7f1c3e000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c3806df80 0x7f1c38160980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:13.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.585+0000 7f1c3e000640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f1c380ccd50 0x7f1c380cd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:13.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.585+0000 7f1c3e000640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f1c38146100 con 0x7f1c38145d20 2024-09-10T08:48:13.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.585+0000 7f1c3e000640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f1c38160ec0 con 0x7f1c380ccd50 2024-09-10T08:48:13.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.585+0000 7f1c3e000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1c380ce6b0 con 0x7f1c3806df80 2024-09-10T08:48:13.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.586+0000 7f1c37400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1c38145d20 0x7f1c3815c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:13.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.586+0000 7f1c37400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1c38145d20 0x7f1c3815c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36106/0 (socket says 172.21.15.2:36106) 2024-09-10T08:48:13.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.586+0000 7f1c37400640 1 -- 172.21.15.2:0/2853468967 learned_addr learned my addr 172.21.15.2:0/2853468967 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:13.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.586+0000 7f1c37e00640 1 --2- 172.21.15.2:0/2853468967 >> v2:172.21.15.155:3300/0 conn(0x7f1c380ccd50 0x7f1c380cd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:13.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.586+0000 7f1c36a00640 1 --2- 172.21.15.2:0/2853468967 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c3806df80 0x7f1c38160980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:13.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.586+0000 7f1c37400640 1 -- 172.21.15.2:0/2853468967 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c3806df80 msgr2=0x7f1c38160980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:48:13.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.586+0000 7f1c37400640 1 --2- 172.21.15.2:0/2853468967 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c3806df80 0x7f1c38160980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:13.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.586+0000 7f1c37400640 1 -- 172.21.15.2:0/2853468967 >> v2:172.21.15.155:3300/0 conn(0x7f1c380ccd50 msgr2=0x7f1c380cd1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:48:13.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.586+0000 7f1c37400640 1 --2- 172.21.15.2:0/2853468967 >> v2:172.21.15.155:3300/0 conn(0x7f1c380ccd50 0x7f1c380cd1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:13.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.586+0000 7f1c37400640 1 -- 172.21.15.2:0/2853468967 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c3806e4d0 con 0x7f1c38145d20 2024-09-10T08:48:13.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.587+0000 7f1c37400640 1 --2- 172.21.15.2:0/2853468967 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c38145d20 0x7f1c3815c9e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1c38071ef0 tx=0x7f1c2802a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1104684eaca6a54c server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:13.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.588+0000 7f1c36000640 1 -- 172.21.15.2:0/2853468967 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c28037070 con 0x7f1c38145d20 2024-09-10T08:48:13.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.588+0000 7f1c36000640 1 -- 172.21.15.2:0/2853468967 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c2802ae00 con 0x7f1c38145d20 2024-09-10T08:48:13.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.588+0000 7f1c36000640 1 -- 172.21.15.2:0/2853468967 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c28032660 con 0x7f1c38145d20 2024-09-10T08:48:13.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.588+0000 7f1c3e000640 1 -- 172.21.15.2:0/2853468967 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c38145d20 msgr2=0x7f1c3815c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:13.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.588+0000 7f1c3e000640 1 --2- 172.21.15.2:0/2853468967 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c38145d20 0x7f1c3815c9e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1c38071ef0 tx=0x7f1c2802a0b0 comp rx=0 tx=0).stop 2024-09-10T08:48:13.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.588+0000 7f1c3e000640 1 -- 172.21.15.2:0/2853468967 shutdown_connections 2024-09-10T08:48:13.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.588+0000 7f1c3e000640 1 --2- 172.21.15.2:0/2853468967 >> v2:172.21.15.155:3300/0 conn(0x7f1c380ccd50 0x7f1c380cd1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:13.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.588+0000 7f1c3e000640 1 --2- 172.21.15.2:0/2853468967 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c3806df80 0x7f1c38160980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:13.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.588+0000 7f1c3e000640 1 --2- 172.21.15.2:0/2853468967 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c38145d20 0x7f1c3815c9e0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:13.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.588+0000 7f1c3e000640 1 -- 172.21.15.2:0/2853468967 >> 172.21.15.2:0/2853468967 conn(0x7f1c3806bc10 msgr2=0x7f1c3806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:13.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.588+0000 7f1c3e000640 1 -- 172.21.15.2:0/2853468967 shutdown_connections 2024-09-10T08:48:13.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.588+0000 7f1c3e000640 1 -- 172.21.15.2:0/2853468967 wait complete. 2024-09-10T08:48:13.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.590+0000 7f1c3e000640 1 Processor -- start 2024-09-10T08:48:13.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.590+0000 7f1c3e000640 1 -- start start 2024-09-10T08:48:13.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.591+0000 7f1c3e000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c3806df80 0x7f1c381f27a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:13.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.591+0000 7f1c3e000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c380ccd50 0x7f1c380adeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:13.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.591+0000 7f1c3e000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c38145d20 0x7f1c381f14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:13.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.591+0000 7f1c3e000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1c3806ed70 con 0x7f1c38145d20 2024-09-10T08:48:13.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.591+0000 7f1c3e000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1c3806ea90 con 0x7f1c380ccd50 2024-09-10T08:48:13.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.591+0000 7f1c3e000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1c380ceb40 con 0x7f1c3806df80 2024-09-10T08:48:13.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.591+0000 7f1c37e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c38145d20 0x7f1c381f14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:13.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.591+0000 7f1c37e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c38145d20 0x7f1c381f14c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36122/0 (socket says 172.21.15.2:36122) 2024-09-10T08:48:13.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.591+0000 7f1c37e00640 1 -- 172.21.15.2:0/3971736225 learned_addr learned my addr 172.21.15.2:0/3971736225 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:13.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.591+0000 7f1c37400640 1 --2- 172.21.15.2:0/3971736225 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c3806df80 0x7f1c381f27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:13.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.591+0000 7f1c36a00640 1 --2- 172.21.15.2:0/3971736225 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c380ccd50 0x7f1c380adeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:13.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.592+0000 7f1c37e00640 1 -- 172.21.15.2:0/3971736225 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c3806df80 msgr2=0x7f1c381f27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:13.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.592+0000 7f1c37e00640 1 --2- 172.21.15.2:0/3971736225 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c3806df80 0x7f1c381f27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:13.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.592+0000 7f1c37e00640 1 -- 172.21.15.2:0/3971736225 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c380ccd50 msgr2=0x7f1c380adeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:13.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.592+0000 7f1c37e00640 1 --2- 172.21.15.2:0/3971736225 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c380ccd50 0x7f1c380adeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:13.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.592+0000 7f1c37e00640 1 -- 172.21.15.2:0/3971736225 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c380ae6e0 con 0x7f1c38145d20 2024-09-10T08:48:13.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.592+0000 7f1c37e00640 1 --2- 172.21.15.2:0/3971736225 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c38145d20 0x7f1c381f14c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1c30009dd0 tx=0x7f1c3000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:13.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.592+0000 7f1c2f400640 1 -- 172.21.15.2:0/3971736225 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c30018020 con 0x7f1c38145d20 2024-09-10T08:48:13.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.592+0000 7f1c2f400640 1 -- 172.21.15.2:0/3971736225 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c30014480 con 0x7f1c38145d20 2024-09-10T08:48:13.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.592+0000 7f1c2f400640 1 -- 172.21.15.2:0/3971736225 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c30014870 con 0x7f1c38145d20 2024-09-10T08:48:13.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.592+0000 7f1c3e000640 1 -- 172.21.15.2:0/3971736225 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c380ae9c0 con 0x7f1c38145d20 2024-09-10T08:48:13.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.593+0000 7f1c3e000640 1 -- 172.21.15.2:0/3971736225 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c380aef80 con 0x7f1c38145d20 2024-09-10T08:48:13.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.594+0000 7f1c3e000640 1 -- 172.21.15.2:0/3971736225 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c38160980 con 0x7f1c38145d20 2024-09-10T08:48:13.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.595+0000 7f1c2f400640 1 -- 172.21.15.2:0/3971736225 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 10) ==== 90657+0+0 (secure 0 0 0) 0x7f1c30005d10 con 0x7f1c38145d20 2024-09-10T08:48:13.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.596+0000 7f1c2f400640 1 --2- 172.21.15.2:0/3971736225 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7f1c1806bfe0 0x7f1c1806e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:13.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.596+0000 7f1c2f400640 1 -- 172.21.15.2:0/3971736225 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6359+0+0 (secure 0 0 0) 0x7f1c3008bea0 con 0x7f1c38145d20 2024-09-10T08:48:13.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.596+0000 7f1c37400640 1 -- 172.21.15.2:0/3971736225 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7f1c1806bfe0 msgr2=0x7f1c1806e4a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.155:6832/3369759420 2024-09-10T08:48:13.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.596+0000 7f1c37400640 1 --2- 172.21.15.2:0/3971736225 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7f1c1806bfe0 0x7f1c1806e4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:48:13.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.600+0000 7f1c2f400640 1 -- 172.21.15.2:0/3971736225 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1c30022070 con 0x7f1c38145d20 2024-09-10T08:48:13.708 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:48:13.708+0000 7f68143ef040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-10T08:48:13.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.797+0000 7f1c37400640 1 -- 172.21.15.2:0/3971736225 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7f1c1806bfe0 msgr2=0x7f1c1806e4a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.155:6832/3369759420 2024-09-10T08:48:13.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.797+0000 7f1c37400640 1 --2- 172.21.15.2:0/3971736225 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7f1c1806bfe0 0x7f1c1806e4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:48:13.805 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:48:13.805+0000 7f68143ef040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-10T08:48:13.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.820+0000 7f1c3e000640 1 -- 172.21.15.2:0/3971736225 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1c380ae3f0 con 0x7f1c38145d20 2024-09-10T08:48:13.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.821+0000 7f1c2f400640 1 -- 172.21.15.2:0/3971736225 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5217 (secure 0 0 0) 0x7f1c30010040 con 0x7f1c38145d20 2024-09-10T08:48:13.821 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:48:13.821 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":18,"btime":"2024-09-10T08:47:57:038981+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4634,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3082437117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3082437117},{"type":"v1","addr":"172.21.15.155:6837","nonce":3082437117}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4816,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/3193521843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3193521843},{"type":"v1","addr":"172.21.15.2:6834","nonce":3193521843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4822,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/164428463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":164428463},{"type":"v1","addr":"172.21.15.155:6836","nonce":164428463}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:47:53.446893+0000","modified":"2024-09-10T08:47:56.462174+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4824},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4824":{"gid":4824,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6835/464022930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":464022930},{"type":"v1","addr":"172.21.15.2:6835","nonce":464022930}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4824,"qdb_cluster":[4824]},"id":2}]} 2024-09-10T08:48:13.821 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 18 2024-09-10T08:48:13.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.823+0000 7f1c3e000640 1 -- 172.21.15.2:0/3971736225 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7f1c1806bfe0 msgr2=0x7f1c1806e4a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:48:13.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.823+0000 7f1c3e000640 1 --2- 172.21.15.2:0/3971736225 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7f1c1806bfe0 0x7f1c1806e4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:13.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.823+0000 7f1c3e000640 1 -- 172.21.15.2:0/3971736225 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c38145d20 msgr2=0x7f1c381f14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:13.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.823+0000 7f1c3e000640 1 --2- 172.21.15.2:0/3971736225 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c38145d20 0x7f1c381f14c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1c30009dd0 tx=0x7f1c3000c490 comp rx=0 tx=0).stop 2024-09-10T08:48:13.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.823+0000 7f1c3e000640 1 -- 172.21.15.2:0/3971736225 shutdown_connections 2024-09-10T08:48:13.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.823+0000 7f1c3e000640 1 --2- 172.21.15.2:0/3971736225 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7f1c1806bfe0 0x7f1c1806e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:13.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.823+0000 7f1c3e000640 1 --2- 172.21.15.2:0/3971736225 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1c38145d20 0x7f1c381f14c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:13.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.823+0000 7f1c3e000640 1 --2- 172.21.15.2:0/3971736225 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c380ccd50 0x7f1c380adeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:13.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.823+0000 7f1c3e000640 1 --2- 172.21.15.2:0/3971736225 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1c3806df80 0x7f1c381f27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:13.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.823+0000 7f1c3e000640 1 -- 172.21.15.2:0/3971736225 >> 172.21.15.2:0/3971736225 conn(0x7f1c3806bc10 msgr2=0x7f1c380b0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:13.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.823+0000 7f1c3e000640 1 -- 172.21.15.2:0/3971736225 shutdown_connections 2024-09-10T08:48:13.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.823+0000 7f1c3e000640 1 -- 172.21.15.2:0/3971736225 wait complete. 2024-09-10T08:48:13.841 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:48:13.882 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:48:13.882+0000 7fc2a191e040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-10T08:48:13.926 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:48:13.926+0000 7f68143ef040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-10T08:48:13.975 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:48:13.974+0000 7f68143ef040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-10T08:48:13.987 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:48:13.987+0000 7fc2a191e040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-10T08:48:13.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.998+0000 7f3655600640 1 Processor -- start 2024-09-10T08:48:13.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.998+0000 7f3655600640 1 -- start start 2024-09-10T08:48:13.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.999+0000 7f3655600640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f365006ce60 0x7f36500d2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:14.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.999+0000 7f3655600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36500d30e0 0x7f36500cf7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:14.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.999+0000 7f3655600640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36500d1120 con 0x7f365015e6b0 2024-09-10T08:48:14.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.999+0000 7f3655600640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f36500d1a50 con 0x7f365006ce60 2024-09-10T08:48:14.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:13.999+0000 7f3655600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f36500d1400 con 0x7f36500d30e0 2024-09-10T08:48:14.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.000+0000 7f364f400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36500d30e0 0x7f36500cf7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:14.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.000+0000 7f364ea00640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f365015e6b0 0x7f36500d4cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.2:47592/0 (socket says 172.21.15.2:47592) 2024-09-10T08:48:14.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.000+0000 7f364ea00640 1 -- 172.21.15.2:0/1274744884 learned_addr learned my addr 172.21.15.2:0/1274744884 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:48:14.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.000+0000 7f3647e00640 1 --2- 172.21.15.2:0/1274744884 >> v2:172.21.15.155:3300/0 conn(0x7f365006ce60 0x7f36500d2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:14.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.000+0000 7f364f400640 1 -- 172.21.15.2:0/1274744884 >> v2:172.21.15.155:3300/0 conn(0x7f365006ce60 msgr2=0x7f36500d2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:48:14.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.000+0000 7f364f400640 1 --2- 172.21.15.2:0/1274744884 >> v2:172.21.15.155:3300/0 conn(0x7f365006ce60 0x7f36500d2ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:14.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.000+0000 7f364f400640 1 -- 172.21.15.2:0/1274744884 >> v1:172.21.15.155:6789/0 conn(0x7f365015e6b0 legacy=0x7f36500d4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:14.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.000+0000 7f364f400640 1 -- 172.21.15.2:0/1274744884 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36500d16e0 con 0x7f36500d30e0 2024-09-10T08:48:14.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.000+0000 7f364e000640 1 -- 172.21.15.2:0/1274744884 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2853911522 0 0) 0x7f36500d1120 con 0x7f365015e6b0 2024-09-10T08:48:14.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.001+0000 7f364f400640 1 --2- 172.21.15.2:0/1274744884 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36500d30e0 0x7f36500cf7a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3648009d90 tx=0x7f364802a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71139d95b950c9f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:14.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.002+0000 7f364e000640 1 -- 172.21.15.2:0/1274744884 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3648031600 con 0x7f36500d30e0 2024-09-10T08:48:14.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.002+0000 7f364e000640 1 -- 172.21.15.2:0/1274744884 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36480317a0 con 0x7f36500d30e0 2024-09-10T08:48:14.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.002+0000 7f364e000640 1 -- 172.21.15.2:0/1274744884 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3648031b70 con 0x7f36500d30e0 2024-09-10T08:48:14.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.002+0000 7f3655600640 1 -- 172.21.15.2:0/1274744884 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36500d30e0 msgr2=0x7f36500cf7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:14.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.002+0000 7f3655600640 1 --2- 172.21.15.2:0/1274744884 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36500d30e0 0x7f36500cf7a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3648009d90 tx=0x7f364802a5d0 comp rx=0 tx=0).stop 2024-09-10T08:48:14.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.002+0000 7f3655600640 1 -- 172.21.15.2:0/1274744884 shutdown_connections 2024-09-10T08:48:14.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.002+0000 7f3655600640 1 --2- 172.21.15.2:0/1274744884 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f36500d30e0 0x7f36500cf7a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:14.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.002+0000 7f3655600640 1 --2- 172.21.15.2:0/1274744884 >> v2:172.21.15.155:3300/0 conn(0x7f365006ce60 0x7f36500d2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:14.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.002+0000 7f3655600640 1 -- 172.21.15.2:0/1274744884 >> 172.21.15.2:0/1274744884 conn(0x7f365008bfd0 msgr2=0x7f36500d45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:14.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.002+0000 7f3655600640 1 -- 172.21.15.2:0/1274744884 shutdown_connections 2024-09-10T08:48:14.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.002+0000 7f3655600640 1 -- 172.21.15.2:0/1274744884 wait complete. 2024-09-10T08:48:14.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.004+0000 7f3655600640 1 Processor -- start 2024-09-10T08:48:14.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.004+0000 7f3655600640 1 -- start start 2024-09-10T08:48:14.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.005+0000 7f3655600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f365006ce60 0x7f3650157640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:14.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.005+0000 7f3655600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36500d30e0 0x7f36500b6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:14.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.005+0000 7f3655600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f365015e6b0 0x7f365015a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:14.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.005+0000 7f3655600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f36500d53e0 con 0x7f365015e6b0 2024-09-10T08:48:14.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.005+0000 7f3655600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f36500cf210 con 0x7f36500d30e0 2024-09-10T08:48:14.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.005+0000 7f3655600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f36500d0db0 con 0x7f365006ce60 2024-09-10T08:48:14.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.005+0000 7f364f400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f365015e6b0 0x7f365015a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:14.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.005+0000 7f364ea00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f365006ce60 0x7f3650157640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:14.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.005+0000 7f3647e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36500d30e0 0x7f36500b6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:14.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.005+0000 7f364f400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f365015e6b0 0x7f365015a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36138/0 (socket says 172.21.15.2:36138) 2024-09-10T08:48:14.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.005+0000 7f364f400640 1 -- 172.21.15.2:0/2748950049 learned_addr learned my addr 172.21.15.2:0/2748950049 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:14.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.006+0000 7f364ea00640 1 -- 172.21.15.2:0/2748950049 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36500d30e0 msgr2=0x7f36500b6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:14.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.006+0000 7f364ea00640 1 --2- 172.21.15.2:0/2748950049 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36500d30e0 0x7f36500b6830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:14.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.006+0000 7f364ea00640 1 -- 172.21.15.2:0/2748950049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f365015e6b0 msgr2=0x7f365015a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:14.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.006+0000 7f364ea00640 1 --2- 172.21.15.2:0/2748950049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f365015e6b0 0x7f365015a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:14.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.006+0000 7f364ea00640 1 -- 172.21.15.2:0/2748950049 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3650160920 con 0x7f365006ce60 2024-09-10T08:48:14.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.006+0000 7f3647e00640 1 --2- 172.21.15.2:0/2748950049 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36500d30e0 0x7f36500b6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:48:14.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.006+0000 7f364ea00640 1 --2- 172.21.15.2:0/2748950049 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f365006ce60 0x7f3650157640 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f364000c410 tx=0x7f364000c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:14.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.006+0000 7f3646a00640 1 -- 172.21.15.2:0/2748950049 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36400074e0 con 0x7f365006ce60 2024-09-10T08:48:14.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.006+0000 7f3646a00640 1 -- 172.21.15.2:0/2748950049 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36400047e0 con 0x7f365006ce60 2024-09-10T08:48:14.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.006+0000 7f3646a00640 1 -- 172.21.15.2:0/2748950049 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3640004bd0 con 0x7f365006ce60 2024-09-10T08:48:14.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.006+0000 7f3655600640 1 -- 172.21.15.2:0/2748950049 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3650160c00 con 0x7f365006ce60 2024-09-10T08:48:14.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.007+0000 7f3655600640 1 -- 172.21.15.2:0/2748950049 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f36501611c0 con 0x7f365006ce60 2024-09-10T08:48:14.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.008+0000 7f3655600640 1 -- 172.21.15.2:0/2748950049 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36500d2ba0 con 0x7f365006ce60 2024-09-10T08:48:14.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.009+0000 7f3646a00640 1 -- 172.21.15.2:0/2748950049 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 10) ==== 90657+0+0 (secure 0 0 0) 0x7f3640011070 con 0x7f365006ce60 2024-09-10T08:48:14.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.009+0000 7f3646a00640 1 --2- 172.21.15.2:0/2748950049 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7f362c06bfe0 0x7f362c06e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:14.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.010+0000 7f3646a00640 1 -- 172.21.15.2:0/2748950049 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(39..39 src has 1..39) ==== 6359+0+0 (secure 0 0 0) 0x7f364008aed0 con 0x7f365006ce60 2024-09-10T08:48:14.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.010+0000 7f3647e00640 1 -- 172.21.15.2:0/2748950049 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7f362c06bfe0 msgr2=0x7f362c06e4a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.155:6832/3369759420 2024-09-10T08:48:14.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.010+0000 7f3647e00640 1 --2- 172.21.15.2:0/2748950049 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7f362c06bfe0 0x7f362c06e4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:48:14.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.015+0000 7f3646a00640 1 -- 172.21.15.2:0/2748950049 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3640058d40 con 0x7f365006ce60 2024-09-10T08:48:14.101 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:48:14.100+0000 7f68143ef040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-10T08:48:14.117 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:48:14.117+0000 7fc2a191e040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-10T08:48:14.160 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:48:14.160+0000 7f68143ef040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-10T08:48:14.169 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:48:14.169+0000 7fc2a191e040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-10T08:48:14.209 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:48:14.209+0000 7f68143ef040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-10T08:48:14.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.211+0000 7f3647e00640 1 -- 172.21.15.2:0/2748950049 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7f362c06bfe0 msgr2=0x7f362c06e4a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.155:6832/3369759420 2024-09-10T08:48:14.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.211+0000 7f3647e00640 1 --2- 172.21.15.2:0/2748950049 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7f362c06bfe0 0x7f362c06e4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:48:14.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.236+0000 7f3655600640 1 -- 172.21.15.2:0/2748950049 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f36500d1d20 con 0x7f365006ce60 2024-09-10T08:48:14.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.237+0000 7f3646a00640 1 -- 172.21.15.2:0/2748950049 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5217 (secure 0 0 0) 0x7f364005d040 con 0x7f365006ce60 2024-09-10T08:48:14.237 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:48:14.238 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":18,"btime":"2024-09-10T08:47:57:038981+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4634,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3082437117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3082437117},{"type":"v1","addr":"172.21.15.155:6837","nonce":3082437117}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4816,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/3193521843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3193521843},{"type":"v1","addr":"172.21.15.2:6834","nonce":3193521843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4822,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/164428463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":164428463},{"type":"v1","addr":"172.21.15.155:6836","nonce":164428463}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-10T08:47:53.446893+0000","modified":"2024-09-10T08:47:56.462174+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4824},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4824":{"gid":4824,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6835/464022930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":464022930},{"type":"v1","addr":"172.21.15.2:6835","nonce":464022930}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4824,"qdb_cluster":[4824]},"id":2}]} 2024-09-10T08:48:14.238 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 18 2024-09-10T08:48:14.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.239+0000 7f3655600640 1 -- 172.21.15.2:0/2748950049 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7f362c06bfe0 msgr2=0x7f362c06e4a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:48:14.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.239+0000 7f3655600640 1 --2- 172.21.15.2:0/2748950049 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7f362c06bfe0 0x7f362c06e4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:14.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.239+0000 7f3655600640 1 -- 172.21.15.2:0/2748950049 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f365006ce60 msgr2=0x7f3650157640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:14.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.239+0000 7f3655600640 1 --2- 172.21.15.2:0/2748950049 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f365006ce60 0x7f3650157640 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f364000c410 tx=0x7f364000c8d0 comp rx=0 tx=0).stop 2024-09-10T08:48:14.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.239+0000 7f3655600640 1 -- 172.21.15.2:0/2748950049 shutdown_connections 2024-09-10T08:48:14.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.239+0000 7f3655600640 1 --2- 172.21.15.2:0/2748950049 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7f362c06bfe0 0x7f362c06e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:14.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.239+0000 7f3655600640 1 --2- 172.21.15.2:0/2748950049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f365015e6b0 0x7f365015a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:14.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.239+0000 7f3655600640 1 --2- 172.21.15.2:0/2748950049 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36500d30e0 0x7f36500b6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:14.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.239+0000 7f3655600640 1 --2- 172.21.15.2:0/2748950049 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f365006ce60 0x7f3650157640 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:14.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.239+0000 7f3655600640 1 -- 172.21.15.2:0/2748950049 >> 172.21.15.2:0/2748950049 conn(0x7f365008bfd0 msgr2=0x7f36500b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:14.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.240+0000 7f3655600640 1 -- 172.21.15.2:0/2748950049 shutdown_connections 2024-09-10T08:48:14.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.240+0000 7f3655600640 1 -- 172.21.15.2:0/2748950049 wait complete. 2024-09-10T08:48:14.255 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:48:14.304 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:48:14.304+0000 7fc2a191e040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-10T08:48:14.340 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:48:14.339+0000 7f68143ef040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-10T08:48:14.369 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:48:14.369+0000 7fc2a191e040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-10T08:48:14.396 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:48:14.396+0000 7f68143ef040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-10T08:48:14.422 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:48:14.422+0000 7fc2a191e040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-10T08:48:14.452 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:48:14.452+0000 7f68143ef040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-10T08:48:14.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.453+0000 7f4039e00640 1 Processor -- start 2024-09-10T08:48:14.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.453+0000 7f4039e00640 1 -- start start 2024-09-10T08:48:14.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.454+0000 7f4039e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4034144250 0x7f40340cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:14.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.454+0000 7f4039e00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f40340cd480 0x7f40340ce420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:14.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.454+0000 7f4039e00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f403406f540 con 0x7f4034144c90 2024-09-10T08:48:14.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.454+0000 7f4039e00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f403406f820 con 0x7f40340cd480 2024-09-10T08:48:14.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.454+0000 7f4039e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f403406fb00 con 0x7f4034144250 2024-09-10T08:48:14.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.455+0000 7f4033400640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f40340cd480 0x7f40340ce420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:14.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.455+0000 7f4032000640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f4034144c90 0x7f40340ccd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.2:47596/0 (socket says 172.21.15.2:47596) 2024-09-10T08:48:14.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.455+0000 7f4032000640 1 -- 172.21.15.2:0/2918554854 learned_addr learned my addr 172.21.15.2:0/2918554854 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:48:14.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.455+0000 7f4032a00640 1 --2- 172.21.15.2:0/2918554854 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4034144250 0x7f40340cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:14.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.455+0000 7f4033400640 1 -- 172.21.15.2:0/2918554854 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4034144250 msgr2=0x7f40340cf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:48:14.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.455+0000 7f4033400640 1 --2- 172.21.15.2:0/2918554854 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4034144250 0x7f40340cf8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:14.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.455+0000 7f4033400640 1 -- 172.21.15.2:0/2918554854 >> v1:172.21.15.155:6789/0 conn(0x7f4034144c90 legacy=0x7f40340ccd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:14.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.455+0000 7f4033400640 1 -- 172.21.15.2:0/2918554854 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f403406fde0 con 0x7f40340cd480 2024-09-10T08:48:14.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.456+0000 7f4033400640 1 --2- 172.21.15.2:0/2918554854 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f40340cd480 0x7f40340ce420 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f402c00bfa0 tx=0x7f402c02c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2e5d245110b7fc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:14.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.457+0000 7f4031600640 1 -- 172.21.15.2:0/2918554854 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f402c039070 con 0x7f40340cd480 2024-09-10T08:48:14.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.457+0000 7f4031600640 1 -- 172.21.15.2:0/2918554854 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f402c009540 con 0x7f40340cd480 2024-09-10T08:48:14.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.457+0000 7f4031600640 1 -- 172.21.15.2:0/2918554854 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f402c009910 con 0x7f40340cd480 2024-09-10T08:48:14.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.457+0000 7f4039e00640 1 -- 172.21.15.2:0/2918554854 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f40340cd480 msgr2=0x7f40340ce420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:14.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.457+0000 7f4039e00640 1 --2- 172.21.15.2:0/2918554854 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f40340cd480 0x7f40340ce420 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f402c00bfa0 tx=0x7f402c02c860 comp rx=0 tx=0).stop 2024-09-10T08:48:14.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.457+0000 7f4039e00640 1 -- 172.21.15.2:0/2918554854 shutdown_connections 2024-09-10T08:48:14.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.457+0000 7f4039e00640 1 --2- 172.21.15.2:0/2918554854 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f40340cd480 0x7f40340ce420 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:14.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.457+0000 7f4039e00640 1 --2- 172.21.15.2:0/2918554854 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4034144250 0x7f40340cf8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:14.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.457+0000 7f4039e00640 1 -- 172.21.15.2:0/2918554854 >> 172.21.15.2:0/2918554854 conn(0x7f403406bc10 msgr2=0x7f403406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:14.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.457+0000 7f4039e00640 1 -- 172.21.15.2:0/2918554854 shutdown_connections 2024-09-10T08:48:14.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.458+0000 7f4039e00640 1 -- 172.21.15.2:0/2918554854 wait complete. 2024-09-10T08:48:14.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.459+0000 7f4039e00640 1 Processor -- start 2024-09-10T08:48:14.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.459+0000 7f4039e00640 1 -- start start 2024-09-10T08:48:14.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.460+0000 7f4039e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40340cd480 0x7f40340b2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:14.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.460+0000 7f4039e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4034144250 0x7f40341f7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:14.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.460+0000 7f4039e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4034144c90 0x7f403415a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:14.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.460+0000 7f4039e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f40340b3390 con 0x7f40340cd480 2024-09-10T08:48:14.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.460+0000 7f4039e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f40340cfe10 con 0x7f4034144250 2024-09-10T08:48:14.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.460+0000 7f4039e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f40340ce960 con 0x7f4034144c90 2024-09-10T08:48:14.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.461+0000 7f4032a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40340cd480 0x7f40340b2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:14.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.461+0000 7f4032000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4034144250 0x7f40341f7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:14.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.461+0000 7f4032a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40340cd480 0x7f40340b2b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36140/0 (socket says 172.21.15.2:36140) 2024-09-10T08:48:14.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.461+0000 7f4032a00640 1 -- 172.21.15.2:0/1574716031 learned_addr learned my addr 172.21.15.2:0/1574716031 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:14.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.461+0000 7f4032000640 1 --2- 172.21.15.2:0/1574716031 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4034144250 0x7f40341f7df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.2:52636/0 (socket says 172.21.15.2:52636) 2024-09-10T08:48:14.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.461+0000 7f4033400640 1 --2- 172.21.15.2:0/1574716031 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4034144c90 0x7f403415a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:14.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.461+0000 7f4032a00640 1 -- 172.21.15.2:0/1574716031 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4034144c90 msgr2=0x7f403415a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:14.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.461+0000 7f4032a00640 1 --2- 172.21.15.2:0/1574716031 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4034144c90 0x7f403415a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:14.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.461+0000 7f4032a00640 1 -- 172.21.15.2:0/1574716031 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4034144250 msgr2=0x7f40341f7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:14.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.461+0000 7f4032a00640 1 --2- 172.21.15.2:0/1574716031 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4034144250 0x7f40341f7df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:14.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.461+0000 7f4032a00640 1 -- 172.21.15.2:0/1574716031 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40341e61c0 con 0x7f40340cd480 2024-09-10T08:48:14.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.461+0000 7f4032a00640 1 --2- 172.21.15.2:0/1574716031 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40340cd480 0x7f40340b2b10 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f402400e9b0 tx=0x7f402400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:14.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.462+0000 7f402b400640 1 -- 172.21.15.2:0/1574716031 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4024017070 con 0x7f40340cd480 2024-09-10T08:48:14.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.462+0000 7f402b400640 1 -- 172.21.15.2:0/1574716031 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f402400c9a0 con 0x7f40340cd480 2024-09-10T08:48:14.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.462+0000 7f4039e00640 1 -- 172.21.15.2:0/1574716031 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40340b03e0 con 0x7f40340cd480 2024-09-10T08:48:14.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.462+0000 7f402b400640 1 -- 172.21.15.2:0/1574716031 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f402400cd90 con 0x7f40340cd480 2024-09-10T08:48:14.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.462+0000 7f4039e00640 1 -- 172.21.15.2:0/1574716031 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40340b09a0 con 0x7f40340cd480 2024-09-10T08:48:14.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.463+0000 7f4039e00640 1 -- 172.21.15.2:0/1574716031 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40340ce420 con 0x7f40340cd480 2024-09-10T08:48:14.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.464+0000 7f402b400640 1 -- 172.21.15.2:0/1574716031 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 10) ==== 90657+0+0 (secure 0 0 0) 0x7f402401a070 con 0x7f40340cd480 2024-09-10T08:48:14.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.465+0000 7f402b400640 1 --2- 172.21.15.2:0/1574716031 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7f401406bfe0 0x7f401406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:14.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.465+0000 7f402b400640 1 -- 172.21.15.2:0/1574716031 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6359+0+0 (secure 0 0 0) 0x7f402408b750 con 0x7f40340cd480 2024-09-10T08:48:14.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.465+0000 7f4032000640 1 -- 172.21.15.2:0/1574716031 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7f401406bfe0 msgr2=0x7f401406e4a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.155:6832/3369759420 2024-09-10T08:48:14.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.465+0000 7f4032000640 1 --2- 172.21.15.2:0/1574716031 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7f401406bfe0 0x7f401406e4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:48:14.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.469+0000 7f402b400640 1 -- 172.21.15.2:0/1574716031 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f40240595b0 con 0x7f40340cd480 2024-09-10T08:48:14.515 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:48:14.515+0000 7f68143ef040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-10T08:48:14.559 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:48:14.559+0000 7fc2a191e040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-10T08:48:14.564 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:48:14.564+0000 7f68143ef040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-10T08:48:14.613 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:48:14.613+0000 7f68143ef040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-10T08:48:14.618 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:48:14.618+0000 7fc2a191e040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-10T08:48:14.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.654+0000 7f4039e00640 1 -- 172.21.15.2:0/1574716031 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4034072730 con 0x7f40340cd480 2024-09-10T08:48:14.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.655+0000 7f402b400640 1 -- 172.21.15.2:0/1574716031 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+17323 (secure 0 0 0) 0x7f402405d8b0 con 0x7f40340cd480 2024-09-10T08:48:14.655 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:48:14.656 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":39,"fsid":"f20a15a7-d363-4d44-98cb-4f4f466b52b8","created":"2024-09-10T08:46:26.481619+0000","modified":"2024-09-10T08:48:07.142981+0000","last_up_change":"2024-09-10T08:46:39.323912+0000","last_in_change":"2024-09-10T08:46:29.499894+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:46:39.426180+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-10T08:47:51.804125+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-10T08:47:52.436532+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c90be333-506b-46d1-b00a-10d089a84776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6822","nonce":298678486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6823","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6826","nonce":298678486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6831","nonce":298678486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6829","nonce":298678486}]},"public_addr":"172.21.15.2:6822/298678486","cluster_addr":"172.21.15.2:6826/298678486","heartbeat_back_addr":"172.21.15.2:6831/298678486","heartbeat_front_addr":"172.21.15.2:6829/298678486","state":["exists","up"]},{"osd":1,"uuid":"3f8bdde8-6cd3-4112-8939-a876191c7368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6809","nonce":1619566025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6811","nonce":1619566025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6815","nonce":1619566025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6813","nonce":1619566025}]},"public_addr":"172.21.15.2:6809/1619566025","cluster_addr":"172.21.15.2:6811/1619566025","heartbeat_back_addr":"172.21.15.2:6815/1619566025","heartbeat_front_addr":"172.21.15.2:6813/1619566025","state":["exists","up"]},{"osd":2,"uuid":"3835f5ab-ed3a-4f46-ae6c-f0edf21708d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6801","nonce":3992427579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6803","nonce":3992427579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6807","nonce":3992427579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6805","nonce":3992427579}]},"public_addr":"172.21.15.2:6801/3992427579","cluster_addr":"172.21.15.2:6803/3992427579","heartbeat_back_addr":"172.21.15.2:6807/3992427579","heartbeat_front_addr":"172.21.15.2:6805/3992427579","state":["exists","up"]},{"osd":3,"uuid":"add6ad27-b411-4a82-9622-b0c1c1782cf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6817","nonce":1270626884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6819","nonce":1270626884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6827","nonce":1270626884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6824","nonce":1270626884}]},"public_addr":"172.21.15.2:6817/1270626884","cluster_addr":"172.21.15.2:6819/1270626884","heartbeat_back_addr":"172.21.15.2:6827/1270626884","heartbeat_front_addr":"172.21.15.2:6824/1270626884","state":["exists","up"]},{"osd":4,"uuid":"c7b642f4-8bd2-4262-9a82-ee1061cfab7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6803","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6806","nonce":553254873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6813","nonce":553254873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6822","nonce":553254873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6819","nonce":553254873}]},"public_addr":"172.21.15.155:6806/553254873","cluster_addr":"172.21.15.155:6813/553254873","heartbeat_back_addr":"172.21.15.155:6822/553254873","heartbeat_front_addr":"172.21.15.155:6819/553254873","state":["exists","up"]},{"osd":5,"uuid":"fb53289a-419f-46d8-9e3a-384ac529dc57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6805","nonce":2107688472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6811","nonce":2107688472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6823","nonce":2107688472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6817","nonce":2107688472}]},"public_addr":"172.21.15.155:6805/2107688472","cluster_addr":"172.21.15.155:6811/2107688472","heartbeat_back_addr":"172.21.15.155:6823/2107688472","heartbeat_front_addr":"172.21.15.155:6817/2107688472","state":["exists","up"]},{"osd":6,"uuid":"3f9ddd54-ede4-4565-aff6-ae1c07e7c678","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6825","nonce":944542383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6827","nonce":944542383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6831","nonce":944542383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6829","nonce":944542383}]},"public_addr":"172.21.15.155:6825/944542383","cluster_addr":"172.21.15.155:6827/944542383","heartbeat_back_addr":"172.21.15.155:6831/944542383","heartbeat_front_addr":"172.21.15.155:6829/944542383","state":["exists","up"]},{"osd":7,"uuid":"328d0681-eef4-4556-94e1-9745bd4adbe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6801","nonce":2220093913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6807","nonce":2220093913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6818","nonce":2220093913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6812","nonce":2220093913}]},"public_addr":"172.21.15.155:6801/2220093913","cluster_addr":"172.21.15.155:6807/2220093913","heartbeat_back_addr":"172.21.15.155:6818/2220093913","heartbeat_front_addr":"172.21.15.155:6812/2220093913","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.052980+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.104550+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.025661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:35.784354+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:35.863363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.322312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.100890+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:35.763584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.155:0/41896583":"2024-09-11T08:48:07.142887+0000","172.21.15.155:0/1305551464":"2024-09-11T08:48:07.142887+0000","172.21.15.155:0/3560911645":"2024-09-11T08:48:07.142887+0000","172.21.15.155:0/1872766231":"2024-09-11T08:48:07.142887+0000","172.21.15.155:6833/2611418382":"2024-09-11T08:48:07.142887+0000","172.21.15.155:6832/2611418382":"2024-09-11T08:48:07.142887+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:48:14.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.657+0000 7f4039e00640 1 -- 172.21.15.2:0/1574716031 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7f401406bfe0 msgr2=0x7f401406e4a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:48:14.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.657+0000 7f4039e00640 1 --2- 172.21.15.2:0/1574716031 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7f401406bfe0 0x7f401406e4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:14.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.657+0000 7f4039e00640 1 -- 172.21.15.2:0/1574716031 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40340cd480 msgr2=0x7f40340b2b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:14.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.657+0000 7f4039e00640 1 --2- 172.21.15.2:0/1574716031 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40340cd480 0x7f40340b2b10 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f402400e9b0 tx=0x7f402400ee70 comp rx=0 tx=0).stop 2024-09-10T08:48:14.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.657+0000 7f4039e00640 1 -- 172.21.15.2:0/1574716031 shutdown_connections 2024-09-10T08:48:14.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.657+0000 7f4039e00640 1 --2- 172.21.15.2:0/1574716031 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7f401406bfe0 0x7f401406e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:14.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.657+0000 7f4039e00640 1 --2- 172.21.15.2:0/1574716031 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4034144c90 0x7f403415a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:14.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.657+0000 7f4039e00640 1 --2- 172.21.15.2:0/1574716031 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4034144250 0x7f40341f7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:14.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.657+0000 7f4039e00640 1 --2- 172.21.15.2:0/1574716031 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f40340cd480 0x7f40340b2b10 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:14.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.657+0000 7f4039e00640 1 -- 172.21.15.2:0/1574716031 >> 172.21.15.2:0/1574716031 conn(0x7f403406bc10 msgr2=0x7f403406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:14.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.658+0000 7f4039e00640 1 -- 172.21.15.2:0/1574716031 shutdown_connections 2024-09-10T08:48:14.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.658+0000 7f4039e00640 1 -- 172.21.15.2:0/1574716031 wait complete. 2024-09-10T08:48:14.675 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-10T08:48:14.679 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:48:14.678+0000 7fc2a191e040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-10T08:48:14.745 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:48:14.745+0000 7fc2a191e040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-10T08:48:14.798 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:48:14.798+0000 7fc2a191e040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-10T08:48:14.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.837+0000 7f8275400640 1 Processor -- start 2024-09-10T08:48:14.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.837+0000 7f8275400640 1 -- start start 2024-09-10T08:48:14.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.838+0000 7f8275400640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8270161ca0 0x7f82700d2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:14.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.839+0000 7f8275400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82700cf8c0 0x7f827006d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:14.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.839+0000 7f8275400640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82700cfe50 con 0x7f82700d2b60 2024-09-10T08:48:14.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.839+0000 7f8275400640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f82700d2fd0 con 0x7f8270161ca0 2024-09-10T08:48:14.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.839+0000 7f8275400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f82700d34a0 con 0x7f82700cf8c0 2024-09-10T08:48:14.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.839+0000 7f826de00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f82700d2b60 0x7f82700cf1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:60106/0 (socket says 172.21.15.2:60106) 2024-09-10T08:48:14.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.839+0000 7f826de00640 1 -- 172.21.15.2:0/1016642881 learned_addr learned my addr 172.21.15.2:0/1016642881 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:48:14.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.839+0000 7f826e800640 1 --2- 172.21.15.2:0/1016642881 >> v2:172.21.15.155:3300/0 conn(0x7f8270161ca0 0x7f82700d2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:14.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.839+0000 7f826f200640 1 --2- 172.21.15.2:0/1016642881 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82700cf8c0 0x7f827006d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:14.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.839+0000 7f826d400640 1 -- 172.21.15.2:0/1016642881 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 686629426 0 0) 0x7f82700cfe50 con 0x7f82700d2b60 2024-09-10T08:48:14.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.839+0000 7f826d400640 1 -- 172.21.15.2:0/1016642881 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8254003520 con 0x7f82700d2b60 2024-09-10T08:48:14.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.839+0000 7f826e800640 1 -- 172.21.15.2:0/1016642881 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82700cf8c0 msgr2=0x7f827006d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:48:14.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.839+0000 7f826e800640 1 --2- 172.21.15.2:0/1016642881 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82700cf8c0 0x7f827006d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:14.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.840+0000 7f826e800640 1 -- 172.21.15.2:0/1016642881 >> v1:172.21.15.2:6789/0 conn(0x7f82700d2b60 legacy=0x7f82700cf1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:14.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.840+0000 7f826e800640 1 -- 172.21.15.2:0/1016642881 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82700d0130 con 0x7f8270161ca0 2024-09-10T08:48:14.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.840+0000 7f826f200640 1 --2- 172.21.15.2:0/1016642881 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82700cf8c0 0x7f827006d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:48:14.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.841+0000 7f826e800640 1 --2- 172.21.15.2:0/1016642881 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8270161ca0 0x7f82700d2620 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f82600097a0 tx=0x7f826002a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab8733c1c493b791 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:14.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.841+0000 7f826d400640 1 -- 172.21.15.2:0/1016642881 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8260037070 con 0x7f8270161ca0 2024-09-10T08:48:14.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.841+0000 7f826d400640 1 -- 172.21.15.2:0/1016642881 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f826002ae50 con 0x7f8270161ca0 2024-09-10T08:48:14.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.841+0000 7f826d400640 1 -- 172.21.15.2:0/1016642881 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8260032660 con 0x7f8270161ca0 2024-09-10T08:48:14.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.841+0000 7f8275400640 1 -- 172.21.15.2:0/1016642881 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8270161ca0 msgr2=0x7f82700d2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:14.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.841+0000 7f8275400640 1 --2- 172.21.15.2:0/1016642881 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8270161ca0 0x7f82700d2620 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f82600097a0 tx=0x7f826002a100 comp rx=0 tx=0).stop 2024-09-10T08:48:14.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.842+0000 7f8275400640 1 -- 172.21.15.2:0/1016642881 shutdown_connections 2024-09-10T08:48:14.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.842+0000 7f8275400640 1 --2- 172.21.15.2:0/1016642881 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82700cf8c0 0x7f827006d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:14.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.842+0000 7f8275400640 1 --2- 172.21.15.2:0/1016642881 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8270161ca0 0x7f82700d2620 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:14.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.842+0000 7f8275400640 1 -- 172.21.15.2:0/1016642881 >> 172.21.15.2:0/1016642881 conn(0x7f827008bfd0 msgr2=0x7f82700d45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:14.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.842+0000 7f8275400640 1 -- 172.21.15.2:0/1016642881 shutdown_connections 2024-09-10T08:48:14.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.842+0000 7f8275400640 1 -- 172.21.15.2:0/1016642881 wait complete. 2024-09-10T08:48:14.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.843+0000 7f8275400640 1 Processor -- start 2024-09-10T08:48:14.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.844+0000 7f8275400640 1 -- start start 2024-09-10T08:48:14.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.844+0000 7f8275400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82700cf8c0 0x7f82701f4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:14.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.844+0000 7f8275400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82700d2b60 0x7f82700cb670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:14.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.844+0000 7f8275400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8270161ca0 0x7f82701f1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:14.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.844+0000 7f8275400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f827006d040 con 0x7f82700cf8c0 2024-09-10T08:48:14.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.844+0000 7f8275400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f827006cdf0 con 0x7f82700d2b60 2024-09-10T08:48:14.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.844+0000 7f8275400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f827006daa0 con 0x7f8270161ca0 2024-09-10T08:48:14.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.845+0000 7f826e800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82700cf8c0 0x7f82701f4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:14.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.845+0000 7f826e800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82700cf8c0 0x7f82701f4c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:36154/0 (socket says 172.21.15.2:36154) 2024-09-10T08:48:14.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.845+0000 7f826de00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82700d2b60 0x7f82700cb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:14.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.845+0000 7f826f200640 1 --2- 172.21.15.2:0/2933579858 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8270161ca0 0x7f82701f1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:14.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.845+0000 7f826e800640 1 -- 172.21.15.2:0/2933579858 learned_addr learned my addr 172.21.15.2:0/2933579858 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:14.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.845+0000 7f826f200640 1 -- 172.21.15.2:0/2933579858 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82700d2b60 msgr2=0x7f82700cb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:14.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.845+0000 7f826f200640 1 --2- 172.21.15.2:0/2933579858 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82700d2b60 0x7f82700cb670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:14.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.845+0000 7f826f200640 1 -- 172.21.15.2:0/2933579858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82700cf8c0 msgr2=0x7f82701f4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:14.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.845+0000 7f826f200640 1 --2- 172.21.15.2:0/2933579858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82700cf8c0 0x7f82701f4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:14.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.845+0000 7f826f200640 1 -- 172.21.15.2:0/2933579858 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82700b77b0 con 0x7f8270161ca0 2024-09-10T08:48:14.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.845+0000 7f826e800640 1 --2- 172.21.15.2:0/2933579858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82700cf8c0 0x7f82701f4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:48:14.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.846+0000 7f826f200640 1 --2- 172.21.15.2:0/2933579858 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8270161ca0 0x7f82701f1610 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8268009e50 tx=0x7f826800c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:14.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.846+0000 7f8266a00640 1 -- 172.21.15.2:0/2933579858 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8268018030 con 0x7f8270161ca0 2024-09-10T08:48:14.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.846+0000 7f8266a00640 1 -- 172.21.15.2:0/2933579858 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f826800cd90 con 0x7f8270161ca0 2024-09-10T08:48:14.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.846+0000 7f8266a00640 1 -- 172.21.15.2:0/2933579858 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8268003bb0 con 0x7f8270161ca0 2024-09-10T08:48:14.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.846+0000 7f8275400640 1 -- 172.21.15.2:0/2933579858 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82700b7a90 con 0x7f8270161ca0 2024-09-10T08:48:14.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.846+0000 7f8275400640 1 -- 172.21.15.2:0/2933579858 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f82700b8050 con 0x7f8270161ca0 2024-09-10T08:48:14.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.847+0000 7f8275400640 1 -- 172.21.15.2:0/2933579858 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f827006d560 con 0x7f8270161ca0 2024-09-10T08:48:14.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.849+0000 7f8266a00640 1 -- 172.21.15.2:0/2933579858 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 10) ==== 90657+0+0 (secure 0 0 0) 0x7f826801b070 con 0x7f8270161ca0 2024-09-10T08:48:14.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.850+0000 7f8266a00640 1 --2- 172.21.15.2:0/2933579858 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7f825006bfe0 0x7f825006e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:14.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.850+0000 7f8266a00640 1 -- 172.21.15.2:0/2933579858 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(39..39 src has 1..39) ==== 6359+0+0 (secure 0 0 0) 0x7f826808be70 con 0x7f8270161ca0 2024-09-10T08:48:14.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.850+0000 7f826e800640 1 -- 172.21.15.2:0/2933579858 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7f825006bfe0 msgr2=0x7f825006e4a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.155:6832/3369759420 2024-09-10T08:48:14.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.850+0000 7f826e800640 1 --2- 172.21.15.2:0/2933579858 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7f825006bfe0 0x7f825006e4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-10T08:48:14.852 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:48:14.852+0000 7fc2a191e040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-10T08:48:14.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:14.854+0000 7f8266a00640 1 -- 172.21.15.2:0/2933579858 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8268010040 con 0x7f8270161ca0 2024-09-10T08:48:15.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:15.051+0000 7f826e800640 1 -- 172.21.15.2:0/2933579858 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7f825006bfe0 msgr2=0x7f825006e4a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.155:6832/3369759420 2024-09-10T08:48:15.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:15.051+0000 7f826e800640 1 --2- 172.21.15.2:0/2933579858 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7f825006bfe0 0x7f825006e4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-10T08:48:15.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:15.076+0000 7f8275400640 1 -- 172.21.15.2:0/2933579858 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f82700b18b0 con 0x7f8270161ca0 2024-09-10T08:48:15.078 INFO:tasks.ceph.mon.a.smithi002.stderr:2024-09-10T08:48:15.078+0000 7f03c9600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-10T08:48:15.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:15.083+0000 7f8266a00640 1 -- 172.21.15.2:0/2933579858 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v19) ==== 161+0+0 (secure 0 0 0) 0x7f8268059b10 con 0x7f8270161ca0 2024-09-10T08:48:15.083 INFO:teuthology.orchestra.run.smithi002.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-10T08:48:15.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:15.086+0000 7f8275400640 1 -- 172.21.15.2:0/2933579858 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7f825006bfe0 msgr2=0x7f825006e4a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T08:48:15.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:15.086+0000 7f8275400640 1 --2- 172.21.15.2:0/2933579858 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7f825006bfe0 0x7f825006e4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:15.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:15.086+0000 7f8275400640 1 -- 172.21.15.2:0/2933579858 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8270161ca0 msgr2=0x7f82701f1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:15.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:15.086+0000 7f8275400640 1 --2- 172.21.15.2:0/2933579858 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8270161ca0 0x7f82701f1610 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8268009e50 tx=0x7f826800c490 comp rx=0 tx=0).stop 2024-09-10T08:48:15.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:15.086+0000 7f8275400640 1 -- 172.21.15.2:0/2933579858 shutdown_connections 2024-09-10T08:48:15.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:15.086+0000 7f8275400640 1 --2- 172.21.15.2:0/2933579858 >> [v2:172.21.15.155:6832/3369759420,v1:172.21.15.155:6833/3369759420] conn(0x7f825006bfe0 0x7f825006e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:15.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:15.086+0000 7f8275400640 1 --2- 172.21.15.2:0/2933579858 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8270161ca0 0x7f82701f1610 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:15.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:15.086+0000 7f8275400640 1 --2- 172.21.15.2:0/2933579858 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82700d2b60 0x7f82700cb670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:15.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:15.086+0000 7f8275400640 1 --2- 172.21.15.2:0/2933579858 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82700cf8c0 0x7f82701f4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:15.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:15.086+0000 7f8275400640 1 -- 172.21.15.2:0/2933579858 >> 172.21.15.2:0/2933579858 conn(0x7f827008bfd0 msgr2=0x7f82700b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:15.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:15.086+0000 7f8275400640 1 -- 172.21.15.2:0/2933579858 shutdown_connections 2024-09-10T08:48:15.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:15.086+0000 7f8275400640 1 -- 172.21.15.2:0/2933579858 wait complete. 2024-09-10T08:48:15.095 INFO:tasks.ceph.mds.c.smithi002.stderr: -3631> 2024-09-10T08:47:58.877+0000 7f571da00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-10T08:48:15.103 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-10T08:48:15.152 INFO:tasks.ceph.mds.c.smithi002.stdout:starting mds.c at 2024-09-10T08:48:15.266 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:48:15.266+0000 7f68143ef040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-10T08:48:15.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:15.266+0000 7fa9d8600640 1 Processor -- start 2024-09-10T08:48:15.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:15.266+0000 7fa9d8600640 1 -- start start 2024-09-10T08:48:15.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:15.267+0000 7fa9d8600640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa9d0161ca0 0x7fa9d00d2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:15.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:15.267+0000 7fa9d8600640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa9d00cf8c0 0x7fa9d006d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:15.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:15.267+0000 7fa9d8600640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9d00cfe50 con 0x7fa9d00d2b60 2024-09-10T08:48:15.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:15.267+0000 7fa9d8600640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fa9d00d2fd0 con 0x7fa9d00cf8c0 2024-09-10T08:48:15.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:15.267+0000 7fa9d8600640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fa9d00d34a0 con 0x7fa9d0161ca0 2024-09-10T08:48:15.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:15.267+0000 7fa9d5200640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fa9d00d2b60 0x7fa9d00cf1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:60116/0 (socket says 172.21.15.2:60116) 2024-09-10T08:48:15.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:15.267+0000 7fa9d5200640 1 -- 172.21.15.2:0/2565738698 learned_addr learned my addr 172.21.15.2:0/2565738698 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:48:15.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:15.267+0000 7fa9d6600640 1 --2- 172.21.15.2:0/2565738698 >> v2:172.21.15.2:3300/0 conn(0x7fa9d00cf8c0 0x7fa9d006d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:15.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:15.267+0000 7fa9d5c00640 1 --2- 172.21.15.2:0/2565738698 >> v2:172.21.15.155:3300/0 conn(0x7fa9d0161ca0 0x7fa9d00d2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:15.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:15.268+0000 7fa9d6600640 1 -- 172.21.15.2:0/2565738698 >> v2:172.21.15.155:3300/0 conn(0x7fa9d0161ca0 msgr2=0x7fa9d00d2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:48:15.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:15.268+0000 7fa9d6600640 1 --2- 172.21.15.2:0/2565738698 >> v2:172.21.15.155:3300/0 conn(0x7fa9d0161ca0 0x7fa9d00d2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:15.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:15.268+0000 7fa9d6600640 1 -- 172.21.15.2:0/2565738698 >> v1:172.21.15.2:6789/0 conn(0x7fa9d00d2b60 legacy=0x7fa9d00cf1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:15.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:15.268+0000 7fa9d6600640 1 -- 172.21.15.2:0/2565738698 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9d00d0130 con 0x7fa9d00cf8c0 2024-09-10T08:48:15.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:15.269+0000 7fa9d6600640 1 --2- 172.21.15.2:0/2565738698 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9d00cf8c0 0x7fa9d006d560 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa9d008d410 tx=0x7fa9c802a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3b43a522bf49dd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:15.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:15.270+0000 7fa9cfe00640 1 -- 172.21.15.2:0/2565738698 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c8007740 con 0x7fa9d00cf8c0 2024-09-10T08:48:15.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:15.270+0000 7fa9cfe00640 1 -- 172.21.15.2:0/2565738698 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9c80078e0 con 0x7fa9d00cf8c0 2024-09-10T08:48:15.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:15.270+0000 7fa9cfe00640 1 -- 172.21.15.2:0/2565738698 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c8007cb0 con 0x7fa9d00cf8c0 2024-09-10T08:48:15.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:15.270+0000 7fa9d8600640 1 -- 172.21.15.2:0/2565738698 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9d00cf8c0 msgr2=0x7fa9d006d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:15.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:15.270+0000 7fa9d8600640 1 --2- 172.21.15.2:0/2565738698 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9d00cf8c0 0x7fa9d006d560 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa9d008d410 tx=0x7fa9c802a5f0 comp rx=0 tx=0).stop 2024-09-10T08:48:15.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:15.270+0000 7fa9d8600640 1 -- 172.21.15.2:0/2565738698 shutdown_connections 2024-09-10T08:48:15.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:15.270+0000 7fa9d8600640 1 --2- 172.21.15.2:0/2565738698 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9d00cf8c0 0x7fa9d006d560 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:15.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:15.270+0000 7fa9d8600640 1 --2- 172.21.15.2:0/2565738698 >> v2:172.21.15.155:3300/0 conn(0x7fa9d0161ca0 0x7fa9d00d2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:15.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:15.271+0000 7fa9d8600640 1 -- 172.21.15.2:0/2565738698 >> 172.21.15.2:0/2565738698 conn(0x7fa9d008bfd0 msgr2=0x7fa9d00d45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:15.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:15.271+0000 7fa9d8600640 1 -- 172.21.15.2:0/2565738698 shutdown_connections 2024-09-10T08:48:15.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:15.271+0000 7fa9d8600640 1 -- 172.21.15.2:0/2565738698 wait complete. 2024-09-10T08:48:15.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:15.272+0000 7fa9d8600640 1 Processor -- start 2024-09-10T08:48:15.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:15.273+0000 7fa9d8600640 1 -- start start 2024-09-10T08:48:15.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:15.274+0000 7fa9d8600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9d00cf8c0 0x7fa9d0157c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:15.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:15.274+0000 7fa9d8600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9d00d2b60 0x7fa9d00ca6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:15.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:15.274+0000 7fa9d8600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9d0161ca0 0x7fa9d00b73d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:15.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:15.274+0000 7fa9d8600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fa9d006d040 con 0x7fa9d0161ca0 2024-09-10T08:48:15.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:15.274+0000 7fa9d8600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa9d006cdf0 con 0x7fa9d00cf8c0 2024-09-10T08:48:15.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:15.274+0000 7fa9d8600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fa9d006daa0 con 0x7fa9d00d2b60 2024-09-10T08:48:15.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:15.274+0000 7fa9d5c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9d00cf8c0 0x7fa9d0157c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:15.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:15.274+0000 7fa9d5c00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9d00cf8c0 0x7fa9d0157c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.2:52694/0 (socket says 172.21.15.2:52694) 2024-09-10T08:48:15.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:15.275+0000 7fa9d5c00640 1 -- 172.21.15.2:0/417720653 learned_addr learned my addr 172.21.15.2:0/417720653 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:15.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:15.275+0000 7fa9d5200640 1 --2- 172.21.15.2:0/417720653 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9d00d2b60 0x7fa9d00ca6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:15.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:15.275+0000 7fa9d5c00640 1 -- 172.21.15.2:0/417720653 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9d00d2b60 msgr2=0x7fa9d00ca6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:15.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:15.275+0000 7fa9d5c00640 1 --2- 172.21.15.2:0/417720653 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9d00d2b60 0x7fa9d00ca6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:15.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:15.275+0000 7fa9d5c00640 1 -- 172.21.15.2:0/417720653 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9d0161ca0 msgr2=0x7fa9d00b73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:15.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:15.275+0000 7fa9d5c00640 1 --2- 172.21.15.2:0/417720653 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9d0161ca0 0x7fa9d00b73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:15.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:15.275+0000 7fa9d5c00640 1 -- 172.21.15.2:0/417720653 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9d00cadc0 con 0x7fa9d00cf8c0 2024-09-10T08:48:15.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:15.276+0000 7fa9d5c00640 1 --2- 172.21.15.2:0/417720653 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9d00cf8c0 0x7fa9d0157c90 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa9c400e870 tx=0x7fa9c400ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:15.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:15.280+0000 7fa9cd600640 1 -- 172.21.15.2:0/417720653 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c4017070 con 0x7fa9d00cf8c0 2024-09-10T08:48:15.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:15.280+0000 7fa9cd600640 1 -- 172.21.15.2:0/417720653 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9c400c940 con 0x7fa9d00cf8c0 2024-09-10T08:48:15.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:15.280+0000 7fa9cd600640 1 -- 172.21.15.2:0/417720653 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c400cd10 con 0x7fa9d00cf8c0 2024-09-10T08:48:15.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:15.280+0000 7fa9d8600640 1 -- 172.21.15.2:0/417720653 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9d01e8550 con 0x7fa9d00cf8c0 2024-09-10T08:48:15.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:15.280+0000 7fa9d8600640 1 -- 172.21.15.2:0/417720653 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9d00c8d80 con 0x7fa9d00cf8c0 2024-09-10T08:48:15.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:15.282+0000 7fa9d8600640 1 -- 172.21.15.2:0/417720653 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9d0068e30 con 0x7fa9d00cf8c0 2024-09-10T08:48:15.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:15.283+0000 7fa9cd600640 1 -- 172.21.15.2:0/417720653 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 11) ==== 90209+0+0 (secure 0 0 0) 0x7fa9c401a070 con 0x7fa9d00cf8c0 2024-09-10T08:48:15.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:15.284+0000 7fa9cd600640 1 -- 172.21.15.2:0/417720653 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6832+0+0 (secure 0 0 0) 0x7fa9c408ac40 con 0x7fa9d00cf8c0 2024-09-10T08:48:15.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:15.289+0000 7fa9cd600640 1 -- 172.21.15.2:0/417720653 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa9d0068e30 con 0x7fa9d00cf8c0 2024-09-10T08:48:15.344 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:48:15.344+0000 7f6790c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T08:48:15.344 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:48:15.344+0000 7f6790c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T08:48:15.344 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:48:15.344+0000 7f6790c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T08:48:15.344 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:48:15.344+0000 7f6790c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T08:48:15.344 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:48:15.344+0000 7f6790c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T08:48:15.344 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:48:15.344+0000 7f678da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T08:48:15.345 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:48:15.344+0000 7f678da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T08:48:15.345 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:48:15.344+0000 7f678da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T08:48:15.345 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:48:15.344+0000 7f678da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T08:48:15.345 INFO:tasks.ceph.mgr.x.smithi155.stderr:2024-09-10T08:48:15.344+0000 7f678da00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-10T08:48:15.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:15.513+0000 7fa9d8600640 1 -- 172.21.15.2:0/417720653 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fa9d006d560 con 0x7fa9d00cf8c0 2024-09-10T08:48:15.560 INFO:tasks.ceph.mgr.y.smithi002.stderr:2024-09-10T08:48:15.559+0000 7fc2a191e040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-10T08:48:16.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:16.084+0000 7fa9cd600640 1 -- 172.21.15.2:0/417720653 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v20) ==== 104+0+0 (secure 0 0 0) 0x7fa9c4059590 con 0x7fa9d00cf8c0 2024-09-10T08:48:16.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:16.087+0000 7fa9d8600640 1 -- 172.21.15.2:0/417720653 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9d00cf8c0 msgr2=0x7fa9d0157c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:16.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:16.087+0000 7fa9d8600640 1 --2- 172.21.15.2:0/417720653 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9d00cf8c0 0x7fa9d0157c90 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa9c400e870 tx=0x7fa9c400ed30 comp rx=0 tx=0).stop 2024-09-10T08:48:16.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:16.087+0000 7fa9d8600640 1 -- 172.21.15.2:0/417720653 shutdown_connections 2024-09-10T08:48:16.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:16.087+0000 7fa9d8600640 1 --2- 172.21.15.2:0/417720653 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9d0161ca0 0x7fa9d00b73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:16.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:16.087+0000 7fa9d8600640 1 --2- 172.21.15.2:0/417720653 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa9d00d2b60 0x7fa9d00ca6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:16.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:16.087+0000 7fa9d8600640 1 --2- 172.21.15.2:0/417720653 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9d00cf8c0 0x7fa9d0157c90 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:16.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:16.087+0000 7fa9d8600640 1 -- 172.21.15.2:0/417720653 >> 172.21.15.2:0/417720653 conn(0x7fa9d008bfd0 msgr2=0x7fa9d00d0ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:16.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:16.087+0000 7fa9d8600640 1 -- 172.21.15.2:0/417720653 shutdown_connections 2024-09-10T08:48:16.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:16.087+0000 7fa9d8600640 1 -- 172.21.15.2:0/417720653 wait complete. 2024-09-10T08:48:16.105 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-10T08:48:16.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:16.269+0000 7f04ab400640 1 Processor -- start 2024-09-10T08:48:16.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:16.269+0000 7f04ab400640 1 -- start start 2024-09-10T08:48:16.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:16.270+0000 7f04ab400640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f04a415b560 0x7f04a40b3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:16.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:16.270+0000 7f04ab400640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04a415b940 con 0x7f04a40d07d0 2024-09-10T08:48:16.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:16.270+0000 7f04ab400640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04a415fe60 con 0x7f04a40cba60 2024-09-10T08:48:16.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:16.270+0000 7f04ab400640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f04a40cefb0 con 0x7f04a415b560 2024-09-10T08:48:16.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:16.270+0000 7f049be00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f04a40d07d0 0x7f04a415f040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:44512/0 (socket says 172.21.15.2:44512) 2024-09-10T08:48:16.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:16.270+0000 7f049be00640 1 -- 172.21.15.2:0/626285634 learned_addr learned my addr 172.21.15.2:0/626285634 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:48:16.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:16.270+0000 7f04a8a00640 1 --2- 172.21.15.2:0/626285634 >> v2:172.21.15.155:3300/0 conn(0x7f04a415b560 0x7f04a40b3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:16.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:16.271+0000 7f04a3e00640 1 -- 172.21.15.2:0/626285634 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1237448440 0 0) 0x7f048c001110 con 0x7f04a40d07d0 2024-09-10T08:48:16.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:16.271+0000 7f04a3e00640 1 -- 172.21.15.2:0/626285634 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0488005730 con 0x7f04a40d07d0 2024-09-10T08:48:16.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:16.271+0000 7f04a8a00640 1 -- 172.21.15.2:0/626285634 >> v1:172.21.15.155:6789/0 conn(0x7f04a40cba60 legacy=0x7f04a415f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:16.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:16.271+0000 7f04a8a00640 1 -- 172.21.15.2:0/626285634 >> v1:172.21.15.2:6789/0 conn(0x7f04a40d07d0 legacy=0x7f04a415f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:16.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:16.271+0000 7f04a8a00640 1 -- 172.21.15.2:0/626285634 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04a40ce0c0 con 0x7f04a415b560 2024-09-10T08:48:16.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:16.272+0000 7f04a8a00640 1 --2- 172.21.15.2:0/626285634 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04a415b560 0x7f04a40b3050 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f04940097a0 tx=0x7f049402a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73daa308dea27aaf server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:16.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:16.272+0000 7f04a3e00640 1 -- 172.21.15.2:0/626285634 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0494037070 con 0x7f04a415b560 2024-09-10T08:48:16.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:16.272+0000 7f04a3e00640 1 -- 172.21.15.2:0/626285634 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0494032440 con 0x7f04a415b560 2024-09-10T08:48:16.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:16.272+0000 7f04a3e00640 1 -- 172.21.15.2:0/626285634 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04940327f0 con 0x7f04a415b560 2024-09-10T08:48:16.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:16.273+0000 7f04ab400640 1 -- 172.21.15.2:0/626285634 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04a415b560 msgr2=0x7f04a40b3050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:16.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:16.273+0000 7f04ab400640 1 --2- 172.21.15.2:0/626285634 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04a415b560 0x7f04a40b3050 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f04940097a0 tx=0x7f049402a230 comp rx=0 tx=0).stop 2024-09-10T08:48:16.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:16.273+0000 7f04ab400640 1 -- 172.21.15.2:0/626285634 shutdown_connections 2024-09-10T08:48:16.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:16.273+0000 7f04ab400640 1 --2- 172.21.15.2:0/626285634 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04a415b560 0x7f04a40b3050 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:16.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:16.273+0000 7f04ab400640 1 -- 172.21.15.2:0/626285634 >> 172.21.15.2:0/626285634 conn(0x7f04a406bdf0 msgr2=0x7f04a406c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:16.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:16.273+0000 7f04ab400640 1 -- 172.21.15.2:0/626285634 shutdown_connections 2024-09-10T08:48:16.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:16.273+0000 7f04ab400640 1 -- 172.21.15.2:0/626285634 wait complete. 2024-09-10T08:48:16.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:16.275+0000 7f04ab400640 1 Processor -- start 2024-09-10T08:48:16.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:16.275+0000 7f04ab400640 1 -- start start 2024-09-10T08:48:16.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:16.276+0000 7f04ab400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04a40cba60 0x7f04a40c3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:16.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:16.276+0000 7f04ab400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04a40d07d0 0x7f04a41f34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:16.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:16.276+0000 7f04ab400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04a415b560 0x7f04a4073470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:16.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:16.276+0000 7f04ab400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f04a40ce960 con 0x7f04a40cba60 2024-09-10T08:48:16.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:16.276+0000 7f04ab400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f04a40ce680 con 0x7f04a415b560 2024-09-10T08:48:16.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:16.276+0000 7f04ab400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f04a40cec40 con 0x7f04a40d07d0 2024-09-10T08:48:16.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:16.276+0000 7f04a8a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04a40cba60 0x7f04a40c3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:16.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:16.276+0000 7f04a8a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04a40cba60 0x7f04a40c3cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52096/0 (socket says 172.21.15.2:52096) 2024-09-10T08:48:16.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:16.276+0000 7f04a8a00640 1 -- 172.21.15.2:0/3765569658 learned_addr learned my addr 172.21.15.2:0/3765569658 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:16.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:16.276+0000 7f049be00640 1 --2- 172.21.15.2:0/3765569658 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04a40d07d0 0x7f04a41f34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:16.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:16.276+0000 7f04a9400640 1 --2- 172.21.15.2:0/3765569658 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04a415b560 0x7f04a4073470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:16.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:16.277+0000 7f04a8a00640 1 -- 172.21.15.2:0/3765569658 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04a40d07d0 msgr2=0x7f04a41f34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:16.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:16.277+0000 7f04a8a00640 1 --2- 172.21.15.2:0/3765569658 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04a40d07d0 0x7f04a41f34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:16.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:16.277+0000 7f04a8a00640 1 -- 172.21.15.2:0/3765569658 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04a415b560 msgr2=0x7f04a4073470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:16.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:16.277+0000 7f04a8a00640 1 --2- 172.21.15.2:0/3765569658 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04a415b560 0x7f04a4073470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:16.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:16.277+0000 7f04a8a00640 1 -- 172.21.15.2:0/3765569658 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04a4099e60 con 0x7f04a40cba60 2024-09-10T08:48:16.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:16.278+0000 7f04a8a00640 1 --2- 172.21.15.2:0/3765569658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04a40cba60 0x7f04a40c3cf0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f04940097a0 tx=0x7f04940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:16.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:16.281+0000 7f04a1600640 1 -- 172.21.15.2:0/3765569658 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0494037050 con 0x7f04a40cba60 2024-09-10T08:48:16.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:16.281+0000 7f04a1600640 1 -- 172.21.15.2:0/3765569658 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0494038040 con 0x7f04a40cba60 2024-09-10T08:48:16.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:16.281+0000 7f04a1600640 1 -- 172.21.15.2:0/3765569658 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0494004470 con 0x7f04a40cba60 2024-09-10T08:48:16.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:16.281+0000 7f04ab400640 1 -- 172.21.15.2:0/3765569658 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04a40c4380 con 0x7f04a40cba60 2024-09-10T08:48:16.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:16.282+0000 7f04ab400640 1 -- 172.21.15.2:0/3765569658 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04a40c6780 con 0x7f04a40cba60 2024-09-10T08:48:16.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:16.283+0000 7f04ab400640 1 -- 172.21.15.2:0/3765569658 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04a40cc6e0 con 0x7f04a40cba60 2024-09-10T08:48:16.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:16.284+0000 7f04a1600640 1 -- 172.21.15.2:0/3765569658 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 12) ==== 90336+0+0 (secure 0 0 0) 0x7f049403c6d0 con 0x7f04a40cba60 2024-09-10T08:48:16.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:16.285+0000 7f04a1600640 1 --2- 172.21.15.2:0/3765569658 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f048006bc80 0x7f048006e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:16.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:16.285+0000 7f04a1600640 1 -- 172.21.15.2:0/3765569658 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6832+0+0 (secure 0 0 0) 0x7f04940ab750 con 0x7f04a40cba60 2024-09-10T08:48:16.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:16.287+0000 7f049be00640 1 --2- 172.21.15.2:0/3765569658 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f048006bc80 0x7f048006e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:16.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:16.288+0000 7f049be00640 1 --2- 172.21.15.2:0/3765569658 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f048006bc80 0x7f048006e140 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f04a40c6df0 tx=0x7f048c007b70 comp rx=0 tx=0).ready entity=mgr.4862 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:16.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:16.290+0000 7f04a1600640 1 -- 172.21.15.2:0/3765569658 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0494079990 con 0x7f04a40cba60 2024-09-10T08:48:16.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:16.475+0000 7f04ab400640 1 -- 172.21.15.2:0/3765569658 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f04a41f3a20 con 0x7f04a40cba60 2024-09-10T08:48:17.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.284+0000 7f04a1600640 1 -- 172.21.15.2:0/3765569658 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v42) ==== 181+0+0 (secure 0 0 0) 0x7f049407ee20 con 0x7f04a40cba60 2024-09-10T08:48:17.284 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' removed 2024-09-10T08:48:17.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.288+0000 7f04ab400640 1 -- 172.21.15.2:0/3765569658 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f048006bc80 msgr2=0x7f048006e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:17.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.288+0000 7f04ab400640 1 --2- 172.21.15.2:0/3765569658 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f048006bc80 0x7f048006e140 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f04a40c6df0 tx=0x7f048c007b70 comp rx=0 tx=0).stop 2024-09-10T08:48:17.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.288+0000 7f04ab400640 1 -- 172.21.15.2:0/3765569658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04a40cba60 msgr2=0x7f04a40c3cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:17.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.288+0000 7f04ab400640 1 --2- 172.21.15.2:0/3765569658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04a40cba60 0x7f04a40c3cf0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f04940097a0 tx=0x7f04940046c0 comp rx=0 tx=0).stop 2024-09-10T08:48:17.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.289+0000 7f04ab400640 1 -- 172.21.15.2:0/3765569658 shutdown_connections 2024-09-10T08:48:17.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.289+0000 7f04ab400640 1 --2- 172.21.15.2:0/3765569658 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f048006bc80 0x7f048006e140 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:17.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.289+0000 7f04ab400640 1 --2- 172.21.15.2:0/3765569658 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f04a415b560 0x7f04a4073470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:17.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.289+0000 7f04ab400640 1 --2- 172.21.15.2:0/3765569658 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f04a40d07d0 0x7f04a41f34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:17.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.289+0000 7f04ab400640 1 --2- 172.21.15.2:0/3765569658 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f04a40cba60 0x7f04a40c3cf0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:17.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.289+0000 7f04ab400640 1 -- 172.21.15.2:0/3765569658 >> 172.21.15.2:0/3765569658 conn(0x7f04a406bdf0 msgr2=0x7f04a40afe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:17.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.289+0000 7f04ab400640 1 -- 172.21.15.2:0/3765569658 shutdown_connections 2024-09-10T08:48:17.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.289+0000 7f04ab400640 1 -- 172.21.15.2:0/3765569658 wait complete. 2024-09-10T08:48:17.315 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-10T08:48:17.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.480+0000 7f24f8e00640 1 Processor -- start 2024-09-10T08:48:17.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.480+0000 7f24f8e00640 1 -- start start 2024-09-10T08:48:17.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.481+0000 7f24f8e00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f24f4161ce0 0x7f24f40d0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:17.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.481+0000 7f24f8e00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24f40cf180 con 0x7f24f40b5a80 2024-09-10T08:48:17.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.481+0000 7f24f8e00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24f40b5ec0 con 0x7f24f40d2e00 2024-09-10T08:48:17.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.481+0000 7f24f8e00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f24f40d3690 con 0x7f24f4161ce0 2024-09-10T08:48:17.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.481+0000 7f24f1400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f24f40b5a80 0x7f24f40d26f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:44514/0 (socket says 172.21.15.2:44514) 2024-09-10T08:48:17.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.481+0000 7f24f1400640 1 -- 172.21.15.2:0/3762499929 learned_addr learned my addr 172.21.15.2:0/3762499929 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:48:17.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.481+0000 7f24f1e00640 1 --2- 172.21.15.2:0/3762499929 >> v2:172.21.15.155:3300/0 conn(0x7f24f4161ce0 0x7f24f40d0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:17.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.482+0000 7f24f0a00640 1 -- 172.21.15.2:0/3762499929 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 933879353 0 0) 0x7f24e0001110 con 0x7f24f40b5a80 2024-09-10T08:48:17.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.482+0000 7f24f0a00640 1 -- 172.21.15.2:0/3762499929 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f24d8003520 con 0x7f24f40b5a80 2024-09-10T08:48:17.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.482+0000 7f24f1e00640 1 -- 172.21.15.2:0/3762499929 >> v1:172.21.15.155:6789/0 conn(0x7f24f40d2e00 legacy=0x7f24f40cf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:17.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.482+0000 7f24f0a00640 1 -- 172.21.15.2:0/3762499929 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3066628617 0 0) 0x7f24f40b5ec0 con 0x7f24f40d2e00 2024-09-10T08:48:17.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.482+0000 7f24f1e00640 1 -- 172.21.15.2:0/3762499929 >> v1:172.21.15.2:6789/0 conn(0x7f24f40b5a80 legacy=0x7f24f40d26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:17.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.482+0000 7f24f1e00640 1 -- 172.21.15.2:0/3762499929 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24f40d13f0 con 0x7f24f4161ce0 2024-09-10T08:48:17.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.483+0000 7f24f1e00640 1 --2- 172.21.15.2:0/3762499929 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24f4161ce0 0x7f24f40d0d80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f24e40097a0 tx=0x7f24e402a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59016e3cf5d47687 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:17.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.483+0000 7f24f0a00640 1 -- 172.21.15.2:0/3762499929 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24e4037070 con 0x7f24f4161ce0 2024-09-10T08:48:17.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.483+0000 7f24f0a00640 1 -- 172.21.15.2:0/3762499929 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24e4032440 con 0x7f24f4161ce0 2024-09-10T08:48:17.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.483+0000 7f24f0a00640 1 -- 172.21.15.2:0/3762499929 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24e402ae60 con 0x7f24f4161ce0 2024-09-10T08:48:17.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.484+0000 7f24f8e00640 1 -- 172.21.15.2:0/3762499929 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24f4161ce0 msgr2=0x7f24f40d0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:17.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.484+0000 7f24f8e00640 1 --2- 172.21.15.2:0/3762499929 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24f4161ce0 0x7f24f40d0d80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f24e40097a0 tx=0x7f24e402a110 comp rx=0 tx=0).stop 2024-09-10T08:48:17.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.484+0000 7f24f8e00640 1 -- 172.21.15.2:0/3762499929 shutdown_connections 2024-09-10T08:48:17.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.484+0000 7f24f8e00640 1 --2- 172.21.15.2:0/3762499929 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24f4161ce0 0x7f24f40d0d80 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:17.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.484+0000 7f24f8e00640 1 -- 172.21.15.2:0/3762499929 >> 172.21.15.2:0/3762499929 conn(0x7f24f408bfd0 msgr2=0x7f24f40d45e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:17.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.484+0000 7f24f8e00640 1 -- 172.21.15.2:0/3762499929 shutdown_connections 2024-09-10T08:48:17.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.484+0000 7f24f8e00640 1 -- 172.21.15.2:0/3762499929 wait complete. 2024-09-10T08:48:17.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.486+0000 7f24f8e00640 1 Processor -- start 2024-09-10T08:48:17.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.486+0000 7f24f8e00640 1 -- start start 2024-09-10T08:48:17.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.487+0000 7f24f8e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24f40b5a80 0x7f24f41567e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:17.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.487+0000 7f24f8e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24f40d2e00 0x7f24f40ca840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:17.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.487+0000 7f24f8e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24f4161ce0 0x7f24f415ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:17.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.487+0000 7f24f8e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f24f40d1c90 con 0x7f24f40d2e00 2024-09-10T08:48:17.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.487+0000 7f24f8e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f24f40d19b0 con 0x7f24f4161ce0 2024-09-10T08:48:17.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.487+0000 7f24f8e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f24f40b3db0 con 0x7f24f40b5a80 2024-09-10T08:48:17.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.487+0000 7f24f1400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24f40d2e00 0x7f24f40ca840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:17.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.487+0000 7f24f1400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24f40d2e00 0x7f24f40ca840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52112/0 (socket says 172.21.15.2:52112) 2024-09-10T08:48:17.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.487+0000 7f24f1400640 1 -- 172.21.15.2:0/2192901826 learned_addr learned my addr 172.21.15.2:0/2192901826 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:17.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.487+0000 7f24f2800640 1 --2- 172.21.15.2:0/2192901826 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24f4161ce0 0x7f24f415ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:17.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.487+0000 7f24f1e00640 1 --2- 172.21.15.2:0/2192901826 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24f40b5a80 0x7f24f41567e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:17.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.487+0000 7f24f1400640 1 -- 172.21.15.2:0/2192901826 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24f40b5a80 msgr2=0x7f24f41567e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:17.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.487+0000 7f24f1400640 1 --2- 172.21.15.2:0/2192901826 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24f40b5a80 0x7f24f41567e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:17.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.487+0000 7f24f1400640 1 -- 172.21.15.2:0/2192901826 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24f4161ce0 msgr2=0x7f24f415ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:17.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.487+0000 7f24f1400640 1 --2- 172.21.15.2:0/2192901826 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24f4161ce0 0x7f24f415ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:17.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.487+0000 7f24f1400640 1 -- 172.21.15.2:0/2192901826 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24f415b320 con 0x7f24f40d2e00 2024-09-10T08:48:17.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.487+0000 7f24f2800640 1 --2- 172.21.15.2:0/2192901826 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24f4161ce0 0x7f24f415ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:48:17.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.487+0000 7f24f1e00640 1 --2- 172.21.15.2:0/2192901826 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24f40b5a80 0x7f24f41567e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:48:17.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.488+0000 7f24f1400640 1 --2- 172.21.15.2:0/2192901826 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24f40d2e00 0x7f24f40ca840 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f24e000c3a0 tx=0x7f24e000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:17.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.488+0000 7f24ea000640 1 -- 172.21.15.2:0/2192901826 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24e0017070 con 0x7f24f40d2e00 2024-09-10T08:48:17.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.488+0000 7f24ea000640 1 -- 172.21.15.2:0/2192901826 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24e0005ce0 con 0x7f24f40d2e00 2024-09-10T08:48:17.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.488+0000 7f24ea000640 1 -- 172.21.15.2:0/2192901826 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24e0007310 con 0x7f24f40d2e00 2024-09-10T08:48:17.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.488+0000 7f24f8e00640 1 -- 172.21.15.2:0/2192901826 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24f40c9d90 con 0x7f24f40d2e00 2024-09-10T08:48:17.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.488+0000 7f24f8e00640 1 -- 172.21.15.2:0/2192901826 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24f40ca350 con 0x7f24f40d2e00 2024-09-10T08:48:17.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.489+0000 7f24f8e00640 1 -- 172.21.15.2:0/2192901826 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24f41620c0 con 0x7f24f40d2e00 2024-09-10T08:48:17.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.490+0000 7f24ea000640 1 -- 172.21.15.2:0/2192901826 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 90442+0+0 (secure 0 0 0) 0x7f24e001a070 con 0x7f24f40d2e00 2024-09-10T08:48:17.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.491+0000 7f24ea000640 1 --2- 172.21.15.2:0/2192901826 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f24d406bdd0 0x7f24d406e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:17.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.492+0000 7f24ea000640 1 -- 172.21.15.2:0/2192901826 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6394+0+0 (secure 0 0 0) 0x7f24e008a430 con 0x7f24f40d2e00 2024-09-10T08:48:17.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.492+0000 7f24f1e00640 1 --2- 172.21.15.2:0/2192901826 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f24d406bdd0 0x7f24d406e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:17.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.493+0000 7f24f1e00640 1 --2- 172.21.15.2:0/2192901826 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f24d406bdd0 0x7f24d406e290 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f24e4034000 tx=0x7f24e402e000 comp rx=0 tx=0).ready entity=mgr.4862 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:17.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.496+0000 7f24ea000640 1 -- 172.21.15.2:0/2192901826 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f24f40cf180 con 0x7f24f40d2e00 2024-09-10T08:48:17.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:17.678+0000 7f24f8e00640 1 -- 172.21.15.2:0/2192901826 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f24f408c740 con 0x7f24f40d2e00 2024-09-10T08:48:18.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.289+0000 7f24ea000640 1 -- 172.21.15.2:0/2192901826 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v43) ==== 169+0+0 (secure 0 0 0) 0x7f24e0058c00 con 0x7f24f40d2e00 2024-09-10T08:48:18.290 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' removed 2024-09-10T08:48:18.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.296+0000 7f24f8e00640 1 -- 172.21.15.2:0/2192901826 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f24d406bdd0 msgr2=0x7f24d406e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:18.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.296+0000 7f24f8e00640 1 --2- 172.21.15.2:0/2192901826 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f24d406bdd0 0x7f24d406e290 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f24e4034000 tx=0x7f24e402e000 comp rx=0 tx=0).stop 2024-09-10T08:48:18.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.296+0000 7f24f8e00640 1 -- 172.21.15.2:0/2192901826 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24f40d2e00 msgr2=0x7f24f40ca840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:18.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.296+0000 7f24f8e00640 1 --2- 172.21.15.2:0/2192901826 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24f40d2e00 0x7f24f40ca840 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f24e000c3a0 tx=0x7f24e000c860 comp rx=0 tx=0).stop 2024-09-10T08:48:18.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.297+0000 7f24f8e00640 1 -- 172.21.15.2:0/2192901826 shutdown_connections 2024-09-10T08:48:18.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.297+0000 7f24f8e00640 1 --2- 172.21.15.2:0/2192901826 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f24d406bdd0 0x7f24d406e290 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:18.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.297+0000 7f24f8e00640 1 --2- 172.21.15.2:0/2192901826 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24f4161ce0 0x7f24f415ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:18.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.297+0000 7f24f8e00640 1 --2- 172.21.15.2:0/2192901826 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f24f40d2e00 0x7f24f40ca840 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:18.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.297+0000 7f24f8e00640 1 --2- 172.21.15.2:0/2192901826 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f24f40b5a80 0x7f24f41567e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:18.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.297+0000 7f24f8e00640 1 -- 172.21.15.2:0/2192901826 >> 172.21.15.2:0/2192901826 conn(0x7f24f408bfd0 msgr2=0x7f24f4160a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:18.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.297+0000 7f24f8e00640 1 -- 172.21.15.2:0/2192901826 shutdown_connections 2024-09-10T08:48:18.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.298+0000 7f24f8e00640 1 -- 172.21.15.2:0/2192901826 wait complete. 2024-09-10T08:48:18.320 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-10T08:48:18.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.481+0000 7fc953800640 1 Processor -- start 2024-09-10T08:48:18.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.481+0000 7fc953800640 1 -- start start 2024-09-10T08:48:18.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.482+0000 7fc953800640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc94c0cf310 0x7fc94c15d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:18.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.483+0000 7fc953800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc94c06df50 0x7fc94c0b43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:18.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.483+0000 7fc953800640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc94c1603b0 con 0x7fc94c15c460 2024-09-10T08:48:18.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.483+0000 7fc953800640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fc94c161030 con 0x7fc94c06df50 2024-09-10T08:48:18.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.483+0000 7fc953800640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fc94c15da70 con 0x7fc94c0cf310 2024-09-10T08:48:18.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.483+0000 7fc951800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc94c06df50 0x7fc94c0b43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:18.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.483+0000 7fc951800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc94c06df50 0x7fc94c0b43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52122/0 (socket says 172.21.15.2:52122) 2024-09-10T08:48:18.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.483+0000 7fc951800640 1 -- 172.21.15.2:0/199940985 learned_addr learned my addr 172.21.15.2:0/199940985 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:18.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.483+0000 7fc94be00640 1 --2- 172.21.15.2:0/199940985 >> v2:172.21.15.155:3300/0 conn(0x7fc94c0cf310 0x7fc94c15d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:18.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.483+0000 7fc951800640 1 -- 172.21.15.2:0/199940985 >> v2:172.21.15.155:3300/0 conn(0x7fc94c0cf310 msgr2=0x7fc94c15d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:48:18.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.483+0000 7fc951800640 1 --2- 172.21.15.2:0/199940985 >> v2:172.21.15.155:3300/0 conn(0x7fc94c0cf310 0x7fc94c15d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:18.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.483+0000 7fc951800640 1 -- 172.21.15.2:0/199940985 >> v1:172.21.15.155:6789/0 conn(0x7fc94c15c460 legacy=0x7fc94c0cec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:18.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.483+0000 7fc951800640 1 -- 172.21.15.2:0/199940985 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc94c160690 con 0x7fc94c06df50 2024-09-10T08:48:18.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.484+0000 7fc951800640 1 --2- 172.21.15.2:0/199940985 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc94c06df50 0x7fc94c0b43d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc94c0cc870 tx=0x7fc94402a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a63ae3cf2f9b7e89 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:18.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.485+0000 7fc94b400640 1 -- 172.21.15.2:0/199940985 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc944036070 con 0x7fc94c06df50 2024-09-10T08:48:18.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.485+0000 7fc94b400640 1 -- 172.21.15.2:0/199940985 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc944031600 con 0x7fc94c06df50 2024-09-10T08:48:18.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.485+0000 7fc94b400640 1 -- 172.21.15.2:0/199940985 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9440319d0 con 0x7fc94c06df50 2024-09-10T08:48:18.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.485+0000 7fc953800640 1 -- 172.21.15.2:0/199940985 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc94c06df50 msgr2=0x7fc94c0b43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:18.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.485+0000 7fc953800640 1 --2- 172.21.15.2:0/199940985 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc94c06df50 0x7fc94c0b43d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc94c0cc870 tx=0x7fc94402a760 comp rx=0 tx=0).stop 2024-09-10T08:48:18.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.485+0000 7fc953800640 1 -- 172.21.15.2:0/199940985 shutdown_connections 2024-09-10T08:48:18.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.485+0000 7fc953800640 1 --2- 172.21.15.2:0/199940985 >> v2:172.21.15.155:3300/0 conn(0x7fc94c0cf310 0x7fc94c15d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:18.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.485+0000 7fc953800640 1 --2- 172.21.15.2:0/199940985 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc94c06df50 0x7fc94c0b43d0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:18.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.485+0000 7fc953800640 1 -- 172.21.15.2:0/199940985 >> 172.21.15.2:0/199940985 conn(0x7fc94c0d02c0 msgr2=0x7fc94c0d06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:18.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.485+0000 7fc953800640 1 -- 172.21.15.2:0/199940985 shutdown_connections 2024-09-10T08:48:18.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.485+0000 7fc953800640 1 -- 172.21.15.2:0/199940985 wait complete. 2024-09-10T08:48:18.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.487+0000 7fc953800640 1 Processor -- start 2024-09-10T08:48:18.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.487+0000 7fc953800640 1 -- start start 2024-09-10T08:48:18.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.488+0000 7fc953800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc94c06df50 0x7fc94c14d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:18.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.488+0000 7fc953800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc94c0cf310 0x7fc94c09a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:18.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.488+0000 7fc953800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc94c15c460 0x7fc94c09a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:18.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.488+0000 7fc953800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc94c160080 con 0x7fc94c06df50 2024-09-10T08:48:18.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.488+0000 7fc953800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc94c160c50 con 0x7fc94c0cf310 2024-09-10T08:48:18.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.488+0000 7fc953800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc94c15c840 con 0x7fc94c15c460 2024-09-10T08:48:18.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.488+0000 7fc950e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc94c06df50 0x7fc94c14d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:18.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.488+0000 7fc950e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc94c06df50 0x7fc94c14d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52126/0 (socket says 172.21.15.2:52126) 2024-09-10T08:48:18.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.488+0000 7fc950e00640 1 -- 172.21.15.2:0/3940340625 learned_addr learned my addr 172.21.15.2:0/3940340625 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:18.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.488+0000 7fc94be00640 1 --2- 172.21.15.2:0/3940340625 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc94c0cf310 0x7fc94c09a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:18.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.489+0000 7fc951800640 1 --2- 172.21.15.2:0/3940340625 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc94c15c460 0x7fc94c09a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:18.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.489+0000 7fc950e00640 1 -- 172.21.15.2:0/3940340625 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc94c15c460 msgr2=0x7fc94c09a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:18.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.489+0000 7fc950e00640 1 --2- 172.21.15.2:0/3940340625 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc94c15c460 0x7fc94c09a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:18.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.489+0000 7fc950e00640 1 -- 172.21.15.2:0/3940340625 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc94c0cf310 msgr2=0x7fc94c09a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:18.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.489+0000 7fc950e00640 1 --2- 172.21.15.2:0/3940340625 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc94c0cf310 0x7fc94c09a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:18.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.489+0000 7fc950e00640 1 -- 172.21.15.2:0/3940340625 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc94c09c670 con 0x7fc94c06df50 2024-09-10T08:48:18.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.489+0000 7fc950e00640 1 --2- 172.21.15.2:0/3940340625 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc94c06df50 0x7fc94c14d420 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc94000c430 tx=0x7fc94000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:18.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.489+0000 7fc948c00640 1 -- 172.21.15.2:0/3940340625 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc940017070 con 0x7fc94c06df50 2024-09-10T08:48:18.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.489+0000 7fc948c00640 1 -- 172.21.15.2:0/3940340625 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9400052d0 con 0x7fc94c06df50 2024-09-10T08:48:18.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.489+0000 7fc953800640 1 -- 172.21.15.2:0/3940340625 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc94c09c950 con 0x7fc94c06df50 2024-09-10T08:48:18.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.489+0000 7fc948c00640 1 -- 172.21.15.2:0/3940340625 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc940003850 con 0x7fc94c06df50 2024-09-10T08:48:18.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.489+0000 7fc953800640 1 -- 172.21.15.2:0/3940340625 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc94c09cf10 con 0x7fc94c06df50 2024-09-10T08:48:18.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.490+0000 7fc953800640 1 -- 172.21.15.2:0/3940340625 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc94c0cdea0 con 0x7fc94c06df50 2024-09-10T08:48:18.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.491+0000 7fc948c00640 1 -- 172.21.15.2:0/3940340625 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 90442+0+0 (secure 0 0 0) 0x7fc94001a070 con 0x7fc94c06df50 2024-09-10T08:48:18.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.492+0000 7fc948c00640 1 --2- 172.21.15.2:0/3940340625 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7fc92c06bda0 0x7fc92c06e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:18.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.492+0000 7fc948c00640 1 -- 172.21.15.2:0/3940340625 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5980+0+0 (secure 0 0 0) 0x7fc94008a200 con 0x7fc94c06df50 2024-09-10T08:48:18.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.493+0000 7fc94be00640 1 --2- 172.21.15.2:0/3940340625 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7fc92c06bda0 0x7fc92c06e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:18.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.494+0000 7fc94be00640 1 --2- 172.21.15.2:0/3940340625 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7fc92c06bda0 0x7fc92c06e260 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc94c0cce80 tx=0x7fc938009190 comp rx=0 tx=0).ready entity=mgr.4862 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:18.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.497+0000 7fc948c00640 1 -- 172.21.15.2:0/3940340625 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc940058490 con 0x7fc94c06df50 2024-09-10T08:48:18.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.685+0000 7fc953800640 1 -- 172.21.15.2:0/3940340625 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fc94c06e750 con 0x7fc94c06df50 2024-09-10T08:48:18.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.689+0000 7fc948c00640 1 -- 172.21.15.2:0/3940340625 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) ==== 104+0+0 (secure 0 0 0) 0x7fc94005c790 con 0x7fc94c06df50 2024-09-10T08:48:18.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.691+0000 7fc953800640 1 -- 172.21.15.2:0/3940340625 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7fc92c06bda0 msgr2=0x7fc92c06e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:18.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.691+0000 7fc953800640 1 --2- 172.21.15.2:0/3940340625 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7fc92c06bda0 0x7fc92c06e260 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc94c0cce80 tx=0x7fc938009190 comp rx=0 tx=0).stop 2024-09-10T08:48:18.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.691+0000 7fc953800640 1 -- 172.21.15.2:0/3940340625 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc94c06df50 msgr2=0x7fc94c14d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:18.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.691+0000 7fc953800640 1 --2- 172.21.15.2:0/3940340625 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc94c06df50 0x7fc94c14d420 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc94000c430 tx=0x7fc94000c8f0 comp rx=0 tx=0).stop 2024-09-10T08:48:18.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.691+0000 7fc953800640 1 -- 172.21.15.2:0/3940340625 shutdown_connections 2024-09-10T08:48:18.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.691+0000 7fc953800640 1 --2- 172.21.15.2:0/3940340625 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7fc92c06bda0 0x7fc92c06e260 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:18.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.691+0000 7fc953800640 1 --2- 172.21.15.2:0/3940340625 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc94c15c460 0x7fc94c09a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:18.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.691+0000 7fc953800640 1 --2- 172.21.15.2:0/3940340625 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc94c0cf310 0x7fc94c09a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:18.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.691+0000 7fc953800640 1 --2- 172.21.15.2:0/3940340625 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc94c06df50 0x7fc94c14d420 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:18.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.691+0000 7fc953800640 1 -- 172.21.15.2:0/3940340625 >> 172.21.15.2:0/3940340625 conn(0x7fc94c0d02c0 msgr2=0x7fc94c15efb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:18.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.691+0000 7fc953800640 1 -- 172.21.15.2:0/3940340625 shutdown_connections 2024-09-10T08:48:18.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.692+0000 7fc953800640 1 -- 172.21.15.2:0/3940340625 wait complete. 2024-09-10T08:48:18.707 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2024-09-10T08:48:18.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.866+0000 7f2f9b400640 1 Processor -- start 2024-09-10T08:48:18.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.867+0000 7f2f9b400640 1 -- start start 2024-09-10T08:48:18.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.868+0000 7f2f9b400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f9406f770 0x7f2f940cf6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:18.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.868+0000 7f2f9b400640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f940ad390 con 0x7f2f9415b4c0 2024-09-10T08:48:18.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.868+0000 7f2f9b400640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f940ad670 con 0x7f2f940af590 2024-09-10T08:48:18.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.868+0000 7f2f9b400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2f940d1130 con 0x7f2f9406f770 2024-09-10T08:48:18.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.868+0000 7f2f98a00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f2f9415b4c0 0x7f2f9406f060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:44526/0 (socket says 172.21.15.2:44526) 2024-09-10T08:48:18.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.868+0000 7f2f98a00640 1 -- 172.21.15.2:0/1275344353 learned_addr learned my addr 172.21.15.2:0/1275344353 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:48:18.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.868+0000 7f2f93e00640 1 --2- 172.21.15.2:0/1275344353 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f9406f770 0x7f2f940cf6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:18.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.868+0000 7f2f93400640 1 -- 172.21.15.2:0/1275344353 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3630980992 0 0) 0x7f2f940ad390 con 0x7f2f9415b4c0 2024-09-10T08:48:18.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.868+0000 7f2f93400640 1 -- 172.21.15.2:0/1275344353 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f7c003520 con 0x7f2f9415b4c0 2024-09-10T08:48:18.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.869+0000 7f2f93400640 1 -- 172.21.15.2:0/1275344353 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2128277820 0 0) 0x7f2f940ad670 con 0x7f2f940af590 2024-09-10T08:48:18.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.869+0000 7f2f93400640 1 -- 172.21.15.2:0/1275344353 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f940ad390 con 0x7f2f940af590 2024-09-10T08:48:18.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.869+0000 7f2f93400640 1 -- 172.21.15.2:0/1275344353 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 930606644 0 0) 0x7f2f7c003520 con 0x7f2f9415b4c0 2024-09-10T08:48:18.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.869+0000 7f2f93400640 1 -- 172.21.15.2:0/1275344353 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f9406f770 msgr2=0x7f2f940cf6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:48:18.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.869+0000 7f2f93400640 1 --2- 172.21.15.2:0/1275344353 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f9406f770 0x7f2f940cf6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:18.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.869+0000 7f2f93400640 1 -- 172.21.15.2:0/1275344353 >> v1:172.21.15.155:6789/0 conn(0x7f2f940af590 legacy=0x7f2f940ae150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:18.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.869+0000 7f2f93400640 1 -- 172.21.15.2:0/1275344353 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f940ad950 con 0x7f2f9415b4c0 2024-09-10T08:48:18.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.869+0000 7f2f93400640 1 -- 172.21.15.2:0/1275344353 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2345211856 0 0) 0x7f2f88001670 con 0x7f2f9415b4c0 2024-09-10T08:48:18.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.869+0000 7f2f93400640 1 -- 172.21.15.2:0/1275344353 >> v1:172.21.15.2:6789/0 conn(0x7f2f9415b4c0 legacy=0x7f2f9406f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:18.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.869+0000 7f2f93400640 1 --2- 172.21.15.2:0/1275344353 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f7c003b70 0x7f2f7c003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:18.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.869+0000 7f2f93400640 1 --2- 172.21.15.2:0/1275344353 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f9406f770 0x7f2f7c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:18.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.869+0000 7f2f93400640 1 --2- 172.21.15.2:0/1275344353 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f7c004d40 0x7f2f7c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:18.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.869+0000 7f2f93400640 1 -- 172.21.15.2:0/1275344353 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2f7c00dcd0 con 0x7f2f7c003b70 2024-09-10T08:48:18.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.869+0000 7f2f93400640 1 -- 172.21.15.2:0/1275344353 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2f7c00de80 con 0x7f2f7c004d40 2024-09-10T08:48:18.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.869+0000 7f2f93400640 1 -- 172.21.15.2:0/1275344353 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2f7c00e080 con 0x7f2f9406f770 2024-09-10T08:48:18.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.869+0000 7f2f98a00640 1 --2- 172.21.15.2:0/1275344353 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f7c003b70 0x7f2f7c003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:18.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.869+0000 7f2f93e00640 1 --2- 172.21.15.2:0/1275344353 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f9406f770 0x7f2f7c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:18.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.869+0000 7f2f99400640 1 --2- 172.21.15.2:0/1275344353 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f7c004d40 0x7f2f7c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:18.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.869+0000 7f2f98a00640 1 -- 172.21.15.2:0/1275344353 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f9406f770 msgr2=0x7f2f7c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:48:18.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.869+0000 7f2f98a00640 1 --2- 172.21.15.2:0/1275344353 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f9406f770 0x7f2f7c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:18.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.869+0000 7f2f98a00640 1 -- 172.21.15.2:0/1275344353 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f7c004d40 msgr2=0x7f2f7c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:48:18.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.869+0000 7f2f98a00640 1 --2- 172.21.15.2:0/1275344353 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f7c004d40 0x7f2f7c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:18.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.870+0000 7f2f98a00640 1 -- 172.21.15.2:0/1275344353 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f7c003520 con 0x7f2f7c003b70 2024-09-10T08:48:18.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.871+0000 7f2f98a00640 1 --2- 172.21.15.2:0/1275344353 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f7c003b70 0x7f2f7c003f70 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f2f8800c190 tx=0x7f2f7c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58189bea8ee7723f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:18.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.871+0000 7f2f93400640 1 -- 172.21.15.2:0/1275344353 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f88007cc0 con 0x7f2f7c003b70 2024-09-10T08:48:18.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.871+0000 7f2f93400640 1 -- 172.21.15.2:0/1275344353 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f88005af0 con 0x7f2f7c003b70 2024-09-10T08:48:18.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.871+0000 7f2f93400640 1 -- 172.21.15.2:0/1275344353 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f88007070 con 0x7f2f7c003b70 2024-09-10T08:48:18.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.871+0000 7f2f9b400640 1 -- 172.21.15.2:0/1275344353 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f7c003b70 msgr2=0x7f2f7c003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:18.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.871+0000 7f2f9b400640 1 --2- 172.21.15.2:0/1275344353 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f7c003b70 0x7f2f7c003f70 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f2f8800c190 tx=0x7f2f7c005830 comp rx=0 tx=0).stop 2024-09-10T08:48:18.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.871+0000 7f2f99400640 1 -- 172.21.15.2:0/1275344353 reap_dead start 2024-09-10T08:48:18.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.871+0000 7f2f9b400640 1 -- 172.21.15.2:0/1275344353 shutdown_connections 2024-09-10T08:48:18.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.871+0000 7f2f9b400640 1 -- 172.21.15.2:0/1275344353 >> 172.21.15.2:0/1275344353 conn(0x7f2f940d02c0 msgr2=0x7f2f940d06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:18.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.872+0000 7f2f9b400640 1 -- 172.21.15.2:0/1275344353 shutdown_connections 2024-09-10T08:48:18.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.872+0000 7f2f9b400640 1 -- 172.21.15.2:0/1275344353 wait complete. 2024-09-10T08:48:18.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.873+0000 7f2f9b400640 1 Processor -- start 2024-09-10T08:48:18.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.873+0000 7f2f9b400640 1 -- start start 2024-09-10T08:48:18.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.874+0000 7f2f9b400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f7c003b70 0x7f2f9415a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:18.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.874+0000 7f2f9b400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f941477f0 0x7f2f94150020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:18.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.874+0000 7f2f9b400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f94150560 0x7f2f941582b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:18.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.874+0000 7f2f9b400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2f94071ef0 con 0x7f2f941477f0 2024-09-10T08:48:18.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.874+0000 7f2f9b400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2f940ad140 con 0x7f2f94150560 2024-09-10T08:48:18.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.874+0000 7f2f9b400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2f94072070 con 0x7f2f7c003b70 2024-09-10T08:48:18.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.874+0000 7f2f93e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f941477f0 0x7f2f94150020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:18.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.874+0000 7f2f93e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f941477f0 0x7f2f94150020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52138/0 (socket says 172.21.15.2:52138) 2024-09-10T08:48:18.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.874+0000 7f2f93e00640 1 -- 172.21.15.2:0/910750738 learned_addr learned my addr 172.21.15.2:0/910750738 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:18.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.875+0000 7f2f98a00640 1 --2- 172.21.15.2:0/910750738 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f7c003b70 0x7f2f9415a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:18.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.875+0000 7f2f99400640 1 --2- 172.21.15.2:0/910750738 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f94150560 0x7f2f941582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:18.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.875+0000 7f2f93e00640 1 -- 172.21.15.2:0/910750738 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f7c003b70 msgr2=0x7f2f9415a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:18.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.875+0000 7f2f93e00640 1 --2- 172.21.15.2:0/910750738 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f7c003b70 0x7f2f9415a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:18.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.875+0000 7f2f93e00640 1 -- 172.21.15.2:0/910750738 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f94150560 msgr2=0x7f2f941582b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:18.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.875+0000 7f2f93e00640 1 --2- 172.21.15.2:0/910750738 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f94150560 0x7f2f941582b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:18.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.875+0000 7f2f93e00640 1 -- 172.21.15.2:0/910750738 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f94147c70 con 0x7f2f941477f0 2024-09-10T08:48:18.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.875+0000 7f2f93e00640 1 --2- 172.21.15.2:0/910750738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f941477f0 0x7f2f94150020 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2f800119a0 tx=0x7f2f80011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:18.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.875+0000 7f2f90c00640 1 -- 172.21.15.2:0/910750738 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f8000fa90 con 0x7f2f941477f0 2024-09-10T08:48:18.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.875+0000 7f2f90c00640 1 -- 172.21.15.2:0/910750738 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f8000fc30 con 0x7f2f941477f0 2024-09-10T08:48:18.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.876+0000 7f2f90c00640 1 -- 172.21.15.2:0/910750738 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f80014440 con 0x7f2f941477f0 2024-09-10T08:48:18.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.876+0000 7f2f9b400640 1 -- 172.21.15.2:0/910750738 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f94159170 con 0x7f2f941477f0 2024-09-10T08:48:18.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.876+0000 7f2f9b400640 1 -- 172.21.15.2:0/910750738 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f941598c0 con 0x7f2f941477f0 2024-09-10T08:48:18.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.877+0000 7f2f9b400640 1 -- 172.21.15.2:0/910750738 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f9415b8a0 con 0x7f2f941477f0 2024-09-10T08:48:18.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.878+0000 7f2f90c00640 1 -- 172.21.15.2:0/910750738 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 90442+0+0 (secure 0 0 0) 0x7f2f80012040 con 0x7f2f941477f0 2024-09-10T08:48:18.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.878+0000 7f2f90c00640 1 --2- 172.21.15.2:0/910750738 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f2f7406bdd0 0x7f2f7406e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:18.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.879+0000 7f2f90c00640 1 -- 172.21.15.2:0/910750738 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5980+0+0 (secure 0 0 0) 0x7f2f8008b520 con 0x7f2f941477f0 2024-09-10T08:48:18.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.879+0000 7f2f98a00640 1 --2- 172.21.15.2:0/910750738 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f2f7406bdd0 0x7f2f7406e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:18.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.880+0000 7f2f98a00640 1 --2- 172.21.15.2:0/910750738 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f2f7406bdd0 0x7f2f7406e290 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2f88032000 tx=0x7f2f88009030 comp rx=0 tx=0).ready entity=mgr.4862 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:18.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:18.883+0000 7f2f90c00640 1 -- 172.21.15.2:0/910750738 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2f80019030 con 0x7f2f941477f0 2024-09-10T08:48:19.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.066+0000 7f2f9b400640 1 -- 172.21.15.2:0/910750738 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) -- 0x7f2f94150940 con 0x7f2f941477f0 2024-09-10T08:48:19.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.069+0000 7f2f90c00640 1 -- 172.21.15.2:0/910750738 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v14) ==== 120+0+0 (secure 0 0 0) 0x7f2f80059e00 con 0x7f2f941477f0 2024-09-10T08:48:19.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.072+0000 7f2f9b400640 1 -- 172.21.15.2:0/910750738 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f2f7406bdd0 msgr2=0x7f2f7406e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:19.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.072+0000 7f2f9b400640 1 --2- 172.21.15.2:0/910750738 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f2f7406bdd0 0x7f2f7406e290 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2f88032000 tx=0x7f2f88009030 comp rx=0 tx=0).stop 2024-09-10T08:48:19.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.072+0000 7f2f9b400640 1 -- 172.21.15.2:0/910750738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f941477f0 msgr2=0x7f2f94150020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:19.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.072+0000 7f2f9b400640 1 --2- 172.21.15.2:0/910750738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f941477f0 0x7f2f94150020 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2f800119a0 tx=0x7f2f80011e60 comp rx=0 tx=0).stop 2024-09-10T08:48:19.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.072+0000 7f2f9b400640 1 -- 172.21.15.2:0/910750738 shutdown_connections 2024-09-10T08:48:19.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.072+0000 7f2f9b400640 1 --2- 172.21.15.2:0/910750738 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f2f7406bdd0 0x7f2f7406e290 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:19.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.072+0000 7f2f9b400640 1 --2- 172.21.15.2:0/910750738 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f94150560 0x7f2f941582b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:19.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.072+0000 7f2f9b400640 1 --2- 172.21.15.2:0/910750738 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f941477f0 0x7f2f94150020 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:19.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.072+0000 7f2f9b400640 1 --2- 172.21.15.2:0/910750738 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2f7c003b70 0x7f2f9415a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:19.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.072+0000 7f2f9b400640 1 -- 172.21.15.2:0/910750738 >> 172.21.15.2:0/910750738 conn(0x7f2f940d02c0 msgr2=0x7f2f940ae050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:19.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.072+0000 7f2f9b400640 1 -- 172.21.15.2:0/910750738 shutdown_connections 2024-09-10T08:48:19.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.072+0000 7f2f9b400640 1 -- 172.21.15.2:0/910750738 wait complete. 2024-09-10T08:48:19.088 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2024-09-10T08:48:19.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.246+0000 7f2245400640 1 Processor -- start 2024-09-10T08:48:19.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.246+0000 7f2245400640 1 -- start start 2024-09-10T08:48:19.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.247+0000 7f2245400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f22400d1510 0x7f22400cf040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:19.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.247+0000 7f2245400640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22400d0550 con 0x7f22400b59e0 2024-09-10T08:48:19.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.247+0000 7f2245400640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22400d2760 con 0x7f2240161cb0 2024-09-10T08:48:19.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.247+0000 7f2245400640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f22400d3090 con 0x7f22400d1510 2024-09-10T08:48:19.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.247+0000 7f2237e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f22400d1510 0x7f22400cf040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:19.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.247+0000 7f2237e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f22400d1510 0x7f22400cf040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52154/0 (socket says 172.21.15.2:52154) 2024-09-10T08:48:19.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.247+0000 7f2237e00640 1 -- 172.21.15.2:0/1135259923 learned_addr learned my addr 172.21.15.2:0/1135259923 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:19.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.248+0000 7f2237e00640 1 -- 172.21.15.2:0/1135259923 >> v1:172.21.15.155:6789/0 conn(0x7f2240161cb0 legacy=0x7f22400d0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:48:19.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.248+0000 7f2237e00640 1 -- 172.21.15.2:0/1135259923 >> v1:172.21.15.2:6789/0 conn(0x7f22400b59e0 legacy=0x7f22400cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:19.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.248+0000 7f2237e00640 1 -- 172.21.15.2:0/1135259923 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22400d2a40 con 0x7f22400d1510 2024-09-10T08:48:19.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.248+0000 7f223f400640 1 -- 172.21.15.2:0/1135259923 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1855740990 0 0) 0x7f22400d0550 con 0x7f22400b59e0 2024-09-10T08:48:19.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.249+0000 7f2237e00640 1 --2- 172.21.15.2:0/1135259923 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22400d1510 0x7f22400cf040 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f2228009870 tx=0x7f222802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cdafe52e7725c3e server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:19.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.249+0000 7f223f400640 1 -- 172.21.15.2:0/1135259923 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2228037070 con 0x7f22400d1510 2024-09-10T08:48:19.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.249+0000 7f223f400640 1 -- 172.21.15.2:0/1135259923 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f222802ae50 con 0x7f22400d1510 2024-09-10T08:48:19.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.249+0000 7f223f400640 1 -- 172.21.15.2:0/1135259923 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2228032860 con 0x7f22400d1510 2024-09-10T08:48:19.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.250+0000 7f2245400640 1 -- 172.21.15.2:0/1135259923 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22400d1510 msgr2=0x7f22400cf040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:19.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.250+0000 7f2245400640 1 --2- 172.21.15.2:0/1135259923 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22400d1510 0x7f22400cf040 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f2228009870 tx=0x7f222802a300 comp rx=0 tx=0).stop 2024-09-10T08:48:19.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.250+0000 7f2245400640 1 -- 172.21.15.2:0/1135259923 shutdown_connections 2024-09-10T08:48:19.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.250+0000 7f2245400640 1 --2- 172.21.15.2:0/1135259923 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22400d1510 0x7f22400cf040 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:19.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.250+0000 7f2245400640 1 -- 172.21.15.2:0/1135259923 >> 172.21.15.2:0/1135259923 conn(0x7f224009d700 msgr2=0x7f22400d4430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:19.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.250+0000 7f2245400640 1 -- 172.21.15.2:0/1135259923 shutdown_connections 2024-09-10T08:48:19.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.250+0000 7f2245400640 1 -- 172.21.15.2:0/1135259923 wait complete. 2024-09-10T08:48:19.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.251+0000 7f2245400640 1 Processor -- start 2024-09-10T08:48:19.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.252+0000 7f2245400640 1 -- start start 2024-09-10T08:48:19.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.252+0000 7f2245400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22400b59e0 0x7f22400cd000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:19.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.252+0000 7f2245400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f22400d1510 0x7f22400ca7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:19.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.253+0000 7f2245400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2240161cb0 0x7f224015fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:19.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.253+0000 7f2245400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f22400b4d40 con 0x7f22400b59e0 2024-09-10T08:48:19.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.253+0000 7f2245400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f22400b4bc0 con 0x7f22400d1510 2024-09-10T08:48:19.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.253+0000 7f2245400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2240162090 con 0x7f2240161cb0 2024-09-10T08:48:19.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.253+0000 7f223fe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22400b59e0 0x7f22400cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:19.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.253+0000 7f223fe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22400b59e0 0x7f22400cd000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52156/0 (socket says 172.21.15.2:52156) 2024-09-10T08:48:19.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.253+0000 7f223fe00640 1 -- 172.21.15.2:0/3397029381 learned_addr learned my addr 172.21.15.2:0/3397029381 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:19.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.253+0000 7f2244a00640 1 --2- 172.21.15.2:0/3397029381 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2240161cb0 0x7f224015fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:19.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.253+0000 7f2237e00640 1 --2- 172.21.15.2:0/3397029381 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f22400d1510 0x7f22400ca7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:19.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.253+0000 7f223fe00640 1 -- 172.21.15.2:0/3397029381 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2240161cb0 msgr2=0x7f224015fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:19.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.253+0000 7f223fe00640 1 --2- 172.21.15.2:0/3397029381 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2240161cb0 0x7f224015fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:19.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.253+0000 7f223fe00640 1 -- 172.21.15.2:0/3397029381 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f22400d1510 msgr2=0x7f22400ca7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:19.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.253+0000 7f223fe00640 1 --2- 172.21.15.2:0/3397029381 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f22400d1510 0x7f22400ca7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:19.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.253+0000 7f223fe00640 1 -- 172.21.15.2:0/3397029381 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22400c8d70 con 0x7f22400b59e0 2024-09-10T08:48:19.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.253+0000 7f2237e00640 1 --2- 172.21.15.2:0/3397029381 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f22400d1510 0x7f22400ca7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:48:19.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.253+0000 7f2244a00640 1 --2- 172.21.15.2:0/3397029381 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2240161cb0 0x7f224015fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:48:19.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.253+0000 7f223fe00640 1 --2- 172.21.15.2:0/3397029381 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22400b59e0 0x7f22400cd000 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f223000c400 tx=0x7f223000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:19.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.254+0000 7f223cc00640 1 -- 172.21.15.2:0/3397029381 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2230017070 con 0x7f22400b59e0 2024-09-10T08:48:19.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.254+0000 7f223cc00640 1 -- 172.21.15.2:0/3397029381 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22300052d0 con 0x7f22400b59e0 2024-09-10T08:48:19.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.254+0000 7f223cc00640 1 -- 172.21.15.2:0/3397029381 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2230003830 con 0x7f22400b59e0 2024-09-10T08:48:19.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.254+0000 7f2245400640 1 -- 172.21.15.2:0/3397029381 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22400c9050 con 0x7f22400b59e0 2024-09-10T08:48:19.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.254+0000 7f2245400640 1 -- 172.21.15.2:0/3397029381 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22400c98f0 con 0x7f22400b59e0 2024-09-10T08:48:19.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.255+0000 7f2245400640 1 -- 172.21.15.2:0/3397029381 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22400c9220 con 0x7f22400b59e0 2024-09-10T08:48:19.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.256+0000 7f223cc00640 1 -- 172.21.15.2:0/3397029381 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 90442+0+0 (secure 0 0 0) 0x7f223001a070 con 0x7f22400b59e0 2024-09-10T08:48:19.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.257+0000 7f223cc00640 1 --2- 172.21.15.2:0/3397029381 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f221c06bda0 0x7f221c06e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:19.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.257+0000 7f223cc00640 1 -- 172.21.15.2:0/3397029381 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5980+0+0 (secure 0 0 0) 0x7f223008a1c0 con 0x7f22400b59e0 2024-09-10T08:48:19.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.257+0000 7f2237e00640 1 --2- 172.21.15.2:0/3397029381 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f221c06bda0 0x7f221c06e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:19.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.258+0000 7f2237e00640 1 --2- 172.21.15.2:0/3397029381 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f221c06bda0 0x7f221c06e260 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2228034000 tx=0x7f222802e000 comp rx=0 tx=0).ready entity=mgr.4862 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:19.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.261+0000 7f223cc00640 1 -- 172.21.15.2:0/3397029381 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2230058b30 con 0x7f22400b59e0 2024-09-10T08:48:19.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.444+0000 7f2245400640 1 -- 172.21.15.2:0/3397029381 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) -- 0x7f22400b3080 con 0x7f22400b59e0 2024-09-10T08:48:19.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.448+0000 7f223cc00640 1 -- 172.21.15.2:0/3397029381 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v15) ==== 115+0+0 (secure 0 0 0) 0x7f2230058430 con 0x7f22400b59e0 2024-09-10T08:48:19.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.451+0000 7f2245400640 1 -- 172.21.15.2:0/3397029381 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f221c06bda0 msgr2=0x7f221c06e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:19.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.451+0000 7f2245400640 1 --2- 172.21.15.2:0/3397029381 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f221c06bda0 0x7f221c06e260 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2228034000 tx=0x7f222802e000 comp rx=0 tx=0).stop 2024-09-10T08:48:19.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.451+0000 7f2245400640 1 -- 172.21.15.2:0/3397029381 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22400b59e0 msgr2=0x7f22400cd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:19.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.451+0000 7f2245400640 1 --2- 172.21.15.2:0/3397029381 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22400b59e0 0x7f22400cd000 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f223000c400 tx=0x7f223000c8c0 comp rx=0 tx=0).stop 2024-09-10T08:48:19.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.451+0000 7f2245400640 1 -- 172.21.15.2:0/3397029381 shutdown_connections 2024-09-10T08:48:19.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.451+0000 7f2245400640 1 --2- 172.21.15.2:0/3397029381 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f221c06bda0 0x7f221c06e260 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:19.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.451+0000 7f2245400640 1 --2- 172.21.15.2:0/3397029381 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2240161cb0 0x7f224015fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:19.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.451+0000 7f2245400640 1 --2- 172.21.15.2:0/3397029381 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f22400d1510 0x7f22400ca7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:19.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.451+0000 7f2245400640 1 --2- 172.21.15.2:0/3397029381 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22400b59e0 0x7f22400cd000 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:19.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.451+0000 7f2245400640 1 -- 172.21.15.2:0/3397029381 >> 172.21.15.2:0/3397029381 conn(0x7f224009d700 msgr2=0x7f22400cf000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:19.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.451+0000 7f2245400640 1 -- 172.21.15.2:0/3397029381 shutdown_connections 2024-09-10T08:48:19.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.451+0000 7f2245400640 1 -- 172.21.15.2:0/3397029381 wait complete. 2024-09-10T08:48:19.467 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name' 2024-09-10T08:48:19.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.624+0000 7f7834600640 1 Processor -- start 2024-09-10T08:48:19.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.624+0000 7f7834600640 1 -- start start 2024-09-10T08:48:19.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.625+0000 7f7834600640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f782c15c4f0 0x7f782c073540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:19.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.625+0000 7f7834600640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f782c15c8d0 con 0x7f782c0d1e90 2024-09-10T08:48:19.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.625+0000 7f7834600640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f782c0cf4a0 con 0x7f782c06c320 2024-09-10T08:48:19.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.625+0000 7f7834600640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f782c0d1170 con 0x7f782c15c4f0 2024-09-10T08:48:19.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.625+0000 7f7831200640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f782c0d1e90 0x7f782c06bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:44534/0 (socket says 172.21.15.2:44534) 2024-09-10T08:48:19.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.625+0000 7f7831200640 1 -- 172.21.15.2:0/3557789341 learned_addr learned my addr 172.21.15.2:0/3557789341 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:48:19.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.626+0000 7f7831c00640 1 --2- 172.21.15.2:0/3557789341 >> v2:172.21.15.155:3300/0 conn(0x7f782c15c4f0 0x7f782c073540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:19.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.626+0000 7f782be00640 1 -- 172.21.15.2:0/3557789341 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3567308030 0 0) 0x7f782c15c8d0 con 0x7f782c0d1e90 2024-09-10T08:48:19.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.626+0000 7f782be00640 1 -- 172.21.15.2:0/3557789341 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7814003520 con 0x7f782c0d1e90 2024-09-10T08:48:19.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.626+0000 7f782be00640 1 -- 172.21.15.2:0/3557789341 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 837607197 0 0) 0x7f7814003520 con 0x7f782c0d1e90 2024-09-10T08:48:19.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.626+0000 7f782be00640 1 -- 172.21.15.2:0/3557789341 >> v2:172.21.15.155:3300/0 conn(0x7f782c15c4f0 msgr2=0x7f782c073540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:48:19.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.626+0000 7f782be00640 1 --2- 172.21.15.2:0/3557789341 >> v2:172.21.15.155:3300/0 conn(0x7f782c15c4f0 0x7f782c073540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:19.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.626+0000 7f782be00640 1 -- 172.21.15.2:0/3557789341 >> v1:172.21.15.155:6789/0 conn(0x7f782c06c320 legacy=0x7f782c0cd970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:19.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.626+0000 7f782be00640 1 -- 172.21.15.2:0/3557789341 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f782c0d13b0 con 0x7f782c0d1e90 2024-09-10T08:48:19.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.626+0000 7f782be00640 1 -- 172.21.15.2:0/3557789341 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2345211856 0 0) 0x7f7818001670 con 0x7f782c0d1e90 2024-09-10T08:48:19.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.626+0000 7f782be00640 1 -- 172.21.15.2:0/3557789341 >> v1:172.21.15.2:6789/0 conn(0x7f782c0d1e90 legacy=0x7f782c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:19.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.626+0000 7f782be00640 1 --2- 172.21.15.2:0/3557789341 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7814003a00 0x7f7814003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:19.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.626+0000 7f782be00640 1 --2- 172.21.15.2:0/3557789341 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7814004800 0x7f7814004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:19.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.626+0000 7f782be00640 1 --2- 172.21.15.2:0/3557789341 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78140051c0 0x7f781400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:19.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.626+0000 7f782be00640 1 -- 172.21.15.2:0/3557789341 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f782c0d1170 con 0x7f7814004800 2024-09-10T08:48:19.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.626+0000 7f782be00640 1 -- 172.21.15.2:0/3557789341 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f781400c0c0 con 0x7f7814003a00 2024-09-10T08:48:19.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.626+0000 7f782be00640 1 -- 172.21.15.2:0/3557789341 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f781400c2c0 con 0x7f78140051c0 2024-09-10T08:48:19.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.627+0000 7f7831200640 1 --2- 172.21.15.2:0/3557789341 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7814004800 0x7f7814004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:19.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.627+0000 7f7831c00640 1 --2- 172.21.15.2:0/3557789341 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7814003a00 0x7f7814003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:19.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.627+0000 7f7832600640 1 --2- 172.21.15.2:0/3557789341 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78140051c0 0x7f781400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:19.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.627+0000 7f7831200640 1 -- 172.21.15.2:0/3557789341 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78140051c0 msgr2=0x7f781400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:48:19.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.627+0000 7f7831200640 1 --2- 172.21.15.2:0/3557789341 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78140051c0 0x7f781400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:19.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.627+0000 7f7831200640 1 -- 172.21.15.2:0/3557789341 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7814003a00 msgr2=0x7f7814003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:48:19.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.627+0000 7f7831200640 1 --2- 172.21.15.2:0/3557789341 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7814003a00 0x7f7814003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:19.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.627+0000 7f7831200640 1 -- 172.21.15.2:0/3557789341 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7814003520 con 0x7f7814004800 2024-09-10T08:48:19.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.627+0000 7f7832600640 1 --2- 172.21.15.2:0/3557789341 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78140051c0 0x7f781400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:48:19.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.627+0000 7f7832600640 1 -- 172.21.15.2:0/3557789341 reap_dead start 2024-09-10T08:48:19.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.628+0000 7f7831200640 1 --2- 172.21.15.2:0/3557789341 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7814004800 0x7f7814004c80 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f781800c190 tx=0x7f7814005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec6a5098bdfd1a38 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:19.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.628+0000 7f782be00640 1 -- 172.21.15.2:0/3557789341 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7818007c60 con 0x7f7814004800 2024-09-10T08:48:19.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.628+0000 7f782be00640 1 -- 172.21.15.2:0/3557789341 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7818005ad0 con 0x7f7814004800 2024-09-10T08:48:19.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.628+0000 7f782be00640 1 -- 172.21.15.2:0/3557789341 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7818007070 con 0x7f7814004800 2024-09-10T08:48:19.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.629+0000 7f7834600640 1 -- 172.21.15.2:0/3557789341 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7814004800 msgr2=0x7f7814004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:19.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.629+0000 7f7834600640 1 --2- 172.21.15.2:0/3557789341 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7814004800 0x7f7814004c80 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f781800c190 tx=0x7f7814005830 comp rx=0 tx=0).stop 2024-09-10T08:48:19.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.629+0000 7f7834600640 1 -- 172.21.15.2:0/3557789341 shutdown_connections 2024-09-10T08:48:19.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.629+0000 7f7834600640 1 --2- 172.21.15.2:0/3557789341 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7814004800 0x7f7814004c80 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:19.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.629+0000 7f7834600640 1 -- 172.21.15.2:0/3557789341 >> 172.21.15.2:0/3557789341 conn(0x7f782c0b6a00 msgr2=0x7f782c09aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:19.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.629+0000 7f7834600640 1 -- 172.21.15.2:0/3557789341 shutdown_connections 2024-09-10T08:48:19.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.629+0000 7f7834600640 1 -- 172.21.15.2:0/3557789341 wait complete. 2024-09-10T08:48:19.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.631+0000 7f7834600640 1 Processor -- start 2024-09-10T08:48:19.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.631+0000 7f7834600640 1 -- start start 2024-09-10T08:48:19.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.632+0000 7f7834600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7814004800 0x7f782c155f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:19.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.632+0000 7f7834600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f782c09ef20 0x7f782c0b2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:19.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.632+0000 7f7834600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f782c0b34e0 0x7f782c09bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:19.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.632+0000 7f7834600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f782c0d1970 con 0x7f782c0b34e0 2024-09-10T08:48:19.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.632+0000 7f7834600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f782c0cf250 con 0x7f782c09ef20 2024-09-10T08:48:19.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.632+0000 7f7834600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f782c0b05e0 con 0x7f7814004800 2024-09-10T08:48:19.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.632+0000 7f7832600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f782c0b34e0 0x7f782c09bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:19.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.632+0000 7f7831c00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7814004800 0x7f782c155f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:19.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.632+0000 7f7832600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f782c0b34e0 0x7f782c09bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52172/0 (socket says 172.21.15.2:52172) 2024-09-10T08:48:19.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.632+0000 7f7832600640 1 -- 172.21.15.2:0/1615566374 learned_addr learned my addr 172.21.15.2:0/1615566374 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:19.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.632+0000 7f7831200640 1 --2- 172.21.15.2:0/1615566374 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f782c09ef20 0x7f782c0b2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:19.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.632+0000 7f7832600640 1 -- 172.21.15.2:0/1615566374 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7814004800 msgr2=0x7f782c155f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:19.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.632+0000 7f7832600640 1 --2- 172.21.15.2:0/1615566374 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7814004800 0x7f782c155f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:19.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.632+0000 7f7832600640 1 -- 172.21.15.2:0/1615566374 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f782c09ef20 msgr2=0x7f782c0b2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:19.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.632+0000 7f7832600640 1 --2- 172.21.15.2:0/1615566374 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f782c09ef20 0x7f782c0b2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:19.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.632+0000 7f7832600640 1 -- 172.21.15.2:0/1615566374 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f782c09dbc0 con 0x7f782c0b34e0 2024-09-10T08:48:19.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.633+0000 7f7832600640 1 --2- 172.21.15.2:0/1615566374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f782c0b34e0 0x7f782c09bd10 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f782c0cf0a0 tx=0x7f782400ead0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:19.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.633+0000 7f7829600640 1 -- 172.21.15.2:0/1615566374 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7824003b80 con 0x7f782c0b34e0 2024-09-10T08:48:19.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.633+0000 7f7829600640 1 -- 172.21.15.2:0/1615566374 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7824003d20 con 0x7f782c0b34e0 2024-09-10T08:48:19.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.633+0000 7f7829600640 1 -- 172.21.15.2:0/1615566374 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7824006b50 con 0x7f782c0b34e0 2024-09-10T08:48:19.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.633+0000 7f7834600640 1 -- 172.21.15.2:0/1615566374 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f782c09de80 con 0x7f782c0b34e0 2024-09-10T08:48:19.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.633+0000 7f7834600640 1 -- 172.21.15.2:0/1615566374 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f782c09e440 con 0x7f782c0b34e0 2024-09-10T08:48:19.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.634+0000 7f7834600640 1 -- 172.21.15.2:0/1615566374 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f782c073540 con 0x7f782c0b34e0 2024-09-10T08:48:19.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.635+0000 7f7829600640 1 -- 172.21.15.2:0/1615566374 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 13) ==== 90442+0+0 (secure 0 0 0) 0x7f782401a020 con 0x7f782c0b34e0 2024-09-10T08:48:19.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.636+0000 7f7829600640 1 --2- 172.21.15.2:0/1615566374 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f780c06bda0 0x7f780c06e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:19.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.636+0000 7f7829600640 1 -- 172.21.15.2:0/1615566374 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5980+0+0 (secure 0 0 0) 0x7f782408a3a0 con 0x7f782c0b34e0 2024-09-10T08:48:19.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.636+0000 7f7831c00640 1 --2- 172.21.15.2:0/1615566374 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f780c06bda0 0x7f780c06e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:19.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.637+0000 7f7831c00640 1 --2- 172.21.15.2:0/1615566374 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f780c06bda0 0x7f780c06e260 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7820009c40 tx=0x7f7820009190 comp rx=0 tx=0).ready entity=mgr.4862 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:19.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.640+0000 7f7829600640 1 -- 172.21.15.2:0/1615566374 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7824058c80 con 0x7f782c0b34e0 2024-09-10T08:48:19.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:19.889+0000 7f7834600640 1 -- 172.21.15.2:0/1615566374 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]} v 0) -- 0x7f782c0af0c0 con 0x7f782c0b34e0 2024-09-10T08:48:20.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:20.074+0000 7f7829600640 1 -- 172.21.15.2:0/1615566374 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mgrmap(e 14) ==== 90498+0+0 (secure 0 0 0) 0x7f7824054bf0 con 0x7f782c0b34e0 2024-09-10T08:48:20.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:20.296+0000 7f7829600640 1 -- 172.21.15.2:0/1615566374 <== mon.0 v2:172.21.15.2:3300/0 8 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]}]=0 v100) ==== 155+0+0 (secure 0 0 0) 0x7f7824074f80 con 0x7f782c0b34e0 2024-09-10T08:48:20.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:20.298+0000 7f7834600640 1 -- 172.21.15.2:0/1615566374 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f780c06bda0 msgr2=0x7f780c06e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:20.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:20.298+0000 7f7834600640 1 --2- 172.21.15.2:0/1615566374 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f780c06bda0 0x7f780c06e260 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7820009c40 tx=0x7f7820009190 comp rx=0 tx=0).stop 2024-09-10T08:48:20.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:20.298+0000 7f7834600640 1 -- 172.21.15.2:0/1615566374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f782c0b34e0 msgr2=0x7f782c09bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:20.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:20.298+0000 7f7834600640 1 --2- 172.21.15.2:0/1615566374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f782c0b34e0 0x7f782c09bd10 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f782c0cf0a0 tx=0x7f782400ead0 comp rx=0 tx=0).stop 2024-09-10T08:48:20.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:20.298+0000 7f7834600640 1 -- 172.21.15.2:0/1615566374 shutdown_connections 2024-09-10T08:48:20.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:20.298+0000 7f7834600640 1 --2- 172.21.15.2:0/1615566374 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f780c06bda0 0x7f780c06e260 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:20.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:20.298+0000 7f7834600640 1 --2- 172.21.15.2:0/1615566374 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f782c0b34e0 0x7f782c09bd10 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:20.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:20.298+0000 7f7834600640 1 --2- 172.21.15.2:0/1615566374 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f782c09ef20 0x7f782c0b2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:20.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:20.298+0000 7f7834600640 1 --2- 172.21.15.2:0/1615566374 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7814004800 0x7f782c155f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:20.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:20.298+0000 7f7834600640 1 -- 172.21.15.2:0/1615566374 >> 172.21.15.2:0/1615566374 conn(0x7f782c0b6a00 msgr2=0x7f782c0af8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:20.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:20.299+0000 7f7834600640 1 -- 172.21.15.2:0/1615566374 shutdown_connections 2024-09-10T08:48:20.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:20.299+0000 7f7834600640 1 -- 172.21.15.2:0/1615566374 wait complete. 2024-09-10T08:48:20.315 INFO:tasks.cephfs_test_runner:Test the correctness of snap directory name ... ok 2024-09-10T08:48:20.315 INFO:tasks.cephfs_test_runner: 2024-09-10T08:48:20.315 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-10T08:48:20.315 INFO:tasks.cephfs_test_runner:Ran 1 test in 46.597s 2024-09-10T08:48:20.315 INFO:tasks.cephfs_test_runner: 2024-09-10T08:48:20.316 INFO:tasks.cephfs_test_runner:OK 2024-09-10T08:48:20.316 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-09-10T08:48:20.325 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-10T08:48:20.368 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-10T08:48:20.369 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T08:48:20.369 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:48:20.405 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T08:48:20.405 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-10T08:48:20.405 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:48:20.480 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053402,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249604k,nr_inodes=812401,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499212k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-10T08:48:20.481 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-10T08:48:20.481 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:48:20.519 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052629,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T08:48:20.520 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-10T08:48:20.520 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-10T08:48:20.597 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052629,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248984k,nr_inodes=812246,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497976k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-10T08:48:20.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:48:20.597 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2024-09-10T08:48:20.633 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-10T08:48:20.633 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-10T08:48:20.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:48:20.633 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-10T08:48:20.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:48:20.730 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-10T08:48:20.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:48:20.984 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link delete ceph-brx 2024-09-10T08:48:21.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:48:21.297 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2024-09-10T08:48:21.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:48:21.335 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link delete ceph-brx 2024-09-10T08:48:21.436 INFO:teuthology.orchestra.run.smithi002.stderr:Cannot find device "ceph-brx" 2024-09-10T08:48:21.438 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T08:48:21.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:48:21.440 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2024-09-10T08:48:21.480 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-10T08:48:21.480 INFO:teuthology.orchestra.run.smithi155.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-10T08:48:21.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:48:21.480 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-10T08:48:21.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:48:21.582 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-10T08:48:21.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:48:21.847 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link delete ceph-brx 2024-09-10T08:48:22.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:48:22.137 DEBUG:teuthology.orchestra.run.smithi155:> ip netns list 2024-09-10T08:48:22.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-10T08:48:22.174 DEBUG:teuthology.orchestra.run.smithi155:> sudo ip link delete ceph-brx 2024-09-10T08:48:22.274 INFO:teuthology.orchestra.run.smithi155.stderr:Cannot find device "ceph-brx" 2024-09-10T08:48:22.277 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T08:48:22.277 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-10T08:48:22.286 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T08:48:22.286 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:48:22.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.454+0000 7f1e9a000640 1 Processor -- start 2024-09-10T08:48:22.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.454+0000 7f1e9a000640 1 -- start start 2024-09-10T08:48:22.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.456+0000 7f1e9a000640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f1e940cd460 0x7f1e9415c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:22.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.456+0000 7f1e9a000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1e9406df80 0x7f1e94160980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:22.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.456+0000 7f1e9a000640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e9406e4d0 con 0x7f1e94145d20 2024-09-10T08:48:22.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.456+0000 7f1e9a000640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f1e94146100 con 0x7f1e9406df80 2024-09-10T08:48:22.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.456+0000 7f1e9a000640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f1e94160ec0 con 0x7f1e940cd460 2024-09-10T08:48:22.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.456+0000 7f1e93e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1e9406df80 0x7f1e94160980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:22.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.456+0000 7f1e93e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1e9406df80 0x7f1e94160980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52176/0 (socket says 172.21.15.2:52176) 2024-09-10T08:48:22.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.456+0000 7f1e93e00640 1 -- 172.21.15.2:0/4289140138 learned_addr learned my addr 172.21.15.2:0/4289140138 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:22.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.456+0000 7f1e92a00640 1 --2- 172.21.15.2:0/4289140138 >> v2:172.21.15.155:3300/0 conn(0x7f1e940cd460 0x7f1e9415c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:22.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.456+0000 7f1e93e00640 1 -- 172.21.15.2:0/4289140138 >> v2:172.21.15.155:3300/0 conn(0x7f1e940cd460 msgr2=0x7f1e9415c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:48:22.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.456+0000 7f1e93e00640 1 --2- 172.21.15.2:0/4289140138 >> v2:172.21.15.155:3300/0 conn(0x7f1e940cd460 0x7f1e9415c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:22.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.456+0000 7f1e93e00640 1 -- 172.21.15.2:0/4289140138 >> v1:172.21.15.155:6789/0 conn(0x7f1e94145d20 legacy=0x7f1e940ccd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:22.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.456+0000 7f1e93e00640 1 -- 172.21.15.2:0/4289140138 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e9406e7b0 con 0x7f1e9406df80 2024-09-10T08:48:22.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.457+0000 7f1e93e00640 1 --2- 172.21.15.2:0/4289140138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e9406df80 0x7f1e94160980 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1e940b3420 tx=0x7f1e8c02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67418b89635b6468 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:22.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.458+0000 7f1e92000640 1 -- 172.21.15.2:0/4289140138 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e8c036070 con 0x7f1e9406df80 2024-09-10T08:48:22.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.458+0000 7f1e92000640 1 -- 172.21.15.2:0/4289140138 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e8c031600 con 0x7f1e9406df80 2024-09-10T08:48:22.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.458+0000 7f1e92000640 1 -- 172.21.15.2:0/4289140138 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e8c0319d0 con 0x7f1e9406df80 2024-09-10T08:48:22.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.458+0000 7f1e9a000640 1 -- 172.21.15.2:0/4289140138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e9406df80 msgr2=0x7f1e94160980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:22.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.458+0000 7f1e9a000640 1 --2- 172.21.15.2:0/4289140138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e9406df80 0x7f1e94160980 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1e940b3420 tx=0x7f1e8c02a610 comp rx=0 tx=0).stop 2024-09-10T08:48:22.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.458+0000 7f1e9a000640 1 -- 172.21.15.2:0/4289140138 shutdown_connections 2024-09-10T08:48:22.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.458+0000 7f1e9a000640 1 --2- 172.21.15.2:0/4289140138 >> v2:172.21.15.155:3300/0 conn(0x7f1e940cd460 0x7f1e9415c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:22.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.458+0000 7f1e9a000640 1 --2- 172.21.15.2:0/4289140138 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e9406df80 0x7f1e94160980 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:22.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.458+0000 7f1e9a000640 1 -- 172.21.15.2:0/4289140138 >> 172.21.15.2:0/4289140138 conn(0x7f1e9406bc10 msgr2=0x7f1e9406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:22.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.458+0000 7f1e9a000640 1 -- 172.21.15.2:0/4289140138 shutdown_connections 2024-09-10T08:48:22.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.458+0000 7f1e9a000640 1 -- 172.21.15.2:0/4289140138 wait complete. 2024-09-10T08:48:22.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.460+0000 7f1e9a000640 1 Processor -- start 2024-09-10T08:48:22.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.460+0000 7f1e9a000640 1 -- start start 2024-09-10T08:48:22.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.461+0000 7f1e9a000640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1e9406df80 0x7f1e9415aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:22.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.461+0000 7f1e9a000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e940cd460 0x7f1e94144300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:22.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.461+0000 7f1e9a000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1e94145d20 0x7f1e940b2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:22.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.461+0000 7f1e9a000640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f1e9406ed70 con 0x7f1e940cd460 2024-09-10T08:48:22.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.461+0000 7f1e9a000640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1e940ce6b0 con 0x7f1e94145d20 2024-09-10T08:48:22.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.461+0000 7f1e9a000640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f1e940ceb40 con 0x7f1e9406df80 2024-09-10T08:48:22.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.461+0000 7f1e92a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e940cd460 0x7f1e94144300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:22.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.461+0000 7f1e92a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e940cd460 0x7f1e94144300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52190/0 (socket says 172.21.15.2:52190) 2024-09-10T08:48:22.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.461+0000 7f1e92a00640 1 -- 172.21.15.2:0/4012136626 learned_addr learned my addr 172.21.15.2:0/4012136626 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:22.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.461+0000 7f1e93e00640 1 --2- 172.21.15.2:0/4012136626 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1e94145d20 0x7f1e940b2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:22.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.461+0000 7f1e93400640 1 --2- 172.21.15.2:0/4012136626 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1e9406df80 0x7f1e9415aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:22.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.462+0000 7f1e92a00640 1 -- 172.21.15.2:0/4012136626 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1e9406df80 msgr2=0x7f1e9415aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:22.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.462+0000 7f1e92a00640 1 --2- 172.21.15.2:0/4012136626 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1e9406df80 0x7f1e9415aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:22.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.462+0000 7f1e92a00640 1 -- 172.21.15.2:0/4012136626 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1e94145d20 msgr2=0x7f1e940b2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:22.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.462+0000 7f1e92a00640 1 --2- 172.21.15.2:0/4012136626 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1e94145d20 0x7f1e940b2280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:22.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.462+0000 7f1e92a00640 1 -- 172.21.15.2:0/4012136626 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e940b2f70 con 0x7f1e940cd460 2024-09-10T08:48:22.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.462+0000 7f1e92a00640 1 --2- 172.21.15.2:0/4012136626 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e940cd460 0x7f1e94144300 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1e8000e9b0 tx=0x7f1e8000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:22.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.462+0000 7f1e8b400640 1 -- 172.21.15.2:0/4012136626 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e80017070 con 0x7f1e940cd460 2024-09-10T08:48:22.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.462+0000 7f1e8b400640 1 -- 172.21.15.2:0/4012136626 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e8000c9a0 con 0x7f1e940cd460 2024-09-10T08:48:22.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.462+0000 7f1e8b400640 1 -- 172.21.15.2:0/4012136626 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e8000cd90 con 0x7f1e940cd460 2024-09-10T08:48:22.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.462+0000 7f1e9a000640 1 -- 172.21.15.2:0/4012136626 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e9415b420 con 0x7f1e940cd460 2024-09-10T08:48:22.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.462+0000 7f1e9a000640 1 -- 172.21.15.2:0/4012136626 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e940b1490 con 0x7f1e940cd460 2024-09-10T08:48:22.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.463+0000 7f1e9a000640 1 -- 172.21.15.2:0/4012136626 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e94160980 con 0x7f1e940cd460 2024-09-10T08:48:22.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.464+0000 7f1e8b400640 1 -- 172.21.15.2:0/4012136626 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 14) ==== 90498+0+0 (secure 0 0 0) 0x7f1e8001a070 con 0x7f1e940cd460 2024-09-10T08:48:22.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.465+0000 7f1e8b400640 1 --2- 172.21.15.2:0/4012136626 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f1e7406be60 0x7f1e7406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:22.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.465+0000 7f1e8b400640 1 -- 172.21.15.2:0/4012136626 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5980+0+0 (secure 0 0 0) 0x7f1e8008aeb0 con 0x7f1e940cd460 2024-09-10T08:48:22.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.466+0000 7f1e93400640 1 --2- 172.21.15.2:0/4012136626 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f1e7406be60 0x7f1e7406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:22.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.466+0000 7f1e93400640 1 --2- 172.21.15.2:0/4012136626 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f1e7406be60 0x7f1e7406e320 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1e840016e0 tx=0x7f1e84009040 comp rx=0 tx=0).ready entity=mgr.4862 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:22.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.470+0000 7f1e8b400640 1 -- 172.21.15.2:0/4012136626 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1e800590f0 con 0x7f1e940cd460 2024-09-10T08:48:22.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.651+0000 7f1e9a000640 1 -- 172.21.15.2:0/4012136626 --> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1e9415e130 con 0x7f1e7406be60 2024-09-10T08:48:22.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.652+0000 7f1e8b400640 1 -- 172.21.15.2:0/4012136626 <== mgr.4862 v2:172.21.15.155:6832/2264044153 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13491 (secure 0 0 0) 0x7f1e9415e130 con 0x7f1e7406be60 2024-09-10T08:48:22.653 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:48:22.653 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-10T08:48:22.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.655+0000 7f1e9a000640 1 -- 172.21.15.2:0/4012136626 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f1e7406be60 msgr2=0x7f1e7406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:22.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.655+0000 7f1e9a000640 1 --2- 172.21.15.2:0/4012136626 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f1e7406be60 0x7f1e7406e320 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1e840016e0 tx=0x7f1e84009040 comp rx=0 tx=0).stop 2024-09-10T08:48:22.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.655+0000 7f1e9a000640 1 -- 172.21.15.2:0/4012136626 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e940cd460 msgr2=0x7f1e94144300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:22.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.655+0000 7f1e9a000640 1 --2- 172.21.15.2:0/4012136626 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e940cd460 0x7f1e94144300 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1e8000e9b0 tx=0x7f1e8000ee70 comp rx=0 tx=0).stop 2024-09-10T08:48:22.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.655+0000 7f1e9a000640 1 -- 172.21.15.2:0/4012136626 shutdown_connections 2024-09-10T08:48:22.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.655+0000 7f1e9a000640 1 --2- 172.21.15.2:0/4012136626 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f1e7406be60 0x7f1e7406e320 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:22.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.655+0000 7f1e9a000640 1 --2- 172.21.15.2:0/4012136626 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1e94145d20 0x7f1e940b2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:22.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.655+0000 7f1e9a000640 1 --2- 172.21.15.2:0/4012136626 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e940cd460 0x7f1e94144300 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:22.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.655+0000 7f1e9a000640 1 --2- 172.21.15.2:0/4012136626 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1e9406df80 0x7f1e9415aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:22.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.655+0000 7f1e9a000640 1 -- 172.21.15.2:0/4012136626 >> 172.21.15.2:0/4012136626 conn(0x7f1e9406bc10 msgr2=0x7f1e940ceed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:22.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.655+0000 7f1e9a000640 1 -- 172.21.15.2:0/4012136626 shutdown_connections 2024-09-10T08:48:22.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.655+0000 7f1e9a000640 1 -- 172.21.15.2:0/4012136626 wait complete. 2024-09-10T08:48:22.671 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":8,"stamp":"2024-09-10T08:48:21.294891+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":22,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":238024,"kb_used_data":5128,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736696,"statfs":{"total":773094113280,"available":772850376704,"internally_reserved":0,"allocated":5251072,"data_stored":2979192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-732920,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-25,"num_whiteouts":0,"num_read":-321,"num_read_kb":-165,"num_write":-337,"num_write_kb":-2904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.000066"},"pg_stats":[{"pgid":"1.0","version":"42'139","reported_seq":289,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-10T08:48:18.375156+0000","last_change":"2024-09-10T08:46:42.177049+0000","last_active":"2024-09-10T08:48:18.375156+0000","last_peered":"2024-09-10T08:48:18.375156+0000","last_clean":"2024-09-10T08:48:18.375156+0000","last_became_active":"2024-09-10T08:46:42.175678+0000","last_became_peered":"2024-09-10T08:46:42.175678+0000","last_unstale":"2024-09-10T08:48:18.375156+0000","last_undegraded":"2024-09-10T08:48:18.375156+0000","last_fullsized":"2024-09-10T08:48:18.375156+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:40.326212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:40.326212+0000","last_clean_scrub_stamp":"2024-09-10T08:46:40.326212+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:06.642437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28108,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343732,"statfs":{"total":96636764160,"available":96607981568,"internally_reserved":0,"allocated":1101824,"data_stored":815175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27532,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":507904,"data_stored":224807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27528,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":507904,"data_stored":224807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27528,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":507904,"data_stored":224807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31688,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340152,"statfs":{"total":96636764160,"available":96604315648,"internally_reserved":0,"allocated":507904,"data_stored":224807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31688,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340152,"statfs":{"total":96636764160,"available":96604315648,"internally_reserved":0,"allocated":507904,"data_stored":224807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31688,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340152,"statfs":{"total":96636764160,"available":96604315648,"internally_reserved":0,"allocated":507904,"data_stored":224807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32264,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339576,"statfs":{"total":96636764160,"available":96603725824,"internally_reserved":0,"allocated":1101824,"data_stored":815175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:48:22.671 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:48:22.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.827+0000 7fe106800640 1 Processor -- start 2024-09-10T08:48:22.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.827+0000 7fe106800640 1 -- start start 2024-09-10T08:48:22.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.828+0000 7fe106800640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe100067d30 0x7fe1000b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:22.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.829+0000 7fe106800640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe10006ea10 con 0x7fe1000b41e0 2024-09-10T08:48:22.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.829+0000 7fe106800640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe10006ecf0 con 0x7fe100067950 2024-09-10T08:48:22.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.829+0000 7fe106800640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fe10006f620 con 0x7fe100067d30 2024-09-10T08:48:22.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.829+0000 7fe0ffe00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fe1000b41e0 0x7fe1000b4610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:44544/0 (socket says 172.21.15.2:44544) 2024-09-10T08:48:22.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.829+0000 7fe0ffe00640 1 -- 172.21.15.2:0/2692979269 learned_addr learned my addr 172.21.15.2:0/2692979269 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:48:22.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.829+0000 7fe0f7e00640 1 --2- 172.21.15.2:0/2692979269 >> v2:172.21.15.155:3300/0 conn(0x7fe100067d30 0x7fe1000b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:22.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.829+0000 7fe0fea00640 1 -- 172.21.15.2:0/2692979269 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1346665825 0 0) 0x7fe10006ea10 con 0x7fe1000b41e0 2024-09-10T08:48:22.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.829+0000 7fe0fea00640 1 -- 172.21.15.2:0/2692979269 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0e4003520 con 0x7fe1000b41e0 2024-09-10T08:48:22.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.829+0000 7fe0f7e00640 1 -- 172.21.15.2:0/2692979269 >> v1:172.21.15.155:6789/0 conn(0x7fe100067950 legacy=0x7fe10015f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:22.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.829+0000 7fe0fea00640 1 -- 172.21.15.2:0/2692979269 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 724054305 0 0) 0x7fe10006ecf0 con 0x7fe100067950 2024-09-10T08:48:22.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.829+0000 7fe0f7e00640 1 -- 172.21.15.2:0/2692979269 >> v1:172.21.15.2:6789/0 conn(0x7fe1000b41e0 legacy=0x7fe1000b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:22.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.829+0000 7fe0f7e00640 1 -- 172.21.15.2:0/2692979269 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe10006efd0 con 0x7fe100067d30 2024-09-10T08:48:22.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.831+0000 7fe0f7e00640 1 --2- 172.21.15.2:0/2692979269 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe100067d30 0x7fe1000b3ca0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe0e80097a0 tx=0x7fe0e802a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec528dac8e5ffde8 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:22.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.831+0000 7fe0fea00640 1 -- 172.21.15.2:0/2692979269 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e8037070 con 0x7fe100067d30 2024-09-10T08:48:22.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.831+0000 7fe0fea00640 1 -- 172.21.15.2:0/2692979269 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0e8032440 con 0x7fe100067d30 2024-09-10T08:48:22.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.831+0000 7fe0fea00640 1 -- 172.21.15.2:0/2692979269 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e80327f0 con 0x7fe100067d30 2024-09-10T08:48:22.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.831+0000 7fe106800640 1 -- 172.21.15.2:0/2692979269 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe100067d30 msgr2=0x7fe1000b3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:22.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.831+0000 7fe106800640 1 --2- 172.21.15.2:0/2692979269 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe100067d30 0x7fe1000b3ca0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe0e80097a0 tx=0x7fe0e802a1a0 comp rx=0 tx=0).stop 2024-09-10T08:48:22.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.831+0000 7fe106800640 1 -- 172.21.15.2:0/2692979269 shutdown_connections 2024-09-10T08:48:22.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.831+0000 7fe106800640 1 --2- 172.21.15.2:0/2692979269 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe100067d30 0x7fe1000b3ca0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:22.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.831+0000 7fe106800640 1 -- 172.21.15.2:0/2692979269 >> 172.21.15.2:0/2692979269 conn(0x7fe1000735e0 msgr2=0x7fe10006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:22.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.832+0000 7fe106800640 1 -- 172.21.15.2:0/2692979269 shutdown_connections 2024-09-10T08:48:22.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.832+0000 7fe106800640 1 -- 172.21.15.2:0/2692979269 wait complete. 2024-09-10T08:48:22.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.833+0000 7fe106800640 1 Processor -- start 2024-09-10T08:48:22.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.833+0000 7fe106800640 1 -- start start 2024-09-10T08:48:22.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.834+0000 7fe106800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe100067950 0x7fe100143380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:22.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.834+0000 7fe106800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe100067d30 0x7fe1000aead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:22.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.834+0000 7fe106800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1000b41e0 0x7fe1000af010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:22.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.834+0000 7fe106800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe100068170 con 0x7fe100067d30 2024-09-10T08:48:22.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.834+0000 7fe106800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe10006e700 con 0x7fe100067950 2024-09-10T08:48:22.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.834+0000 7fe106800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe100146370 con 0x7fe1000b41e0 2024-09-10T08:48:22.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.835+0000 7fe0f7e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe100067d30 0x7fe1000aead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:22.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.835+0000 7fe0f7e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe100067d30 0x7fe1000aead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52206/0 (socket says 172.21.15.2:52206) 2024-09-10T08:48:22.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.835+0000 7fe0f7e00640 1 -- 172.21.15.2:0/1769531386 learned_addr learned my addr 172.21.15.2:0/1769531386 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:22.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.835+0000 7fe0f7e00640 1 -- 172.21.15.2:0/1769531386 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1000b41e0 msgr2=0x7fe1000af010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:22.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.835+0000 7fe0ffe00640 1 --2- 172.21.15.2:0/1769531386 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1000b41e0 0x7fe1000af010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:22.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.835+0000 7fe0ff400640 1 --2- 172.21.15.2:0/1769531386 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe100067950 0x7fe100143380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:22.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.835+0000 7fe0f7e00640 1 --2- 172.21.15.2:0/1769531386 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1000b41e0 0x7fe1000af010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:22.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.835+0000 7fe0f7e00640 1 -- 172.21.15.2:0/1769531386 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe100067950 msgr2=0x7fe100143380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:22.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.835+0000 7fe0f7e00640 1 --2- 172.21.15.2:0/1769531386 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe100067950 0x7fe100143380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:22.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.835+0000 7fe0f7e00640 1 -- 172.21.15.2:0/1769531386 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1001430a0 con 0x7fe100067d30 2024-09-10T08:48:22.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.835+0000 7fe0ffe00640 1 --2- 172.21.15.2:0/1769531386 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1000b41e0 0x7fe1000af010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:48:22.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.835+0000 7fe0ff400640 1 --2- 172.21.15.2:0/1769531386 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe100067950 0x7fe100143380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:48:22.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.835+0000 7fe0f7e00640 1 --2- 172.21.15.2:0/1769531386 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe100067d30 0x7fe1000aead0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fe0e8000c00 tx=0x7fe0e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:22.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.836+0000 7fe0f7400640 1 -- 172.21.15.2:0/1769531386 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e8037040 con 0x7fe100067d30 2024-09-10T08:48:22.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.836+0000 7fe0f7400640 1 -- 172.21.15.2:0/1769531386 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0e8042070 con 0x7fe100067d30 2024-09-10T08:48:22.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.836+0000 7fe0f7400640 1 -- 172.21.15.2:0/1769531386 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e8030900 con 0x7fe100067d30 2024-09-10T08:48:22.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.836+0000 7fe106800640 1 -- 172.21.15.2:0/1769531386 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1001456f0 con 0x7fe100067d30 2024-09-10T08:48:22.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.836+0000 7fe106800640 1 -- 172.21.15.2:0/1769531386 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe100145cb0 con 0x7fe100067d30 2024-09-10T08:48:22.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.837+0000 7fe106800640 1 -- 172.21.15.2:0/1769531386 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1000afe30 con 0x7fe100067d30 2024-09-10T08:48:22.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.838+0000 7fe0f7400640 1 -- 172.21.15.2:0/1769531386 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 14) ==== 90498+0+0 (secure 0 0 0) 0x7fe0e8030aa0 con 0x7fe100067d30 2024-09-10T08:48:22.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.839+0000 7fe0f7400640 1 --2- 172.21.15.2:0/1769531386 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7fe0dc06be30 0x7fe0dc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:22.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.839+0000 7fe0f7400640 1 -- 172.21.15.2:0/1769531386 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5980+0+0 (secure 0 0 0) 0x7fe0e80ab8d0 con 0x7fe100067d30 2024-09-10T08:48:22.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.839+0000 7fe0ff400640 1 --2- 172.21.15.2:0/1769531386 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7fe0dc06be30 0x7fe0dc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:22.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.840+0000 7fe0ff400640 1 --2- 172.21.15.2:0/1769531386 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7fe0dc06be30 0x7fe0dc06e2f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe0f0000f60 tx=0x7fe0f0009040 comp rx=0 tx=0).ready entity=mgr.4862 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:22.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:22.843+0000 7fe0f7400640 1 -- 172.21.15.2:0/1769531386 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe1001430a0 con 0x7fe100067d30 2024-09-10T08:48:23.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.025+0000 7fe106800640 1 -- 172.21.15.2:0/1769531386 --> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe100145ff0 con 0x7fe0dc06be30 2024-09-10T08:48:23.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.026+0000 7fe0f7400640 1 -- 172.21.15.2:0/1769531386 <== mgr.4862 v2:172.21.15.155:6832/2264044153 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13491 (secure 0 0 0) 0x7fe100145ff0 con 0x7fe0dc06be30 2024-09-10T08:48:23.027 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:48:23.027 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-10T08:48:23.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.029+0000 7fe106800640 1 -- 172.21.15.2:0/1769531386 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7fe0dc06be30 msgr2=0x7fe0dc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:23.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.029+0000 7fe106800640 1 --2- 172.21.15.2:0/1769531386 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7fe0dc06be30 0x7fe0dc06e2f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe0f0000f60 tx=0x7fe0f0009040 comp rx=0 tx=0).stop 2024-09-10T08:48:23.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.029+0000 7fe106800640 1 -- 172.21.15.2:0/1769531386 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe100067d30 msgr2=0x7fe1000aead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:23.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.029+0000 7fe106800640 1 --2- 172.21.15.2:0/1769531386 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe100067d30 0x7fe1000aead0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fe0e8000c00 tx=0x7fe0e80046c0 comp rx=0 tx=0).stop 2024-09-10T08:48:23.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.029+0000 7fe106800640 1 -- 172.21.15.2:0/1769531386 shutdown_connections 2024-09-10T08:48:23.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.029+0000 7fe106800640 1 --2- 172.21.15.2:0/1769531386 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7fe0dc06be30 0x7fe0dc06e2f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:23.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.029+0000 7fe106800640 1 --2- 172.21.15.2:0/1769531386 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe1000b41e0 0x7fe1000af010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:23.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.029+0000 7fe106800640 1 --2- 172.21.15.2:0/1769531386 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe100067d30 0x7fe1000aead0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:23.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.029+0000 7fe106800640 1 --2- 172.21.15.2:0/1769531386 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe100067950 0x7fe100143380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:23.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.029+0000 7fe106800640 1 -- 172.21.15.2:0/1769531386 >> 172.21.15.2:0/1769531386 conn(0x7fe1000735e0 msgr2=0x7fe1000b08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:23.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.029+0000 7fe106800640 1 -- 172.21.15.2:0/1769531386 shutdown_connections 2024-09-10T08:48:23.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.029+0000 7fe106800640 1 -- 172.21.15.2:0/1769531386 wait complete. 2024-09-10T08:48:23.045 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":8,"stamp":"2024-09-10T08:48:21.294891+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":22,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":238024,"kb_used_data":5128,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736696,"statfs":{"total":773094113280,"available":772850376704,"internally_reserved":0,"allocated":5251072,"data_stored":2979192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-732920,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-25,"num_whiteouts":0,"num_read":-321,"num_read_kb":-165,"num_write":-337,"num_write_kb":-2904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.000066"},"pg_stats":[{"pgid":"1.0","version":"42'139","reported_seq":289,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-10T08:48:18.375156+0000","last_change":"2024-09-10T08:46:42.177049+0000","last_active":"2024-09-10T08:48:18.375156+0000","last_peered":"2024-09-10T08:48:18.375156+0000","last_clean":"2024-09-10T08:48:18.375156+0000","last_became_active":"2024-09-10T08:46:42.175678+0000","last_became_peered":"2024-09-10T08:46:42.175678+0000","last_unstale":"2024-09-10T08:48:18.375156+0000","last_undegraded":"2024-09-10T08:48:18.375156+0000","last_fullsized":"2024-09-10T08:48:18.375156+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:40.326212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:40.326212+0000","last_clean_scrub_stamp":"2024-09-10T08:46:40.326212+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:06.642437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28108,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343732,"statfs":{"total":96636764160,"available":96607981568,"internally_reserved":0,"allocated":1101824,"data_stored":815175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27532,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":507904,"data_stored":224807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27528,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":507904,"data_stored":224807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27528,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":507904,"data_stored":224807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31688,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340152,"statfs":{"total":96636764160,"available":96604315648,"internally_reserved":0,"allocated":507904,"data_stored":224807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31688,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340152,"statfs":{"total":96636764160,"available":96604315648,"internally_reserved":0,"allocated":507904,"data_stored":224807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31688,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340152,"statfs":{"total":96636764160,"available":96604315648,"internally_reserved":0,"allocated":507904,"data_stored":224807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32264,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339576,"statfs":{"total":96636764160,"available":96603725824,"internally_reserved":0,"allocated":1101824,"data_stored":815175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:48:23.046 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T08:48:23.046 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:48:23.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.202+0000 7fce5a800640 1 Processor -- start 2024-09-10T08:48:23.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.202+0000 7fce5a800640 1 -- start start 2024-09-10T08:48:23.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.203+0000 7fce5a800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fce540cebc0 0x7fce540b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:23.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.203+0000 7fce5a800640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce540d4180 con 0x7fce5415e4c0 2024-09-10T08:48:23.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.203+0000 7fce5a800640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce540b6730 con 0x7fce540b6320 2024-09-10T08:48:23.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.203+0000 7fce5a800640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fce540d30e0 con 0x7fce540cebc0 2024-09-10T08:48:23.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.203+0000 7fce58a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fce540cebc0 0x7fce540b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:23.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.203+0000 7fce58a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fce540cebc0 0x7fce540b5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52222/0 (socket says 172.21.15.2:52222) 2024-09-10T08:48:23.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.203+0000 7fce58a00640 1 -- 172.21.15.2:0/3429960852 learned_addr learned my addr 172.21.15.2:0/3429960852 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:23.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.203+0000 7fce59400640 1 --1- 172.21.15.2:0/3429960852 >> v1:172.21.15.2:6789/0 conn(0x7fce5415e4c0 0x7fce540d2890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:44560/0 (socket says 172.21.15.2:44560) 2024-09-10T08:48:23.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.204+0000 7fce58a00640 1 -- 172.21.15.2:0/3429960852 >> v1:172.21.15.155:6789/0 conn(0x7fce540b6320 legacy=0x7fce540b7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:48:23.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.204+0000 7fce58a00640 1 -- 172.21.15.2:0/3429960852 >> v1:172.21.15.2:6789/0 conn(0x7fce5415e4c0 legacy=0x7fce540d2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:23.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.204+0000 7fce58a00640 1 -- 172.21.15.2:0/3429960852 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce540d33c0 con 0x7fce540cebc0 2024-09-10T08:48:23.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.205+0000 7fce58a00640 1 --2- 172.21.15.2:0/3429960852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce540cebc0 0x7fce540b5de0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fce40009870 tx=0x7fce4002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78d0b1c1b74b6c40 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:23.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.205+0000 7fce53e00640 1 -- 172.21.15.2:0/3429960852 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce40037070 con 0x7fce540cebc0 2024-09-10T08:48:23.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.205+0000 7fce53e00640 1 -- 172.21.15.2:0/3429960852 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce40032440 con 0x7fce540cebc0 2024-09-10T08:48:23.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.205+0000 7fce53e00640 1 -- 172.21.15.2:0/3429960852 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce40032810 con 0x7fce540cebc0 2024-09-10T08:48:23.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.206+0000 7fce5a800640 1 -- 172.21.15.2:0/3429960852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce540cebc0 msgr2=0x7fce540b5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:23.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.206+0000 7fce5a800640 1 --2- 172.21.15.2:0/3429960852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce540cebc0 0x7fce540b5de0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fce40009870 tx=0x7fce4002a210 comp rx=0 tx=0).stop 2024-09-10T08:48:23.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.206+0000 7fce5a800640 1 -- 172.21.15.2:0/3429960852 shutdown_connections 2024-09-10T08:48:23.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.206+0000 7fce5a800640 1 --2- 172.21.15.2:0/3429960852 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce540cebc0 0x7fce540b5de0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:23.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.206+0000 7fce5a800640 1 -- 172.21.15.2:0/3429960852 >> 172.21.15.2:0/3429960852 conn(0x7fce540d0de0 msgr2=0x7fce540d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:23.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.206+0000 7fce5a800640 1 -- 172.21.15.2:0/3429960852 shutdown_connections 2024-09-10T08:48:23.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.206+0000 7fce5a800640 1 -- 172.21.15.2:0/3429960852 wait complete. 2024-09-10T08:48:23.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.207+0000 7fce5a800640 1 Processor -- start 2024-09-10T08:48:23.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.208+0000 7fce5a800640 1 -- start start 2024-09-10T08:48:23.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.208+0000 7fce5a800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce540b6320 0x7fce54154800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:23.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.208+0000 7fce5a800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce540cebc0 0x7fce54156040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:23.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.208+0000 7fce5a800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce5415e4c0 0x7fce540cb430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:23.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.208+0000 7fce5a800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fce540d3c60 con 0x7fce5415e4c0 2024-09-10T08:48:23.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.209+0000 7fce5a800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fce540d3980 con 0x7fce540b6320 2024-09-10T08:48:23.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.209+0000 7fce5a800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fce5415e8a0 con 0x7fce540cebc0 2024-09-10T08:48:23.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.209+0000 7fce59e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce5415e4c0 0x7fce540cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:23.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.209+0000 7fce59e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce5415e4c0 0x7fce540cb430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52232/0 (socket says 172.21.15.2:52232) 2024-09-10T08:48:23.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.209+0000 7fce59e00640 1 -- 172.21.15.2:0/4195385277 learned_addr learned my addr 172.21.15.2:0/4195385277 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:23.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.209+0000 7fce58a00640 1 --2- 172.21.15.2:0/4195385277 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce540cebc0 0x7fce54156040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:23.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.209+0000 7fce59400640 1 --2- 172.21.15.2:0/4195385277 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce540b6320 0x7fce54154800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:23.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.209+0000 7fce59e00640 1 -- 172.21.15.2:0/4195385277 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce540cebc0 msgr2=0x7fce54156040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:23.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.209+0000 7fce59e00640 1 --2- 172.21.15.2:0/4195385277 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce540cebc0 0x7fce54156040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:23.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.209+0000 7fce59e00640 1 -- 172.21.15.2:0/4195385277 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce540b6320 msgr2=0x7fce54154800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:23.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.209+0000 7fce59e00640 1 --2- 172.21.15.2:0/4195385277 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce540b6320 0x7fce54154800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:23.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.209+0000 7fce59e00640 1 -- 172.21.15.2:0/4195385277 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce541f56a0 con 0x7fce5415e4c0 2024-09-10T08:48:23.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.209+0000 7fce59400640 1 --2- 172.21.15.2:0/4195385277 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce540b6320 0x7fce54154800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:48:23.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.210+0000 7fce59e00640 1 --2- 172.21.15.2:0/4195385277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce5415e4c0 0x7fce540cb430 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fce4c00c780 tx=0x7fce4c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:23.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.210+0000 7fce51600640 1 -- 172.21.15.2:0/4195385277 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce4c017070 con 0x7fce5415e4c0 2024-09-10T08:48:23.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.210+0000 7fce51600640 1 -- 172.21.15.2:0/4195385277 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce4c003da0 con 0x7fce5415e4c0 2024-09-10T08:48:23.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.210+0000 7fce51600640 1 -- 172.21.15.2:0/4195385277 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce4c0052b0 con 0x7fce5415e4c0 2024-09-10T08:48:23.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.210+0000 7fce5a800640 1 -- 172.21.15.2:0/4195385277 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce54155560 con 0x7fce5415e4c0 2024-09-10T08:48:23.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.210+0000 7fce5a800640 1 -- 172.21.15.2:0/4195385277 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce54155b20 con 0x7fce5415e4c0 2024-09-10T08:48:23.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.211+0000 7fce5a800640 1 -- 172.21.15.2:0/4195385277 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce540cacd0 con 0x7fce5415e4c0 2024-09-10T08:48:23.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.212+0000 7fce51600640 1 -- 172.21.15.2:0/4195385277 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 14) ==== 90498+0+0 (secure 0 0 0) 0x7fce4c005450 con 0x7fce5415e4c0 2024-09-10T08:48:23.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.213+0000 7fce51600640 1 --2- 172.21.15.2:0/4195385277 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7fce3406be30 0x7fce3406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:23.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.213+0000 7fce51600640 1 -- 172.21.15.2:0/4195385277 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5980+0+0 (secure 0 0 0) 0x7fce4c08a440 con 0x7fce5415e4c0 2024-09-10T08:48:23.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.213+0000 7fce59400640 1 --2- 172.21.15.2:0/4195385277 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7fce3406be30 0x7fce3406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:23.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.214+0000 7fce59400640 1 --2- 172.21.15.2:0/4195385277 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7fce3406be30 0x7fce3406e2f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fce48007fd0 tx=0x7fce48007d60 comp rx=0 tx=0).ready entity=mgr.4862 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:23.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.217+0000 7fce51600640 1 -- 172.21.15.2:0/4195385277 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fce540cacd0 con 0x7fce5415e4c0 2024-09-10T08:48:23.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.400+0000 7fce5a800640 1 -- 172.21.15.2:0/4195385277 --> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fce541f5980 con 0x7fce3406be30 2024-09-10T08:48:23.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.402+0000 7fce51600640 1 -- 172.21.15.2:0/4195385277 <== mgr.4862 v2:172.21.15.155:6832/2264044153 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13491 (secure 0 0 0) 0x7fce541f5980 con 0x7fce3406be30 2024-09-10T08:48:23.402 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:48:23.402 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-10T08:48:23.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.404+0000 7fce5a800640 1 -- 172.21.15.2:0/4195385277 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7fce3406be30 msgr2=0x7fce3406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:23.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.404+0000 7fce5a800640 1 --2- 172.21.15.2:0/4195385277 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7fce3406be30 0x7fce3406e2f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fce48007fd0 tx=0x7fce48007d60 comp rx=0 tx=0).stop 2024-09-10T08:48:23.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.404+0000 7fce5a800640 1 -- 172.21.15.2:0/4195385277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce5415e4c0 msgr2=0x7fce540cb430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:23.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.404+0000 7fce5a800640 1 --2- 172.21.15.2:0/4195385277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce5415e4c0 0x7fce540cb430 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fce4c00c780 tx=0x7fce4c00cc40 comp rx=0 tx=0).stop 2024-09-10T08:48:23.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.404+0000 7fce5a800640 1 -- 172.21.15.2:0/4195385277 shutdown_connections 2024-09-10T08:48:23.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.404+0000 7fce5a800640 1 --2- 172.21.15.2:0/4195385277 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7fce3406be30 0x7fce3406e2f0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:23.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.404+0000 7fce5a800640 1 --2- 172.21.15.2:0/4195385277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce5415e4c0 0x7fce540cb430 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:23.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.404+0000 7fce5a800640 1 --2- 172.21.15.2:0/4195385277 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fce540cebc0 0x7fce54156040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:23.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.404+0000 7fce5a800640 1 --2- 172.21.15.2:0/4195385277 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce540b6320 0x7fce54154800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:23.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.404+0000 7fce5a800640 1 -- 172.21.15.2:0/4195385277 >> 172.21.15.2:0/4195385277 conn(0x7fce540d0de0 msgr2=0x7fce5415bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:23.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.404+0000 7fce5a800640 1 -- 172.21.15.2:0/4195385277 shutdown_connections 2024-09-10T08:48:23.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.404+0000 7fce5a800640 1 -- 172.21.15.2:0/4195385277 wait complete. 2024-09-10T08:48:23.421 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":9,"stamp":"2024-09-10T08:48:23.295482+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":22,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":238024,"kb_used_data":5128,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736696,"statfs":{"total":773094113280,"available":772850376704,"internally_reserved":0,"allocated":5251072,"data_stored":2979192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-732920,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-25,"num_whiteouts":0,"num_read":-321,"num_read_kb":-165,"num_write":-337,"num_write_kb":-2904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.000657"},"pg_stats":[{"pgid":"1.0","version":"42'139","reported_seq":289,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-10T08:48:18.375156+0000","last_change":"2024-09-10T08:46:42.177049+0000","last_active":"2024-09-10T08:48:18.375156+0000","last_peered":"2024-09-10T08:48:18.375156+0000","last_clean":"2024-09-10T08:48:18.375156+0000","last_became_active":"2024-09-10T08:46:42.175678+0000","last_became_peered":"2024-09-10T08:46:42.175678+0000","last_unstale":"2024-09-10T08:48:18.375156+0000","last_undegraded":"2024-09-10T08:48:18.375156+0000","last_fullsized":"2024-09-10T08:48:18.375156+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:40.326212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:40.326212+0000","last_clean_scrub_stamp":"2024-09-10T08:46:40.326212+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:06.642437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28108,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343732,"statfs":{"total":96636764160,"available":96607981568,"internally_reserved":0,"allocated":1101824,"data_stored":815175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27532,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":507904,"data_stored":224807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27528,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":507904,"data_stored":224807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27528,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":507904,"data_stored":224807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31688,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340152,"statfs":{"total":96636764160,"available":96604315648,"internally_reserved":0,"allocated":507904,"data_stored":224807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31688,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340152,"statfs":{"total":96636764160,"available":96604315648,"internally_reserved":0,"allocated":507904,"data_stored":224807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31688,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340152,"statfs":{"total":96636764160,"available":96604315648,"internally_reserved":0,"allocated":507904,"data_stored":224807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32264,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339576,"statfs":{"total":96636764160,"available":96603725824,"internally_reserved":0,"allocated":1101824,"data_stored":815175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:48:23.421 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T08:48:23.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.576+0000 7ffbf2600640 1 Processor -- start 2024-09-10T08:48:23.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.576+0000 7ffbf2600640 1 -- start start 2024-09-10T08:48:23.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.577+0000 7ffbf2600640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ffbec0d4d00 0x7ffbec0d2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:23.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.577+0000 7ffbf2600640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbec0d52e0 con 0x7ffbec15e890 2024-09-10T08:48:23.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.577+0000 7ffbf2600640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbec0cfe60 con 0x7ffbec0d3110 2024-09-10T08:48:23.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.577+0000 7ffbf2600640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7ffbec0cfc10 con 0x7ffbec0d4d00 2024-09-10T08:48:23.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.577+0000 7ffbeb400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ffbec15e890 0x7ffbec0d22c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:44562/0 (socket says 172.21.15.2:44562) 2024-09-10T08:48:23.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.577+0000 7ffbeb400640 1 -- 172.21.15.2:0/3366864817 learned_addr learned my addr 172.21.15.2:0/3366864817 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:48:23.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.578+0000 7ffbeaa00640 1 --2- 172.21.15.2:0/3366864817 >> v2:172.21.15.155:3300/0 conn(0x7ffbec0d4d00 0x7ffbec0d2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:23.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.578+0000 7ffbea000640 1 -- 172.21.15.2:0/3366864817 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3718021238 0 0) 0x7ffbec0d52e0 con 0x7ffbec15e890 2024-09-10T08:48:23.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.578+0000 7ffbea000640 1 -- 172.21.15.2:0/3366864817 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffbd0003520 con 0x7ffbec15e890 2024-09-10T08:48:23.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.578+0000 7ffbeaa00640 1 -- 172.21.15.2:0/3366864817 >> v1:172.21.15.155:6789/0 conn(0x7ffbec0d3110 legacy=0x7ffbec0b1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:23.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.578+0000 7ffbeaa00640 1 -- 172.21.15.2:0/3366864817 >> v1:172.21.15.2:6789/0 conn(0x7ffbec15e890 legacy=0x7ffbec0d22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:23.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.578+0000 7ffbea000640 1 -- 172.21.15.2:0/3366864817 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 105574109 0 0) 0x7ffbd0003520 con 0x7ffbec15e890 2024-09-10T08:48:23.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.578+0000 7ffbeaa00640 1 -- 172.21.15.2:0/3366864817 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbec0d0140 con 0x7ffbec0d4d00 2024-09-10T08:48:23.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.579+0000 7ffbeaa00640 1 --2- 172.21.15.2:0/3366864817 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffbec0d4d00 0x7ffbec0d2bd0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ffbec0cfd90 tx=0x7ffbd802a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91d17316d4726ac4 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:23.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.580+0000 7ffbea000640 1 -- 172.21.15.2:0/3366864817 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbd8037070 con 0x7ffbec0d4d00 2024-09-10T08:48:23.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.580+0000 7ffbea000640 1 -- 172.21.15.2:0/3366864817 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbd802aba0 con 0x7ffbec0d4d00 2024-09-10T08:48:23.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.580+0000 7ffbea000640 1 -- 172.21.15.2:0/3366864817 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbdc001670 con 0x7ffbec0d4d00 2024-09-10T08:48:23.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.580+0000 7ffbf2600640 1 -- 172.21.15.2:0/3366864817 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffbec0d4d00 msgr2=0x7ffbec0d2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:23.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.580+0000 7ffbf2600640 1 --2- 172.21.15.2:0/3366864817 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffbec0d4d00 0x7ffbec0d2bd0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ffbec0cfd90 tx=0x7ffbd802a110 comp rx=0 tx=0).stop 2024-09-10T08:48:23.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.580+0000 7ffbf2600640 1 -- 172.21.15.2:0/3366864817 shutdown_connections 2024-09-10T08:48:23.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.580+0000 7ffbf2600640 1 --2- 172.21.15.2:0/3366864817 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffbec0d4d00 0x7ffbec0d2bd0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:23.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.580+0000 7ffbf2600640 1 -- 172.21.15.2:0/3366864817 >> 172.21.15.2:0/3366864817 conn(0x7ffbec08bfd0 msgr2=0x7ffbec0d45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:23.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.580+0000 7ffbf2600640 1 -- 172.21.15.2:0/3366864817 shutdown_connections 2024-09-10T08:48:23.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.580+0000 7ffbf2600640 1 -- 172.21.15.2:0/3366864817 wait complete. 2024-09-10T08:48:23.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.582+0000 7ffbf2600640 1 Processor -- start 2024-09-10T08:48:23.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.582+0000 7ffbf2600640 1 -- start start 2024-09-10T08:48:23.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.583+0000 7ffbf2600640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffbec0d3110 0x7ffbec1f4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:23.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.583+0000 7ffbf2600640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffbec0d4d00 0x7ffbec15d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:23.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.583+0000 7ffbf2600640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbec15e890 0x7ffbec0b3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:23.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.583+0000 7ffbf2600640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ffbec0b2030 con 0x7ffbec15e890 2024-09-10T08:48:23.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.583+0000 7ffbf2600640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ffbec0b1eb0 con 0x7ffbec0d4d00 2024-09-10T08:48:23.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.583+0000 7ffbf2600640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ffbec0b21b0 con 0x7ffbec0d3110 2024-09-10T08:48:23.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.583+0000 7ffbebe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbec15e890 0x7ffbec0b3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:23.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.583+0000 7ffbebe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbec15e890 0x7ffbec0b3c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52240/0 (socket says 172.21.15.2:52240) 2024-09-10T08:48:23.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.583+0000 7ffbebe00640 1 -- 172.21.15.2:0/3895503765 learned_addr learned my addr 172.21.15.2:0/3895503765 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:23.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.583+0000 7ffbeaa00640 1 --2- 172.21.15.2:0/3895503765 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffbec0d4d00 0x7ffbec15d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:23.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.583+0000 7ffbeb400640 1 --2- 172.21.15.2:0/3895503765 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffbec0d3110 0x7ffbec1f4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:23.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.584+0000 7ffbebe00640 1 -- 172.21.15.2:0/3895503765 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffbec0d3110 msgr2=0x7ffbec1f4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:23.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.584+0000 7ffbebe00640 1 --2- 172.21.15.2:0/3895503765 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffbec0d3110 0x7ffbec1f4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:23.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.584+0000 7ffbebe00640 1 -- 172.21.15.2:0/3895503765 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffbec0d4d00 msgr2=0x7ffbec15d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:23.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.584+0000 7ffbebe00640 1 --2- 172.21.15.2:0/3895503765 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffbec0d4d00 0x7ffbec15d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:23.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.584+0000 7ffbebe00640 1 -- 172.21.15.2:0/3895503765 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbec0c90c0 con 0x7ffbec15e890 2024-09-10T08:48:23.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.584+0000 7ffbebe00640 1 --2- 172.21.15.2:0/3895503765 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbec15e890 0x7ffbec0b3c20 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ffbe400c7a0 tx=0x7ffbe400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:23.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.584+0000 7ffbe3400640 1 -- 172.21.15.2:0/3895503765 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbe4003b70 con 0x7ffbec15e890 2024-09-10T08:48:23.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.584+0000 7ffbe3400640 1 -- 172.21.15.2:0/3895503765 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbe4003d30 con 0x7ffbec15e890 2024-09-10T08:48:23.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.584+0000 7ffbe3400640 1 -- 172.21.15.2:0/3895503765 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbe400aa30 con 0x7ffbec15e890 2024-09-10T08:48:23.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.584+0000 7ffbf2600640 1 -- 172.21.15.2:0/3895503765 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbec0caf00 con 0x7ffbec15e890 2024-09-10T08:48:23.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.584+0000 7ffbf2600640 1 -- 172.21.15.2:0/3895503765 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbec0c9340 con 0x7ffbec15e890 2024-09-10T08:48:23.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.585+0000 7ffbf2600640 1 -- 172.21.15.2:0/3895503765 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbec0b25a0 con 0x7ffbec15e890 2024-09-10T08:48:23.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.586+0000 7ffbe3400640 1 -- 172.21.15.2:0/3895503765 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 14) ==== 90498+0+0 (secure 0 0 0) 0x7ffbe400abd0 con 0x7ffbec15e890 2024-09-10T08:48:23.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.587+0000 7ffbe3400640 1 --2- 172.21.15.2:0/3895503765 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7ffbcc06be30 0x7ffbcc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:23.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.588+0000 7ffbe3400640 1 -- 172.21.15.2:0/3895503765 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5980+0+0 (secure 0 0 0) 0x7ffbe408acf0 con 0x7ffbec15e890 2024-09-10T08:48:23.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.588+0000 7ffbeb400640 1 --2- 172.21.15.2:0/3895503765 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7ffbcc06be30 0x7ffbcc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:23.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.589+0000 7ffbeb400640 1 --2- 172.21.15.2:0/3895503765 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7ffbcc06be30 0x7ffbcc06e2f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc005880 tx=0x7ffbdc000bc0 comp rx=0 tx=0).ready entity=mgr.4862 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:23.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.592+0000 7ffbe3400640 1 -- 172.21.15.2:0/3895503765 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ffbec0c90c0 con 0x7ffbec15e890 2024-09-10T08:48:23.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.775+0000 7ffbf2600640 1 -- 172.21.15.2:0/3895503765 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffbec15dda0 con 0x7ffbec15e890 2024-09-10T08:48:23.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.776+0000 7ffbe3400640 1 -- 172.21.15.2:0/3895503765 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) ==== 74+0+14195 (secure 0 0 0) 0x7ffbe4058f30 con 0x7ffbec15e890 2024-09-10T08:48:23.776 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:48:23.776 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":43,"fsid":"f20a15a7-d363-4d44-98cb-4f4f466b52b8","created":"2024-09-10T08:46:26.481619+0000","modified":"2024-09-10T08:48:18.285595+0000","last_up_change":"2024-09-10T08:46:39.323912+0000","last_in_change":"2024-09-10T08:46:29.499894+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T08:46:39.426180+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c90be333-506b-46d1-b00a-10d089a84776","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6822","nonce":298678486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6823","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6826","nonce":298678486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6831","nonce":298678486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":298678486},{"type":"v1","addr":"172.21.15.2:6829","nonce":298678486}]},"public_addr":"172.21.15.2:6822/298678486","cluster_addr":"172.21.15.2:6826/298678486","heartbeat_back_addr":"172.21.15.2:6831/298678486","heartbeat_front_addr":"172.21.15.2:6829/298678486","state":["exists","up"]},{"osd":1,"uuid":"3f8bdde8-6cd3-4112-8939-a876191c7368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6809","nonce":1619566025}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6811","nonce":1619566025}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6815","nonce":1619566025}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":1619566025},{"type":"v1","addr":"172.21.15.2:6813","nonce":1619566025}]},"public_addr":"172.21.15.2:6809/1619566025","cluster_addr":"172.21.15.2:6811/1619566025","heartbeat_back_addr":"172.21.15.2:6815/1619566025","heartbeat_front_addr":"172.21.15.2:6813/1619566025","state":["exists","up"]},{"osd":2,"uuid":"3835f5ab-ed3a-4f46-ae6c-f0edf21708d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6801","nonce":3992427579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6803","nonce":3992427579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6807","nonce":3992427579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3992427579},{"type":"v1","addr":"172.21.15.2:6805","nonce":3992427579}]},"public_addr":"172.21.15.2:6801/3992427579","cluster_addr":"172.21.15.2:6803/3992427579","heartbeat_back_addr":"172.21.15.2:6807/3992427579","heartbeat_front_addr":"172.21.15.2:6805/3992427579","state":["exists","up"]},{"osd":3,"uuid":"add6ad27-b411-4a82-9622-b0c1c1782cf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6817","nonce":1270626884}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6819","nonce":1270626884}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6827","nonce":1270626884}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":1270626884},{"type":"v1","addr":"172.21.15.2:6824","nonce":1270626884}]},"public_addr":"172.21.15.2:6817/1270626884","cluster_addr":"172.21.15.2:6819/1270626884","heartbeat_back_addr":"172.21.15.2:6827/1270626884","heartbeat_front_addr":"172.21.15.2:6824/1270626884","state":["exists","up"]},{"osd":4,"uuid":"c7b642f4-8bd2-4262-9a82-ee1061cfab7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6803","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6806","nonce":553254873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6813","nonce":553254873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6821","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6822","nonce":553254873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":553254873},{"type":"v1","addr":"172.21.15.155:6819","nonce":553254873}]},"public_addr":"172.21.15.155:6806/553254873","cluster_addr":"172.21.15.155:6813/553254873","heartbeat_back_addr":"172.21.15.155:6822/553254873","heartbeat_front_addr":"172.21.15.155:6819/553254873","state":["exists","up"]},{"osd":5,"uuid":"fb53289a-419f-46d8-9e3a-384ac529dc57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6805","nonce":2107688472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6811","nonce":2107688472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6823","nonce":2107688472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":2107688472},{"type":"v1","addr":"172.21.15.155:6817","nonce":2107688472}]},"public_addr":"172.21.15.155:6805/2107688472","cluster_addr":"172.21.15.155:6811/2107688472","heartbeat_back_addr":"172.21.15.155:6823/2107688472","heartbeat_front_addr":"172.21.15.155:6817/2107688472","state":["exists","up"]},{"osd":6,"uuid":"3f9ddd54-ede4-4565-aff6-ae1c07e7c678","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6825","nonce":944542383}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6827","nonce":944542383}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6831","nonce":944542383}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":944542383},{"type":"v1","addr":"172.21.15.155:6829","nonce":944542383}]},"public_addr":"172.21.15.155:6825/944542383","cluster_addr":"172.21.15.155:6827/944542383","heartbeat_back_addr":"172.21.15.155:6831/944542383","heartbeat_front_addr":"172.21.15.155:6829/944542383","state":["exists","up"]},{"osd":7,"uuid":"328d0681-eef4-4556-94e1-9745bd4adbe8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6801","nonce":2220093913}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6807","nonce":2220093913}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6818","nonce":2220093913}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2220093913},{"type":"v1","addr":"172.21.15.155:6812","nonce":2220093913}]},"public_addr":"172.21.15.155:6801/2220093913","cluster_addr":"172.21.15.155:6807/2220093913","heartbeat_back_addr":"172.21.15.155:6818/2220093913","heartbeat_front_addr":"172.21.15.155:6812/2220093913","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.052980+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.104550+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.025661+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:35.784354+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:35.863363+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.322312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:36.100890+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T08:46:35.763584+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.155:0/3348107229":"2024-09-11T08:48:15.269395+0000","172.21.15.155:0/2011710934":"2024-09-11T08:48:15.269395+0000","172.21.15.155:6833/3369759420":"2024-09-11T08:48:15.269395+0000","172.21.15.155:6832/3369759420":"2024-09-11T08:48:15.269395+0000","172.21.15.155:0/2559592977":"2024-09-11T08:48:15.269395+0000","172.21.15.155:6833/2611418382":"2024-09-11T08:48:07.142887+0000","172.21.15.155:0/3560911645":"2024-09-11T08:48:07.142887+0000","172.21.15.155:0/2000912206":"2024-09-11T08:48:15.269395+0000","172.21.15.155:6832/2611418382":"2024-09-11T08:48:07.142887+0000","172.21.15.155:0/146722447":"2024-09-11T08:48:15.269395+0000","172.21.15.155:0/1305551464":"2024-09-11T08:48:07.142887+0000","172.21.15.155:0/41896583":"2024-09-11T08:48:07.142887+0000","172.21.15.155:0/1872766231":"2024-09-11T08:48:07.142887+0000","172.21.15.2:6833/464022930":"2024-09-11T08:48:15.078557+0000","172.21.15.2:6835/464022930":"2024-09-11T08:48:15.078557+0000","172.21.15.155:0/3037596175":"2024-09-11T08:48:15.269395+0000","172.21.15.155:0/2420667288":"2024-09-11T08:48:15.269395+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T08:48:23.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.778+0000 7ffbf2600640 1 -- 172.21.15.2:0/3895503765 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7ffbcc06be30 msgr2=0x7ffbcc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:23.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.778+0000 7ffbf2600640 1 --2- 172.21.15.2:0/3895503765 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7ffbcc06be30 0x7ffbcc06e2f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc005880 tx=0x7ffbdc000bc0 comp rx=0 tx=0).stop 2024-09-10T08:48:23.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.778+0000 7ffbf2600640 1 -- 172.21.15.2:0/3895503765 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbec15e890 msgr2=0x7ffbec0b3c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:23.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.778+0000 7ffbf2600640 1 --2- 172.21.15.2:0/3895503765 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbec15e890 0x7ffbec0b3c20 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ffbe400c7a0 tx=0x7ffbe400cc60 comp rx=0 tx=0).stop 2024-09-10T08:48:23.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.778+0000 7ffbf2600640 1 -- 172.21.15.2:0/3895503765 shutdown_connections 2024-09-10T08:48:23.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.778+0000 7ffbf2600640 1 --2- 172.21.15.2:0/3895503765 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7ffbcc06be30 0x7ffbcc06e2f0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:23.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.778+0000 7ffbf2600640 1 --2- 172.21.15.2:0/3895503765 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffbec15e890 0x7ffbec0b3c20 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:23.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.778+0000 7ffbf2600640 1 --2- 172.21.15.2:0/3895503765 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffbec0d4d00 0x7ffbec15d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:23.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.778+0000 7ffbf2600640 1 --2- 172.21.15.2:0/3895503765 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffbec0d3110 0x7ffbec1f4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:23.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.778+0000 7ffbf2600640 1 -- 172.21.15.2:0/3895503765 >> 172.21.15.2:0/3895503765 conn(0x7ffbec08bfd0 msgr2=0x7ffbec0cf0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:23.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.778+0000 7ffbf2600640 1 -- 172.21.15.2:0/3895503765 shutdown_connections 2024-09-10T08:48:23.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:23.778+0000 7ffbf2600640 1 -- 172.21.15.2:0/3895503765 wait complete. 2024-09-10T08:48:24.795 INFO:tasks.ceph:Scrubbing osd.0 2024-09-10T08:48:24.795 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-10T08:48:24.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.965+0000 7fd102e00640 1 Processor -- start 2024-09-10T08:48:24.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.965+0000 7fd102e00640 1 -- start start 2024-09-10T08:48:24.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.966+0000 7fd102e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd0fc0add80 0x7fd0fc0ae160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:24.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.966+0000 7fd102e00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd0fc070790 0x7fd0fc15f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:24.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.966+0000 7fd102e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd0fc161f10 0x7fd0fc162380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:24.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.966+0000 7fd102e00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fd0fc0af3a0 con 0x7fd0fc161f10 2024-09-10T08:48:24.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.966+0000 7fd102e00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fd0fc0ae6a0 con 0x7fd0fc070790 2024-09-10T08:48:24.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.966+0000 7fd102e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd0fc0af5f0 con 0x7fd0fc0add80 2024-09-10T08:48:24.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.967+0000 7fd102400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd0fc161f10 0x7fd0fc162380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:24.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.967+0000 7fd102400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd0fc161f10 0x7fd0fc162380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52248/0 (socket says 172.21.15.2:52248) 2024-09-10T08:48:24.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.967+0000 7fd102400640 1 -- 172.21.15.2:0/2966896637 learned_addr learned my addr 172.21.15.2:0/2966896637 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:24.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.967+0000 7fd101a00640 1 --2- 172.21.15.2:0/2966896637 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd0fc0add80 0x7fd0fc0ae160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:24.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.967+0000 7fd101000640 1 --2- 172.21.15.2:0/2966896637 >> v2:172.21.15.155:3300/0 conn(0x7fd0fc070790 0x7fd0fc15f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:24.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.967+0000 7fd102400640 1 -- 172.21.15.2:0/2966896637 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd0fc0add80 msgr2=0x7fd0fc0ae160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:48:24.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.967+0000 7fd102400640 1 --2- 172.21.15.2:0/2966896637 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd0fc0add80 0x7fd0fc0ae160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:24.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.967+0000 7fd102400640 1 -- 172.21.15.2:0/2966896637 >> v2:172.21.15.155:3300/0 conn(0x7fd0fc070790 msgr2=0x7fd0fc15f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:48:24.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.967+0000 7fd102400640 1 --2- 172.21.15.2:0/2966896637 >> v2:172.21.15.155:3300/0 conn(0x7fd0fc070790 0x7fd0fc15f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:24.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.967+0000 7fd102400640 1 -- 172.21.15.2:0/2966896637 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0fc0af8d0 con 0x7fd0fc161f10 2024-09-10T08:48:24.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.967+0000 7fd101000640 1 --2- 172.21.15.2:0/2966896637 >> v2:172.21.15.155:3300/0 conn(0x7fd0fc070790 0x7fd0fc15f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:48:24.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.968+0000 7fd102400640 1 --2- 172.21.15.2:0/2966896637 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0fc161f10 0x7fd0fc162380 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc073ca0 tx=0x7fd0f402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d192fc82cbd8416 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:24.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.968+0000 7fd0fbe00640 1 -- 172.21.15.2:0/2966896637 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f4036070 con 0x7fd0fc161f10 2024-09-10T08:48:24.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.968+0000 7fd0fbe00640 1 -- 172.21.15.2:0/2966896637 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0f4031600 con 0x7fd0fc161f10 2024-09-10T08:48:24.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.968+0000 7fd0fbe00640 1 -- 172.21.15.2:0/2966896637 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f40319d0 con 0x7fd0fc161f10 2024-09-10T08:48:24.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.969+0000 7fd102e00640 1 -- 172.21.15.2:0/2966896637 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0fc161f10 msgr2=0x7fd0fc162380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:24.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.969+0000 7fd102e00640 1 --2- 172.21.15.2:0/2966896637 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0fc161f10 0x7fd0fc162380 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc073ca0 tx=0x7fd0f402a610 comp rx=0 tx=0).stop 2024-09-10T08:48:24.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.969+0000 7fd102e00640 1 -- 172.21.15.2:0/2966896637 shutdown_connections 2024-09-10T08:48:24.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.969+0000 7fd102e00640 1 --2- 172.21.15.2:0/2966896637 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0fc161f10 0x7fd0fc162380 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:24.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.969+0000 7fd102e00640 1 --2- 172.21.15.2:0/2966896637 >> v2:172.21.15.155:3300/0 conn(0x7fd0fc070790 0x7fd0fc15f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:24.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.969+0000 7fd102e00640 1 --2- 172.21.15.2:0/2966896637 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd0fc0add80 0x7fd0fc0ae160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:24.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.969+0000 7fd102e00640 1 -- 172.21.15.2:0/2966896637 >> 172.21.15.2:0/2966896637 conn(0x7fd0fc0734b0 msgr2=0x7fd0fc06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:24.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.969+0000 7fd102e00640 1 -- 172.21.15.2:0/2966896637 shutdown_connections 2024-09-10T08:48:24.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.969+0000 7fd102e00640 1 -- 172.21.15.2:0/2966896637 wait complete. 2024-09-10T08:48:24.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.971+0000 7fd102e00640 1 Processor -- start 2024-09-10T08:48:24.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.971+0000 7fd102e00640 1 -- start start 2024-09-10T08:48:24.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.972+0000 7fd102e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0fc070790 0x7fd0fc160c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:24.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.972+0000 7fd102e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd0fc0add80 0x7fd0fc15c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:24.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.972+0000 7fd102e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd0fc161f10 0x7fd0fc1f3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:24.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.972+0000 7fd102e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fd0fc0b03b0 con 0x7fd0fc070790 2024-09-10T08:48:24.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.972+0000 7fd102e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd0fc0afe90 con 0x7fd0fc0add80 2024-09-10T08:48:24.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.972+0000 7fd102e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fd0fc15f790 con 0x7fd0fc161f10 2024-09-10T08:48:24.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.972+0000 7fd101a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0fc070790 0x7fd0fc160c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:24.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.972+0000 7fd101a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0fc070790 0x7fd0fc160c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52254/0 (socket says 172.21.15.2:52254) 2024-09-10T08:48:24.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.972+0000 7fd101a00640 1 -- 172.21.15.2:0/542200267 learned_addr learned my addr 172.21.15.2:0/542200267 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:24.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.972+0000 7fd101000640 1 --2- 172.21.15.2:0/542200267 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd0fc0add80 0x7fd0fc15c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:24.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.972+0000 7fd102400640 1 --2- 172.21.15.2:0/542200267 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd0fc161f10 0x7fd0fc1f3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:24.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.973+0000 7fd101a00640 1 -- 172.21.15.2:0/542200267 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd0fc161f10 msgr2=0x7fd0fc1f3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:24.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.973+0000 7fd101a00640 1 --2- 172.21.15.2:0/542200267 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd0fc161f10 0x7fd0fc1f3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:24.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.973+0000 7fd101a00640 1 -- 172.21.15.2:0/542200267 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd0fc0add80 msgr2=0x7fd0fc15c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:24.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.973+0000 7fd101a00640 1 --2- 172.21.15.2:0/542200267 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd0fc0add80 0x7fd0fc15c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:24.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.973+0000 7fd101a00640 1 -- 172.21.15.2:0/542200267 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0fc15cd70 con 0x7fd0fc070790 2024-09-10T08:48:24.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.973+0000 7fd102400640 1 --2- 172.21.15.2:0/542200267 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd0fc161f10 0x7fd0fc1f3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:48:24.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.973+0000 7fd101a00640 1 --2- 172.21.15.2:0/542200267 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0fc070790 0x7fd0fc160c50 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd0f000d800 tx=0x7fd0f000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:24.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.973+0000 7fd0f9600640 1 -- 172.21.15.2:0/542200267 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f000b6c0 con 0x7fd0fc070790 2024-09-10T08:48:24.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.973+0000 7fd0f9600640 1 -- 172.21.15.2:0/542200267 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0f0019070 con 0x7fd0fc070790 2024-09-10T08:48:24.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.973+0000 7fd0f9600640 1 -- 172.21.15.2:0/542200267 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f000ba80 con 0x7fd0fc070790 2024-09-10T08:48:24.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.973+0000 7fd102e00640 1 -- 172.21.15.2:0/542200267 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0fc1612a0 con 0x7fd0fc070790 2024-09-10T08:48:24.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.973+0000 7fd102e00640 1 -- 172.21.15.2:0/542200267 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0fc15d7e0 con 0x7fd0fc070790 2024-09-10T08:48:24.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.974+0000 7fd102e00640 1 -- 172.21.15.2:0/542200267 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd0fc159cb0 con 0x7fd0fc070790 2024-09-10T08:48:24.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.975+0000 7fd0f9600640 1 -- 172.21.15.2:0/542200267 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 14) ==== 90498+0+0 (secure 0 0 0) 0x7fd0f000bc20 con 0x7fd0fc070790 2024-09-10T08:48:24.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.976+0000 7fd0f9600640 1 --2- 172.21.15.2:0/542200267 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7fd0dc06be30 0x7fd0dc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:24.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.976+0000 7fd0f9600640 1 -- 172.21.15.2:0/542200267 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5980+0+0 (secure 0 0 0) 0x7fd0f008be60 con 0x7fd0fc070790 2024-09-10T08:48:24.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.977+0000 7fd0f9600640 1 --2- 172.21.15.2:0/542200267 >> [v2:172.21.15.2:6820/298678486,v1:172.21.15.2:6822/298678486] conn(0x7fd0dc072870 0x7fd0dc074cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:24.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.977+0000 7fd0f9600640 1 -- 172.21.15.2:0/542200267 --> [v2:172.21.15.2:6820/298678486,v1:172.21.15.2:6822/298678486] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd0dc075380 con 0x7fd0dc072870 2024-09-10T08:48:24.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.977+0000 7fd0f9600640 1 -- 172.21.15.2:0/542200267 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7fd0f008c210 con 0x7fd0fc070790 2024-09-10T08:48:24.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.977+0000 7fd101000640 1 --2- 172.21.15.2:0/542200267 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7fd0dc06be30 0x7fd0dc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:24.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.977+0000 7fd102400640 1 --2- 172.21.15.2:0/542200267 >> [v2:172.21.15.2:6820/298678486,v1:172.21.15.2:6822/298678486] conn(0x7fd0dc072870 0x7fd0dc074cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:24.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.977+0000 7fd102400640 1 --2- 172.21.15.2:0/542200267 >> [v2:172.21.15.2:6820/298678486,v1:172.21.15.2:6822/298678486] conn(0x7fd0dc072870 0x7fd0dc074cb0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:24.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.978+0000 7fd101000640 1 --2- 172.21.15.2:0/542200267 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7fd0dc06be30 0x7fd0dc06e2f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc160be0 tx=0x7fd0e8008040 comp rx=0 tx=0).ready entity=mgr.4862 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:24.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.978+0000 7fd0f9600640 1 -- 172.21.15.2:0/542200267 <== osd.0 v2:172.21.15.2:6820/298678486 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd0dc075380 con 0x7fd0dc072870 2024-09-10T08:48:24.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.991+0000 7fd102e00640 1 -- 172.21.15.2:0/542200267 --> [v2:172.21.15.2:6820/298678486,v1:172.21.15.2:6822/298678486] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd0fc15dc30 con 0x7fd0dc072870 2024-09-10T08:48:24.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.992+0000 7fd0f9600640 1 -- 172.21.15.2:0/542200267 <== osd.0 v2:172.21.15.2:6820/298678486 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd0fc15dc30 con 0x7fd0dc072870 2024-09-10T08:48:24.992 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T08:48:24.992 INFO:teuthology.orchestra.run.smithi002.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T08:48:24.992 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T08:48:24.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.992+0000 7fd102e00640 1 -- 172.21.15.2:0/542200267 >> [v2:172.21.15.2:6820/298678486,v1:172.21.15.2:6822/298678486] conn(0x7fd0dc072870 msgr2=0x7fd0dc074cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:24.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.992+0000 7fd102e00640 1 --2- 172.21.15.2:0/542200267 >> [v2:172.21.15.2:6820/298678486,v1:172.21.15.2:6822/298678486] conn(0x7fd0dc072870 0x7fd0dc074cb0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:24.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.992+0000 7fd102e00640 1 -- 172.21.15.2:0/542200267 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7fd0dc06be30 msgr2=0x7fd0dc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:24.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.992+0000 7fd102e00640 1 --2- 172.21.15.2:0/542200267 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7fd0dc06be30 0x7fd0dc06e2f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc160be0 tx=0x7fd0e8008040 comp rx=0 tx=0).stop 2024-09-10T08:48:24.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.992+0000 7fd102e00640 1 -- 172.21.15.2:0/542200267 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0fc070790 msgr2=0x7fd0fc160c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:24.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.992+0000 7fd102e00640 1 --2- 172.21.15.2:0/542200267 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd0fc070790 0x7fd0fc160c50 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd0f000d800 tx=0x7fd0f000dcc0 comp rx=0 tx=0).stop 2024-09-10T08:48:24.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.992+0000 7fd102400640 1 -- 172.21.15.2:0/542200267 reap_dead start 2024-09-10T08:48:24.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.992+0000 7fd102e00640 1 -- 172.21.15.2:0/542200267 shutdown_connections 2024-09-10T08:48:24.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.992+0000 7fd102e00640 1 -- 172.21.15.2:0/542200267 >> 172.21.15.2:0/542200267 conn(0x7fd0fc0734b0 msgr2=0x7fd0fc0b0910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:24.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.992+0000 7fd102e00640 1 -- 172.21.15.2:0/542200267 shutdown_connections 2024-09-10T08:48:24.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:24.992+0000 7fd102e00640 1 -- 172.21.15.2:0/542200267 wait complete. 2024-09-10T08:48:25.007 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-10T08:48:25.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.164+0000 7fdc15a00640 1 Processor -- start 2024-09-10T08:48:25.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.165+0000 7fdc15a00640 1 -- start start 2024-09-10T08:48:25.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.166+0000 7fdc15a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc1015c240 0x7fdc100cebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:25.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.166+0000 7fdc15a00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fdc100b4a20 0x7fdc1006e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:25.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.166+0000 7fdc15a00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc1015c620 con 0x7fdc100cf0f0 2024-09-10T08:48:25.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.166+0000 7fdc15a00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fdc100cfe60 con 0x7fdc100b4a20 2024-09-10T08:48:25.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.166+0000 7fdc15a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fdc1006e160 con 0x7fdc1015c240 2024-09-10T08:48:25.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.166+0000 7fdc0ea00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc1015c240 0x7fdc100cebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:25.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.166+0000 7fdc0ea00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc1015c240 0x7fdc100cebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.2:36204/0 (socket says 172.21.15.2:36204) 2024-09-10T08:48:25.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.166+0000 7fdc0ea00640 1 -- 172.21.15.2:0/2234877530 learned_addr learned my addr 172.21.15.2:0/2234877530 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:25.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.166+0000 7fdc0f400640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fdc100b4a20 0x7fdc1006e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:25.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.167+0000 7fdc0ea00640 1 -- 172.21.15.2:0/2234877530 >> v2:172.21.15.155:3300/0 conn(0x7fdc100b4a20 msgr2=0x7fdc1006e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:48:25.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.167+0000 7fdc0ea00640 1 --2- 172.21.15.2:0/2234877530 >> v2:172.21.15.155:3300/0 conn(0x7fdc100b4a20 0x7fdc1006e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:25.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.167+0000 7fdc0ea00640 1 -- 172.21.15.2:0/2234877530 >> v1:172.21.15.155:6789/0 conn(0x7fdc100cf0f0 legacy=0x7fdc100b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:25.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.167+0000 7fdc0ea00640 1 -- 172.21.15.2:0/2234877530 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc100cf5c0 con 0x7fdc1015c240 2024-09-10T08:48:25.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.167+0000 7fdc0f400640 1 --2- 172.21.15.2:0/2234877530 >> v2:172.21.15.155:3300/0 conn(0x7fdc100b4a20 0x7fdc1006e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:48:25.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.168+0000 7fdc0ea00640 1 --2- 172.21.15.2:0/2234877530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc1015c240 0x7fdc100cebb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdc00009870 tx=0x7fdc0002a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10d25cd3024f20e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:25.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.168+0000 7fdc0e000640 1 -- 172.21.15.2:0/2234877530 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc00037070 con 0x7fdc1015c240 2024-09-10T08:48:25.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.168+0000 7fdc0e000640 1 -- 172.21.15.2:0/2234877530 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc00032440 con 0x7fdc1015c240 2024-09-10T08:48:25.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.168+0000 7fdc0e000640 1 -- 172.21.15.2:0/2234877530 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc00032810 con 0x7fdc1015c240 2024-09-10T08:48:25.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.168+0000 7fdc15a00640 1 -- 172.21.15.2:0/2234877530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc1015c240 msgr2=0x7fdc100cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:25.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.168+0000 7fdc15a00640 1 --2- 172.21.15.2:0/2234877530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc1015c240 0x7fdc100cebb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdc00009870 tx=0x7fdc0002a250 comp rx=0 tx=0).stop 2024-09-10T08:48:25.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.169+0000 7fdc15a00640 1 -- 172.21.15.2:0/2234877530 shutdown_connections 2024-09-10T08:48:25.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.169+0000 7fdc15a00640 1 --2- 172.21.15.2:0/2234877530 >> v2:172.21.15.155:3300/0 conn(0x7fdc100b4a20 0x7fdc1006e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:25.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.169+0000 7fdc15a00640 1 --2- 172.21.15.2:0/2234877530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc1015c240 0x7fdc100cebb0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:25.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.169+0000 7fdc15a00640 1 -- 172.21.15.2:0/2234877530 >> 172.21.15.2:0/2234877530 conn(0x7fdc100d02c0 msgr2=0x7fdc100d06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:25.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.169+0000 7fdc15a00640 1 -- 172.21.15.2:0/2234877530 shutdown_connections 2024-09-10T08:48:25.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.169+0000 7fdc15a00640 1 -- 172.21.15.2:0/2234877530 wait complete. 2024-09-10T08:48:25.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.170+0000 7fdc15a00640 1 Processor -- start 2024-09-10T08:48:25.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.170+0000 7fdc15a00640 1 -- start start 2024-09-10T08:48:25.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.171+0000 7fdc15a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc100b4a20 0x7fdc101e7d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:25.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.171+0000 7fdc15a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc100cf0f0 0x7fdc1014ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:25.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.171+0000 7fdc15a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc1015c240 0x7fdc101e6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:25.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.171+0000 7fdc15a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fdc100b50e0 con 0x7fdc100cf0f0 2024-09-10T08:48:25.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.171+0000 7fdc15a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fdc100cfb80 con 0x7fdc1015c240 2024-09-10T08:48:25.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.171+0000 7fdc15a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fdc100b5260 con 0x7fdc100b4a20 2024-09-10T08:48:25.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.172+0000 7fdc06000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc100cf0f0 0x7fdc1014ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:25.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.172+0000 7fdc06000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc100cf0f0 0x7fdc1014ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52270/0 (socket says 172.21.15.2:52270) 2024-09-10T08:48:25.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.172+0000 7fdc06000640 1 -- 172.21.15.2:0/3887872039 learned_addr learned my addr 172.21.15.2:0/3887872039 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:25.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.172+0000 7fdc0ea00640 1 --2- 172.21.15.2:0/3887872039 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc100b4a20 0x7fdc101e7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:25.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.172+0000 7fdc0f400640 1 --2- 172.21.15.2:0/3887872039 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc1015c240 0x7fdc101e6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:25.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.172+0000 7fdc06000640 1 -- 172.21.15.2:0/3887872039 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc100b4a20 msgr2=0x7fdc101e7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:25.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.172+0000 7fdc06000640 1 --2- 172.21.15.2:0/3887872039 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc100b4a20 0x7fdc101e7d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:25.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.172+0000 7fdc06000640 1 -- 172.21.15.2:0/3887872039 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc1015c240 msgr2=0x7fdc101e6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:25.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.172+0000 7fdc06000640 1 --2- 172.21.15.2:0/3887872039 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc1015c240 0x7fdc101e6f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:25.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.172+0000 7fdc06000640 1 -- 172.21.15.2:0/3887872039 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc10072d00 con 0x7fdc100cf0f0 2024-09-10T08:48:25.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.172+0000 7fdc06000640 1 --2- 172.21.15.2:0/3887872039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc100cf0f0 0x7fdc1014ec20 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fdbf800c370 tx=0x7fdbf800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:25.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.172+0000 7fdc07400640 1 -- 172.21.15.2:0/3887872039 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf80052d0 con 0x7fdc100cf0f0 2024-09-10T08:48:25.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.173+0000 7fdc07400640 1 -- 172.21.15.2:0/3887872039 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbf8005470 con 0x7fdc100cf0f0 2024-09-10T08:48:25.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.173+0000 7fdc07400640 1 -- 172.21.15.2:0/3887872039 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf8007260 con 0x7fdc100cf0f0 2024-09-10T08:48:25.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.173+0000 7fdc15a00640 1 -- 172.21.15.2:0/3887872039 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc10072fe0 con 0x7fdc100cf0f0 2024-09-10T08:48:25.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.173+0000 7fdc15a00640 1 -- 172.21.15.2:0/3887872039 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc100735a0 con 0x7fdc100cf0f0 2024-09-10T08:48:25.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.174+0000 7fdc15a00640 1 -- 172.21.15.2:0/3887872039 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc100737a0 con 0x7fdc100cf0f0 2024-09-10T08:48:25.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.175+0000 7fdc07400640 1 -- 172.21.15.2:0/3887872039 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 14) ==== 90498+0+0 (secure 0 0 0) 0x7fdbf8007400 con 0x7fdc100cf0f0 2024-09-10T08:48:25.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.175+0000 7fdc07400640 1 --2- 172.21.15.2:0/3887872039 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7fdbec06be30 0x7fdbec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:25.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.176+0000 7fdc07400640 1 -- 172.21.15.2:0/3887872039 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5980+0+0 (secure 0 0 0) 0x7fdbf808a4b0 con 0x7fdc100cf0f0 2024-09-10T08:48:25.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.176+0000 7fdc0ea00640 1 --2- 172.21.15.2:0/3887872039 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7fdbec06be30 0x7fdbec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:25.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.177+0000 7fdc0ea00640 1 --2- 172.21.15.2:0/3887872039 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7fdbec06be30 0x7fdbec06e2f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fdc00034000 tx=0x7fdc0002e000 comp rx=0 tx=0).ready entity=mgr.4862 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:25.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.180+0000 7fdc07400640 1 -- 172.21.15.2:0/3887872039 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdc100737a0 con 0x7fdc100cf0f0 2024-09-10T08:48:25.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.363+0000 7fdc15a00640 1 -- 172.21.15.2:0/3887872039 --> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fdc100b0650 con 0x7fdbec06be30 2024-09-10T08:48:25.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.364+0000 7fdc07400640 1 -- 172.21.15.2:0/3887872039 <== mgr.4862 v2:172.21.15.155:6832/2264044153 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fdc100b0650 con 0x7fdbec06be30 2024-09-10T08:48:25.364 INFO:teuthology.orchestra.run.smithi002.stderr:instructed osd(s) 0 to deep-scrub 2024-09-10T08:48:25.366 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.366+0000 7fdc15a00640 1 -- 172.21.15.2:0/3887872039 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7fdbec06be30 msgr2=0x7fdbec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:25.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.366+0000 7fdc15a00640 1 --2- 172.21.15.2:0/3887872039 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7fdbec06be30 0x7fdbec06e2f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fdc00034000 tx=0x7fdc0002e000 comp rx=0 tx=0).stop 2024-09-10T08:48:25.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.366+0000 7fdc15a00640 1 -- 172.21.15.2:0/3887872039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc100cf0f0 msgr2=0x7fdc1014ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:25.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.366+0000 7fdc15a00640 1 --2- 172.21.15.2:0/3887872039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc100cf0f0 0x7fdc1014ec20 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fdbf800c370 tx=0x7fdbf800c830 comp rx=0 tx=0).stop 2024-09-10T08:48:25.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.366+0000 7fdc15a00640 1 -- 172.21.15.2:0/3887872039 shutdown_connections 2024-09-10T08:48:25.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.366+0000 7fdc15a00640 1 --2- 172.21.15.2:0/3887872039 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7fdbec06be30 0x7fdbec06e2f0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:25.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.366+0000 7fdc15a00640 1 --2- 172.21.15.2:0/3887872039 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc1015c240 0x7fdc101e6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:25.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.366+0000 7fdc15a00640 1 --2- 172.21.15.2:0/3887872039 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdc100cf0f0 0x7fdc1014ec20 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:25.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.366+0000 7fdc15a00640 1 --2- 172.21.15.2:0/3887872039 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc100b4a20 0x7fdc101e7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:25.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.366+0000 7fdc15a00640 1 -- 172.21.15.2:0/3887872039 >> 172.21.15.2:0/3887872039 conn(0x7fdc100d02c0 msgr2=0x7fdc1015cb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:25.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.366+0000 7fdc15a00640 1 -- 172.21.15.2:0/3887872039 shutdown_connections 2024-09-10T08:48:25.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.366+0000 7fdc15a00640 1 -- 172.21.15.2:0/3887872039 wait complete. 2024-09-10T08:48:25.382 INFO:tasks.ceph:Scrubbing osd.1 2024-09-10T08:48:25.382 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-10T08:48:25.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.543+0000 7f3c27200640 1 Processor -- start 2024-09-10T08:48:25.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.544+0000 7f3c27200640 1 -- start start 2024-09-10T08:48:25.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.545+0000 7f3c27200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3c280b3dd0 0x7f3c280b4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:25.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.545+0000 7f3c27200640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c280ccfb0 con 0x7f3c280cfe20 2024-09-10T08:48:25.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.545+0000 7f3c27200640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c2806ce60 con 0x7f3c2815e720 2024-09-10T08:48:25.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.545+0000 7f3c27200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3c280d0290 con 0x7f3c280b3dd0 2024-09-10T08:48:25.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.545+0000 7f3c25400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f3c280cfe20 0x7f3c280cc8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:44576/0 (socket says 172.21.15.2:44576) 2024-09-10T08:48:25.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.545+0000 7f3c25400640 1 -- 172.21.15.2:0/3114411964 learned_addr learned my addr 172.21.15.2:0/3114411964 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:48:25.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.545+0000 7f3c26800640 1 --2- 172.21.15.2:0/3114411964 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3c280b3dd0 0x7f3c280b4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:25.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.546+0000 7f3c24a00640 1 -- 172.21.15.2:0/3114411964 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2414671258 0 0) 0x7f3c280ccfb0 con 0x7f3c280cfe20 2024-09-10T08:48:25.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.546+0000 7f3c24a00640 1 -- 172.21.15.2:0/3114411964 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c0c003520 con 0x7f3c280cfe20 2024-09-10T08:48:25.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.546+0000 7f3c24a00640 1 -- 172.21.15.2:0/3114411964 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1288089154 0 0) 0x7f3c0c003520 con 0x7f3c280cfe20 2024-09-10T08:48:25.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.546+0000 7f3c24a00640 1 -- 172.21.15.2:0/3114411964 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3c280b3dd0 msgr2=0x7f3c280b4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:48:25.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.546+0000 7f3c24a00640 1 --2- 172.21.15.2:0/3114411964 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3c280b3dd0 0x7f3c280b4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:25.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.546+0000 7f3c24a00640 1 -- 172.21.15.2:0/3114411964 >> v1:172.21.15.155:6789/0 conn(0x7f3c2815e720 legacy=0x7f3c280d2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:25.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.546+0000 7f3c24a00640 1 -- 172.21.15.2:0/3114411964 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c280d04b0 con 0x7f3c280cfe20 2024-09-10T08:48:25.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.546+0000 7f3c24a00640 1 -- 172.21.15.2:0/3114411964 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2345211856 0 0) 0x7f3c14001670 con 0x7f3c280cfe20 2024-09-10T08:48:25.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.546+0000 7f3c24a00640 1 -- 172.21.15.2:0/3114411964 >> v1:172.21.15.2:6789/0 conn(0x7f3c280cfe20 legacy=0x7f3c280cc8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:25.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.546+0000 7f3c24a00640 1 --2- 172.21.15.2:0/3114411964 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c0c0039e0 0x7f3c0c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:25.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.546+0000 7f3c24a00640 1 --2- 172.21.15.2:0/3114411964 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3c280b3dd0 0x7f3c0c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:25.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.546+0000 7f3c24a00640 1 --2- 172.21.15.2:0/3114411964 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3c0c004d40 0x7f3c0c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:25.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.546+0000 7f3c24a00640 1 -- 172.21.15.2:0/3114411964 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3c280d0290 con 0x7f3c0c0039e0 2024-09-10T08:48:25.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.546+0000 7f3c24a00640 1 -- 172.21.15.2:0/3114411964 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3c0c00b9c0 con 0x7f3c0c004d40 2024-09-10T08:48:25.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.546+0000 7f3c24a00640 1 -- 172.21.15.2:0/3114411964 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3c0c00bbc0 con 0x7f3c280b3dd0 2024-09-10T08:48:25.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.546+0000 7f3c25e00640 1 --2- 172.21.15.2:0/3114411964 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c0c0039e0 0x7f3c0c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:25.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.546+0000 7f3c25400640 1 --2- 172.21.15.2:0/3114411964 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3c280b3dd0 0x7f3c0c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:25.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.547+0000 7f3c26800640 1 --2- 172.21.15.2:0/3114411964 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3c0c004d40 0x7f3c0c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:25.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.547+0000 7f3c25e00640 1 -- 172.21.15.2:0/3114411964 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3c280b3dd0 msgr2=0x7f3c0c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:48:25.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.547+0000 7f3c25e00640 1 --2- 172.21.15.2:0/3114411964 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3c280b3dd0 0x7f3c0c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:25.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.547+0000 7f3c25e00640 1 -- 172.21.15.2:0/3114411964 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3c0c004d40 msgr2=0x7f3c0c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:48:25.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.547+0000 7f3c25e00640 1 --2- 172.21.15.2:0/3114411964 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3c0c004d40 0x7f3c0c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:25.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.547+0000 7f3c25e00640 1 -- 172.21.15.2:0/3114411964 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c0c003520 con 0x7f3c0c0039e0 2024-09-10T08:48:25.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.548+0000 7f3c25e00640 1 --2- 172.21.15.2:0/3114411964 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c0c0039e0 0x7f3c0c003dc0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f3c18001910 tx=0x7f3c0c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ca5fb4f17966da6 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:25.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.548+0000 7f3c24a00640 1 -- 172.21.15.2:0/3114411964 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c18037070 con 0x7f3c0c0039e0 2024-09-10T08:48:25.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.548+0000 7f3c24a00640 1 -- 172.21.15.2:0/3114411964 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c1802aba0 con 0x7f3c0c0039e0 2024-09-10T08:48:25.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.548+0000 7f3c24a00640 1 -- 172.21.15.2:0/3114411964 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c180014e0 con 0x7f3c0c0039e0 2024-09-10T08:48:25.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.548+0000 7f3c27200640 1 -- 172.21.15.2:0/3114411964 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c0c0039e0 msgr2=0x7f3c0c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:25.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.548+0000 7f3c27200640 1 --2- 172.21.15.2:0/3114411964 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c0c0039e0 0x7f3c0c003dc0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f3c18001910 tx=0x7f3c0c005830 comp rx=0 tx=0).stop 2024-09-10T08:48:25.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.548+0000 7f3c26800640 1 -- 172.21.15.2:0/3114411964 reap_dead start 2024-09-10T08:48:25.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.549+0000 7f3c27200640 1 -- 172.21.15.2:0/3114411964 shutdown_connections 2024-09-10T08:48:25.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.549+0000 7f3c27200640 1 -- 172.21.15.2:0/3114411964 >> 172.21.15.2:0/3114411964 conn(0x7f3c28067950 msgr2=0x7f3c28067d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:25.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.549+0000 7f3c27200640 1 -- 172.21.15.2:0/3114411964 shutdown_connections 2024-09-10T08:48:25.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.549+0000 7f3c27200640 1 -- 172.21.15.2:0/3114411964 wait complete. 2024-09-10T08:48:25.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.550+0000 7f3c27200640 1 Processor -- start 2024-09-10T08:48:25.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.550+0000 7f3c27200640 1 -- start start 2024-09-10T08:48:25.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.551+0000 7f3c27200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3c0c0039e0 0x7f3c28159610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:25.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.551+0000 7f3c27200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c280c8ae0 0x7f3c280b7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:25.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.551+0000 7f3c27200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3c280b7c90 0x7f3c280c9320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:25.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.551+0000 7f3c27200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3c2806d120 con 0x7f3c280c8ae0 2024-09-10T08:48:25.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.551+0000 7f3c27200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3c280d0a70 con 0x7f3c280b7c90 2024-09-10T08:48:25.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.551+0000 7f3c27200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3c280b4260 con 0x7f3c0c0039e0 2024-09-10T08:48:25.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.552+0000 7f3c25400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c280c8ae0 0x7f3c280b7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:25.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.552+0000 7f3c25400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c280c8ae0 0x7f3c280b7750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52290/0 (socket says 172.21.15.2:52290) 2024-09-10T08:48:25.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.552+0000 7f3c25400640 1 -- 172.21.15.2:0/4284392186 learned_addr learned my addr 172.21.15.2:0/4284392186 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:25.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.552+0000 7f3c26800640 1 --2- 172.21.15.2:0/4284392186 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3c280b7c90 0x7f3c280c9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:25.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.552+0000 7f3c25e00640 1 --2- 172.21.15.2:0/4284392186 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3c0c0039e0 0x7f3c28159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:25.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.552+0000 7f3c25400640 1 -- 172.21.15.2:0/4284392186 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3c0c0039e0 msgr2=0x7f3c28159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:25.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.552+0000 7f3c25400640 1 --2- 172.21.15.2:0/4284392186 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3c0c0039e0 0x7f3c28159610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:25.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.552+0000 7f3c25400640 1 -- 172.21.15.2:0/4284392186 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3c280b7c90 msgr2=0x7f3c280c9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:25.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.552+0000 7f3c25400640 1 --2- 172.21.15.2:0/4284392186 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3c280b7c90 0x7f3c280c9320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:25.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.552+0000 7f3c25400640 1 -- 172.21.15.2:0/4284392186 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c280c9030 con 0x7f3c280c8ae0 2024-09-10T08:48:25.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.552+0000 7f3c26800640 1 --2- 172.21.15.2:0/4284392186 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3c280b7c90 0x7f3c280c9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:48:25.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.552+0000 7f3c25e00640 1 --2- 172.21.15.2:0/4284392186 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3c0c0039e0 0x7f3c28159610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:48:25.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.552+0000 7f3c25400640 1 --2- 172.21.15.2:0/4284392186 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c280c8ae0 0x7f3c280b7750 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f3c140072c0 tx=0x7f3c14007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:25.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.553+0000 7f3c1e000640 1 -- 172.21.15.2:0/4284392186 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c1401a070 con 0x7f3c280c8ae0 2024-09-10T08:48:25.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.553+0000 7f3c1e000640 1 -- 172.21.15.2:0/4284392186 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c1400f960 con 0x7f3c280c8ae0 2024-09-10T08:48:25.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.553+0000 7f3c1e000640 1 -- 172.21.15.2:0/4284392186 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c1400fd50 con 0x7f3c280c8ae0 2024-09-10T08:48:25.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.553+0000 7f3c27200640 1 -- 172.21.15.2:0/4284392186 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c280b5b80 con 0x7f3c280c8ae0 2024-09-10T08:48:25.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.553+0000 7f3c27200640 1 -- 172.21.15.2:0/4284392186 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c280b6140 con 0x7f3c280c8ae0 2024-09-10T08:48:25.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.554+0000 7f3c27200640 1 -- 172.21.15.2:0/4284392186 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3c280caac0 con 0x7f3c280c8ae0 2024-09-10T08:48:25.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.555+0000 7f3c1e000640 1 -- 172.21.15.2:0/4284392186 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 14) ==== 90498+0+0 (secure 0 0 0) 0x7f3c1401d360 con 0x7f3c280c8ae0 2024-09-10T08:48:25.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.556+0000 7f3c1e000640 1 --2- 172.21.15.2:0/4284392186 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f3c0806be30 0x7f3c0806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:25.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.556+0000 7f3c1e000640 1 -- 172.21.15.2:0/4284392186 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5980+0+0 (secure 0 0 0) 0x7f3c1408a8e0 con 0x7f3c280c8ae0 2024-09-10T08:48:25.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.556+0000 7f3c1e000640 1 --2- 172.21.15.2:0/4284392186 >> [v2:172.21.15.2:6808/1619566025,v1:172.21.15.2:6809/1619566025] conn(0x7f3c08072870 0x7f3c08074cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:25.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.556+0000 7f3c1e000640 1 -- 172.21.15.2:0/4284392186 --> [v2:172.21.15.2:6808/1619566025,v1:172.21.15.2:6809/1619566025] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3c14012e50 con 0x7f3c08072870 2024-09-10T08:48:25.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.556+0000 7f3c1e000640 1 -- 172.21.15.2:0/4284392186 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f3c1408f2a0 con 0x7f3c280c8ae0 2024-09-10T08:48:25.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.556+0000 7f3c25e00640 1 --2- 172.21.15.2:0/4284392186 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f3c0806be30 0x7f3c0806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:25.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.556+0000 7f3c26800640 1 --2- 172.21.15.2:0/4284392186 >> [v2:172.21.15.2:6808/1619566025,v1:172.21.15.2:6809/1619566025] conn(0x7f3c08072870 0x7f3c08074cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:25.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.557+0000 7f3c26800640 1 --2- 172.21.15.2:0/4284392186 >> [v2:172.21.15.2:6808/1619566025,v1:172.21.15.2:6809/1619566025] conn(0x7f3c08072870 0x7f3c08074cb0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:25.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.557+0000 7f3c25e00640 1 --2- 172.21.15.2:0/4284392186 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f3c0806be30 0x7f3c0806e2f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3c18034000 tx=0x7f3c1802e000 comp rx=0 tx=0).ready entity=mgr.4862 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:25.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.558+0000 7f3c1e000640 1 -- 172.21.15.2:0/4284392186 <== osd.1 v2:172.21.15.2:6808/1619566025 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3c14012e50 con 0x7f3c08072870 2024-09-10T08:48:25.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.571+0000 7f3c27200640 1 -- 172.21.15.2:0/4284392186 --> [v2:172.21.15.2:6808/1619566025,v1:172.21.15.2:6809/1619566025] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f3c28068c80 con 0x7f3c08072870 2024-09-10T08:48:25.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.571+0000 7f3c1e000640 1 -- 172.21.15.2:0/4284392186 <== osd.1 v2:172.21.15.2:6808/1619566025 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f3c28068c80 con 0x7f3c08072870 2024-09-10T08:48:25.572 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T08:48:25.572 INFO:teuthology.orchestra.run.smithi002.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T08:48:25.572 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T08:48:25.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.572+0000 7f3c27200640 1 -- 172.21.15.2:0/4284392186 >> [v2:172.21.15.2:6808/1619566025,v1:172.21.15.2:6809/1619566025] conn(0x7f3c08072870 msgr2=0x7f3c08074cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:25.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.572+0000 7f3c27200640 1 --2- 172.21.15.2:0/4284392186 >> [v2:172.21.15.2:6808/1619566025,v1:172.21.15.2:6809/1619566025] conn(0x7f3c08072870 0x7f3c08074cb0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:25.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.572+0000 7f3c27200640 1 -- 172.21.15.2:0/4284392186 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f3c0806be30 msgr2=0x7f3c0806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:25.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.572+0000 7f3c27200640 1 --2- 172.21.15.2:0/4284392186 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f3c0806be30 0x7f3c0806e2f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3c18034000 tx=0x7f3c1802e000 comp rx=0 tx=0).stop 2024-09-10T08:48:25.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.572+0000 7f3c27200640 1 -- 172.21.15.2:0/4284392186 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c280c8ae0 msgr2=0x7f3c280b7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:25.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.572+0000 7f3c27200640 1 --2- 172.21.15.2:0/4284392186 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3c280c8ae0 0x7f3c280b7750 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f3c140072c0 tx=0x7f3c14007780 comp rx=0 tx=0).stop 2024-09-10T08:48:25.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.572+0000 7f3c26800640 1 -- 172.21.15.2:0/4284392186 reap_dead start 2024-09-10T08:48:25.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.572+0000 7f3c27200640 1 -- 172.21.15.2:0/4284392186 shutdown_connections 2024-09-10T08:48:25.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.572+0000 7f3c27200640 1 -- 172.21.15.2:0/4284392186 >> 172.21.15.2:0/4284392186 conn(0x7f3c28067950 msgr2=0x7f3c280ce270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:25.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.572+0000 7f3c27200640 1 -- 172.21.15.2:0/4284392186 shutdown_connections 2024-09-10T08:48:25.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.572+0000 7f3c27200640 1 -- 172.21.15.2:0/4284392186 wait complete. 2024-09-10T08:48:25.587 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-10T08:48:25.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.745+0000 7f2607a00640 1 Processor -- start 2024-09-10T08:48:25.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.745+0000 7f2607a00640 1 -- start start 2024-09-10T08:48:25.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.746+0000 7f2607a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f260015c460 0x7f260015d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:25.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.746+0000 7f2607a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f260006df50 0x7f26000cec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:25.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.746+0000 7f2607a00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f26000cf140 0x7f26000ccc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:25.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.746+0000 7f2607a00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f2600161030 con 0x7f260015c460 2024-09-10T08:48:25.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.746+0000 7f2607a00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f26000cf5f0 con 0x7f26000cf140 2024-09-10T08:48:25.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.746+0000 7f2607a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f260015da70 con 0x7f260006df50 2024-09-10T08:48:25.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.747+0000 7f2605000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f260015c460 0x7f260015d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:25.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.747+0000 7f2605000640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f260015c460 0x7f260015d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52292/0 (socket says 172.21.15.2:52292) 2024-09-10T08:48:25.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.747+0000 7f2605000640 1 -- 172.21.15.2:0/2873559069 learned_addr learned my addr 172.21.15.2:0/2873559069 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:25.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.747+0000 7f2605a00640 1 --2- 172.21.15.2:0/2873559069 >> v2:172.21.15.155:3300/0 conn(0x7f26000cf140 0x7f26000ccc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:25.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.747+0000 7f25ffe00640 1 --2- 172.21.15.2:0/2873559069 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f260006df50 0x7f26000cec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:25.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.747+0000 7f2605000640 1 -- 172.21.15.2:0/2873559069 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f260006df50 msgr2=0x7f26000cec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:48:25.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.747+0000 7f2605000640 1 --2- 172.21.15.2:0/2873559069 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f260006df50 0x7f26000cec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:25.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.747+0000 7f2605000640 1 -- 172.21.15.2:0/2873559069 >> v2:172.21.15.155:3300/0 conn(0x7f26000cf140 msgr2=0x7f26000ccc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:48:25.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.747+0000 7f2605000640 1 --2- 172.21.15.2:0/2873559069 >> v2:172.21.15.155:3300/0 conn(0x7f26000cf140 0x7f26000ccc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:25.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.747+0000 7f2605000640 1 -- 172.21.15.2:0/2873559069 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26001603b0 con 0x7f260015c460 2024-09-10T08:48:25.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.748+0000 7f2605000640 1 --2- 172.21.15.2:0/2873559069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f260015c460 0x7f260015d530 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f260006dc10 tx=0x7f25f402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d960451799326ec1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:25.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.748+0000 7f25ff400640 1 -- 172.21.15.2:0/2873559069 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f4037070 con 0x7f260015c460 2024-09-10T08:48:25.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.749+0000 7f25ff400640 1 -- 172.21.15.2:0/2873559069 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25f4032440 con 0x7f260015c460 2024-09-10T08:48:25.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.749+0000 7f25ff400640 1 -- 172.21.15.2:0/2873559069 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f4032810 con 0x7f260015c460 2024-09-10T08:48:25.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.749+0000 7f2607a00640 1 -- 172.21.15.2:0/2873559069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f260015c460 msgr2=0x7f260015d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:25.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.749+0000 7f2607a00640 1 --2- 172.21.15.2:0/2873559069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f260015c460 0x7f260015d530 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f260006dc10 tx=0x7f25f402a210 comp rx=0 tx=0).stop 2024-09-10T08:48:25.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.749+0000 7f2607a00640 1 -- 172.21.15.2:0/2873559069 shutdown_connections 2024-09-10T08:48:25.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.749+0000 7f2607a00640 1 --2- 172.21.15.2:0/2873559069 >> v2:172.21.15.155:3300/0 conn(0x7f26000cf140 0x7f26000ccc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:25.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.749+0000 7f2607a00640 1 --2- 172.21.15.2:0/2873559069 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f260006df50 0x7f26000cec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:25.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.749+0000 7f2607a00640 1 --2- 172.21.15.2:0/2873559069 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f260015c460 0x7f260015d530 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:25.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.749+0000 7f2607a00640 1 -- 172.21.15.2:0/2873559069 >> 172.21.15.2:0/2873559069 conn(0x7f26000d02c0 msgr2=0x7f26000d06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:25.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.749+0000 7f2607a00640 1 -- 172.21.15.2:0/2873559069 shutdown_connections 2024-09-10T08:48:25.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.749+0000 7f2607a00640 1 -- 172.21.15.2:0/2873559069 wait complete. 2024-09-10T08:48:25.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.751+0000 7f2607a00640 1 Processor -- start 2024-09-10T08:48:25.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.751+0000 7f2607a00640 1 -- start start 2024-09-10T08:48:25.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.752+0000 7f2607a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f260006df50 0x7f26000cb680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:25.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.752+0000 7f2607a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26000cf140 0x7f2600152ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:25.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.752+0000 7f2607a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f260015c460 0x7f260006ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:25.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.752+0000 7f2607a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2600160c50 con 0x7f260006df50 2024-09-10T08:48:25.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.752+0000 7f2607a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2600160970 con 0x7f260015c460 2024-09-10T08:48:25.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.752+0000 7f2607a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2600160080 con 0x7f26000cf140 2024-09-10T08:48:25.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.752+0000 7f2605000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f260006df50 0x7f26000cb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:25.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.752+0000 7f2605000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f260006df50 0x7f26000cb680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52300/0 (socket says 172.21.15.2:52300) 2024-09-10T08:48:25.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.752+0000 7f2605000640 1 -- 172.21.15.2:0/3435394467 learned_addr learned my addr 172.21.15.2:0/3435394467 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:25.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.752+0000 7f25ffe00640 1 --2- 172.21.15.2:0/3435394467 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26000cf140 0x7f2600152ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:25.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.752+0000 7f2605a00640 1 --2- 172.21.15.2:0/3435394467 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f260015c460 0x7f260006ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:25.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.752+0000 7f2605000640 1 -- 172.21.15.2:0/3435394467 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26000cf140 msgr2=0x7f2600152ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:25.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.752+0000 7f2605000640 1 --2- 172.21.15.2:0/3435394467 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26000cf140 0x7f2600152ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:25.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.752+0000 7f2605000640 1 -- 172.21.15.2:0/3435394467 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f260015c460 msgr2=0x7f260006ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:25.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.752+0000 7f2605000640 1 --2- 172.21.15.2:0/3435394467 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f260015c460 0x7f260006ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:25.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.752+0000 7f2605000640 1 -- 172.21.15.2:0/3435394467 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2600153530 con 0x7f260006df50 2024-09-10T08:48:25.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.753+0000 7f2605000640 1 --2- 172.21.15.2:0/3435394467 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f260006df50 0x7f26000cb680 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f25f4000c00 tx=0x7f25f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:25.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.753+0000 7f25fcc00640 1 -- 172.21.15.2:0/3435394467 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f4037040 con 0x7f260006df50 2024-09-10T08:48:25.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.753+0000 7f25fcc00640 1 -- 172.21.15.2:0/3435394467 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25f4042070 con 0x7f260006df50 2024-09-10T08:48:25.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.753+0000 7f25fcc00640 1 -- 172.21.15.2:0/3435394467 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f4030880 con 0x7f260006df50 2024-09-10T08:48:25.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.753+0000 7f2607a00640 1 -- 172.21.15.2:0/3435394467 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26000ca620 con 0x7f260006df50 2024-09-10T08:48:25.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.753+0000 7f2607a00640 1 -- 172.21.15.2:0/3435394467 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26000caba0 con 0x7f260006df50 2024-09-10T08:48:25.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.754+0000 7f2607a00640 1 -- 172.21.15.2:0/3435394467 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f260015c840 con 0x7f260006df50 2024-09-10T08:48:25.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.755+0000 7f25fcc00640 1 -- 172.21.15.2:0/3435394467 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 14) ==== 90498+0+0 (secure 0 0 0) 0x7f25f4030a20 con 0x7f260006df50 2024-09-10T08:48:25.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.756+0000 7f25fcc00640 1 --2- 172.21.15.2:0/3435394467 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f25e006be30 0x7f25e006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:25.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.756+0000 7f25fcc00640 1 -- 172.21.15.2:0/3435394467 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5980+0+0 (secure 0 0 0) 0x7f25f40ab850 con 0x7f260006df50 2024-09-10T08:48:25.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.756+0000 7f25ffe00640 1 --2- 172.21.15.2:0/3435394467 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f25e006be30 0x7f25e006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:25.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.757+0000 7f25ffe00640 1 --2- 172.21.15.2:0/3435394467 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f25e006be30 0x7f25e006e2f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f25ec006fd0 tx=0x7f25ec008040 comp rx=0 tx=0).ready entity=mgr.4862 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:25.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.760+0000 7f25fcc00640 1 -- 172.21.15.2:0/3435394467 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f25f407a050 con 0x7f260006df50 2024-09-10T08:48:25.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.945+0000 7f2607a00640 1 -- 172.21.15.2:0/3435394467 --> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f26000cb4d0 con 0x7f25e006be30 2024-09-10T08:48:25.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.946+0000 7f25fcc00640 1 -- 172.21.15.2:0/3435394467 <== mgr.4862 v2:172.21.15.155:6832/2264044153 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f26000cb4d0 con 0x7f25e006be30 2024-09-10T08:48:25.946 INFO:teuthology.orchestra.run.smithi002.stderr:instructed osd(s) 1 to deep-scrub 2024-09-10T08:48:25.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.948+0000 7f2607a00640 1 -- 172.21.15.2:0/3435394467 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f25e006be30 msgr2=0x7f25e006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:25.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.948+0000 7f2607a00640 1 --2- 172.21.15.2:0/3435394467 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f25e006be30 0x7f25e006e2f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f25ec006fd0 tx=0x7f25ec008040 comp rx=0 tx=0).stop 2024-09-10T08:48:25.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.948+0000 7f2607a00640 1 -- 172.21.15.2:0/3435394467 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f260006df50 msgr2=0x7f26000cb680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:25.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.948+0000 7f2607a00640 1 --2- 172.21.15.2:0/3435394467 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f260006df50 0x7f26000cb680 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f25f4000c00 tx=0x7f25f40046c0 comp rx=0 tx=0).stop 2024-09-10T08:48:25.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.948+0000 7f2607a00640 1 -- 172.21.15.2:0/3435394467 shutdown_connections 2024-09-10T08:48:25.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.948+0000 7f2607a00640 1 --2- 172.21.15.2:0/3435394467 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f25e006be30 0x7f25e006e2f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:25.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.948+0000 7f2607a00640 1 --2- 172.21.15.2:0/3435394467 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f260015c460 0x7f260006ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:25.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.948+0000 7f2607a00640 1 --2- 172.21.15.2:0/3435394467 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f26000cf140 0x7f2600152ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:25.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.948+0000 7f2607a00640 1 --2- 172.21.15.2:0/3435394467 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f260006df50 0x7f26000cb680 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:25.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.948+0000 7f2607a00640 1 -- 172.21.15.2:0/3435394467 >> 172.21.15.2:0/3435394467 conn(0x7f26000d02c0 msgr2=0x7f260015f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:25.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.948+0000 7f2607a00640 1 -- 172.21.15.2:0/3435394467 shutdown_connections 2024-09-10T08:48:25.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:25.948+0000 7f2607a00640 1 -- 172.21.15.2:0/3435394467 wait complete. 2024-09-10T08:48:25.964 INFO:tasks.ceph:Scrubbing osd.2 2024-09-10T08:48:25.965 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-10T08:48:26.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.125+0000 7fe03ca00640 1 Processor -- start 2024-09-10T08:48:26.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.125+0000 7fe03ca00640 1 -- start start 2024-09-10T08:48:26.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.126+0000 7fe03ca00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe03815e7a0 0x7fe0380cedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:26.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.126+0000 7fe03ca00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe0380d4b00 0x7fe0380cf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:26.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.126+0000 7fe03ca00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0380d0330 con 0x7fe0380d0d90 2024-09-10T08:48:26.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.126+0000 7fe03ca00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fe03806cd30 con 0x7fe03815e7a0 2024-09-10T08:48:26.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.126+0000 7fe03ca00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7fe0380d0610 con 0x7fe0380d4b00 2024-09-10T08:48:26.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.126+0000 7fe036a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe03815e7a0 0x7fe0380cedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:26.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.126+0000 7fe037400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fe0380d0d90 0x7fe0380d1170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41756/0 (socket says 172.21.15.2:41756) 2024-09-10T08:48:26.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.126+0000 7fe037400640 1 -- 172.21.15.2:0/3082235333 learned_addr learned my addr 172.21.15.2:0/3082235333 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:48:26.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.127+0000 7fe037e00640 1 --2- 172.21.15.2:0/3082235333 >> v2:172.21.15.155:3300/0 conn(0x7fe0380d4b00 0x7fe0380cf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:26.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.127+0000 7fe036a00640 1 -- 172.21.15.2:0/3082235333 >> v2:172.21.15.155:3300/0 conn(0x7fe0380d4b00 msgr2=0x7fe0380cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:48:26.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.127+0000 7fe036a00640 1 --2- 172.21.15.2:0/3082235333 >> v2:172.21.15.155:3300/0 conn(0x7fe0380d4b00 0x7fe0380cf2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:26.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.127+0000 7fe036a00640 1 -- 172.21.15.2:0/3082235333 >> v1:172.21.15.2:6789/0 conn(0x7fe0380d0d90 legacy=0x7fe0380d1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:26.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.127+0000 7fe036a00640 1 -- 172.21.15.2:0/3082235333 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0380d08f0 con 0x7fe03815e7a0 2024-09-10T08:48:26.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.128+0000 7fe036a00640 1 --2- 172.21.15.2:0/3082235333 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe03815e7a0 0x7fe0380cedb0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe0380ce960 tx=0x7fe02402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfef540ab333625f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:26.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.128+0000 7fe036000640 1 -- 172.21.15.2:0/3082235333 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe024037070 con 0x7fe03815e7a0 2024-09-10T08:48:26.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.128+0000 7fe036000640 1 -- 172.21.15.2:0/3082235333 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe024032440 con 0x7fe03815e7a0 2024-09-10T08:48:26.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.128+0000 7fe036000640 1 -- 172.21.15.2:0/3082235333 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe024032810 con 0x7fe03815e7a0 2024-09-10T08:48:26.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.129+0000 7fe03ca00640 1 -- 172.21.15.2:0/3082235333 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe03815e7a0 msgr2=0x7fe0380cedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:26.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.129+0000 7fe03ca00640 1 --2- 172.21.15.2:0/3082235333 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe03815e7a0 0x7fe0380cedb0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe0380ce960 tx=0x7fe02402a1a0 comp rx=0 tx=0).stop 2024-09-10T08:48:26.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.129+0000 7fe03ca00640 1 -- 172.21.15.2:0/3082235333 shutdown_connections 2024-09-10T08:48:26.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.129+0000 7fe03ca00640 1 --2- 172.21.15.2:0/3082235333 >> v2:172.21.15.155:3300/0 conn(0x7fe0380d4b00 0x7fe0380cf2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:26.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.129+0000 7fe03ca00640 1 --2- 172.21.15.2:0/3082235333 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe03815e7a0 0x7fe0380cedb0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:26.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.129+0000 7fe03ca00640 1 -- 172.21.15.2:0/3082235333 >> 172.21.15.2:0/3082235333 conn(0x7fe03809d700 msgr2=0x7fe0380d4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:26.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.129+0000 7fe03ca00640 1 -- 172.21.15.2:0/3082235333 shutdown_connections 2024-09-10T08:48:26.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.129+0000 7fe03ca00640 1 -- 172.21.15.2:0/3082235333 wait complete. 2024-09-10T08:48:26.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.131+0000 7fe03ca00640 1 Processor -- start 2024-09-10T08:48:26.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.131+0000 7fe03ca00640 1 -- start start 2024-09-10T08:48:26.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.132+0000 7fe03ca00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0380d0d90 0x7fe0380b8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:26.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.132+0000 7fe03ca00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0380d4b00 0x7fe0380c7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:26.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.132+0000 7fe03ca00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe03815e7a0 0x7fe0380c8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:26.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.132+0000 7fe03ca00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fe03806e630 con 0x7fe03815e7a0 2024-09-10T08:48:26.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.132+0000 7fe03ca00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe03806e4b0 con 0x7fe0380d0d90 2024-09-10T08:48:26.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.132+0000 7fe03ca00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fe03806e7b0 con 0x7fe0380d4b00 2024-09-10T08:48:26.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.132+0000 7fe037e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe03815e7a0 0x7fe0380c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:26.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.132+0000 7fe037e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe03815e7a0 0x7fe0380c8290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46442/0 (socket says 172.21.15.2:46442) 2024-09-10T08:48:26.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.132+0000 7fe037e00640 1 -- 172.21.15.2:0/1204141306 learned_addr learned my addr 172.21.15.2:0/1204141306 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:26.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.132+0000 7fe037400640 1 --2- 172.21.15.2:0/1204141306 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0380d0d90 0x7fe0380b8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:26.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.132+0000 7fe036a00640 1 --2- 172.21.15.2:0/1204141306 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0380d4b00 0x7fe0380c7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:26.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.132+0000 7fe037e00640 1 -- 172.21.15.2:0/1204141306 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0380d4b00 msgr2=0x7fe0380c7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:26.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.132+0000 7fe037e00640 1 --2- 172.21.15.2:0/1204141306 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0380d4b00 0x7fe0380c7d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:26.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.132+0000 7fe037e00640 1 -- 172.21.15.2:0/1204141306 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0380d0d90 msgr2=0x7fe0380b8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:26.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.132+0000 7fe037e00640 1 --2- 172.21.15.2:0/1204141306 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0380d0d90 0x7fe0380b8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:26.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.132+0000 7fe037e00640 1 -- 172.21.15.2:0/1204141306 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0380b8740 con 0x7fe03815e7a0 2024-09-10T08:48:26.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.132+0000 7fe036a00640 1 --2- 172.21.15.2:0/1204141306 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe0380d4b00 0x7fe0380c7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:48:26.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.133+0000 7fe037e00640 1 --2- 172.21.15.2:0/1204141306 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe03815e7a0 0x7fe0380c8290 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe030007e70 tx=0x7fe03000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:26.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.133+0000 7fe02f400640 1 -- 172.21.15.2:0/1204141306 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe030014620 con 0x7fe03815e7a0 2024-09-10T08:48:26.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.133+0000 7fe02f400640 1 -- 172.21.15.2:0/1204141306 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe030019070 con 0x7fe03815e7a0 2024-09-10T08:48:26.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.133+0000 7fe02f400640 1 -- 172.21.15.2:0/1204141306 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe030014a20 con 0x7fe03815e7a0 2024-09-10T08:48:26.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.133+0000 7fe03ca00640 1 -- 172.21.15.2:0/1204141306 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0380b89e0 con 0x7fe03815e7a0 2024-09-10T08:48:26.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.133+0000 7fe03ca00640 1 -- 172.21.15.2:0/1204141306 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0380b8fa0 con 0x7fe03815e7a0 2024-09-10T08:48:26.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.134+0000 7fe03ca00640 1 -- 172.21.15.2:0/1204141306 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe0380b3940 con 0x7fe03815e7a0 2024-09-10T08:48:26.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.135+0000 7fe02f400640 1 -- 172.21.15.2:0/1204141306 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 14) ==== 90498+0+0 (secure 0 0 0) 0x7fe030014bc0 con 0x7fe03815e7a0 2024-09-10T08:48:26.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.136+0000 7fe02f400640 1 --2- 172.21.15.2:0/1204141306 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7fe01806be30 0x7fe01806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:26.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.136+0000 7fe02f400640 1 -- 172.21.15.2:0/1204141306 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5980+0+0 (secure 0 0 0) 0x7fe03008b8b0 con 0x7fe03815e7a0 2024-09-10T08:48:26.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.136+0000 7fe02f400640 1 --2- 172.21.15.2:0/1204141306 >> [v2:172.21.15.2:6800/3992427579,v1:172.21.15.2:6801/3992427579] conn(0x7fe018072870 0x7fe018074cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:26.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.136+0000 7fe02f400640 1 -- 172.21.15.2:0/1204141306 --> [v2:172.21.15.2:6800/3992427579,v1:172.21.15.2:6801/3992427579] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe03000df30 con 0x7fe018072870 2024-09-10T08:48:26.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.136+0000 7fe02f400640 1 -- 172.21.15.2:0/1204141306 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7fe0300902a0 con 0x7fe03815e7a0 2024-09-10T08:48:26.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.136+0000 7fe036a00640 1 --2- 172.21.15.2:0/1204141306 >> [v2:172.21.15.2:6800/3992427579,v1:172.21.15.2:6801/3992427579] conn(0x7fe018072870 0x7fe018074cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:26.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.137+0000 7fe037400640 1 --2- 172.21.15.2:0/1204141306 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7fe01806be30 0x7fe01806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:26.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.137+0000 7fe036a00640 1 --2- 172.21.15.2:0/1204141306 >> [v2:172.21.15.2:6800/3992427579,v1:172.21.15.2:6801/3992427579] conn(0x7fe018072870 0x7fe018074cb0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:26.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.137+0000 7fe037400640 1 --2- 172.21.15.2:0/1204141306 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7fe01806be30 0x7fe01806e2f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe028007fd0 tx=0x7fe028007e80 comp rx=0 tx=0).ready entity=mgr.4862 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:26.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.138+0000 7fe02f400640 1 -- 172.21.15.2:0/1204141306 <== osd.2 v2:172.21.15.2:6800/3992427579 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe03000df30 con 0x7fe018072870 2024-09-10T08:48:26.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.151+0000 7fe03ca00640 1 -- 172.21.15.2:0/1204141306 --> [v2:172.21.15.2:6800/3992427579,v1:172.21.15.2:6801/3992427579] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe0380b4080 con 0x7fe018072870 2024-09-10T08:48:26.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.151+0000 7fe02f400640 1 -- 172.21.15.2:0/1204141306 <== osd.2 v2:172.21.15.2:6800/3992427579 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fe0380b4080 con 0x7fe018072870 2024-09-10T08:48:26.152 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T08:48:26.152 INFO:teuthology.orchestra.run.smithi002.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T08:48:26.152 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T08:48:26.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.152+0000 7fe03ca00640 1 -- 172.21.15.2:0/1204141306 >> [v2:172.21.15.2:6800/3992427579,v1:172.21.15.2:6801/3992427579] conn(0x7fe018072870 msgr2=0x7fe018074cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:26.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.152+0000 7fe03ca00640 1 --2- 172.21.15.2:0/1204141306 >> [v2:172.21.15.2:6800/3992427579,v1:172.21.15.2:6801/3992427579] conn(0x7fe018072870 0x7fe018074cb0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:26.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.152+0000 7fe03ca00640 1 -- 172.21.15.2:0/1204141306 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7fe01806be30 msgr2=0x7fe01806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:26.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.152+0000 7fe03ca00640 1 --2- 172.21.15.2:0/1204141306 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7fe01806be30 0x7fe01806e2f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe028007fd0 tx=0x7fe028007e80 comp rx=0 tx=0).stop 2024-09-10T08:48:26.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.152+0000 7fe03ca00640 1 -- 172.21.15.2:0/1204141306 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe03815e7a0 msgr2=0x7fe0380c8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:26.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.152+0000 7fe03ca00640 1 --2- 172.21.15.2:0/1204141306 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe03815e7a0 0x7fe0380c8290 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe030007e70 tx=0x7fe03000e4b0 comp rx=0 tx=0).stop 2024-09-10T08:48:26.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.152+0000 7fe037e00640 1 -- 172.21.15.2:0/1204141306 reap_dead start 2024-09-10T08:48:26.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.152+0000 7fe03ca00640 1 -- 172.21.15.2:0/1204141306 shutdown_connections 2024-09-10T08:48:26.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.152+0000 7fe03ca00640 1 -- 172.21.15.2:0/1204141306 >> 172.21.15.2:0/1204141306 conn(0x7fe03809d700 msgr2=0x7fe0380b5e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:26.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.152+0000 7fe03ca00640 1 -- 172.21.15.2:0/1204141306 shutdown_connections 2024-09-10T08:48:26.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.152+0000 7fe03ca00640 1 -- 172.21.15.2:0/1204141306 wait complete. 2024-09-10T08:48:26.167 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-10T08:48:26.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.325+0000 7ffa57e00640 1 Processor -- start 2024-09-10T08:48:26.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.325+0000 7ffa57e00640 1 -- start start 2024-09-10T08:48:26.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.326+0000 7ffa57e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa5815e500 0x7ffa580cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:26.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.326+0000 7ffa57e00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa580d0350 con 0x7ffa580d4d90 2024-09-10T08:48:26.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.326+0000 7ffa57e00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa580d2080 con 0x7ffa580d0b50 2024-09-10T08:48:26.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.326+0000 7ffa57e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ffa5815e8e0 con 0x7ffa5815e500 2024-09-10T08:48:26.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.326+0000 7ffa56000640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ffa580d4d90 0x7ffa580d2e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41760/0 (socket says 172.21.15.2:41760) 2024-09-10T08:48:26.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.326+0000 7ffa56000640 1 -- 172.21.15.2:0/2555170144 learned_addr learned my addr 172.21.15.2:0/2555170144 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:48:26.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.326+0000 7ffa56a00640 1 --2- 172.21.15.2:0/2555170144 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa5815e500 0x7ffa580cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:26.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.327+0000 7ffa55600640 1 -- 172.21.15.2:0/2555170144 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2873382009 0 0) 0x7ffa580d0350 con 0x7ffa580d4d90 2024-09-10T08:48:26.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.327+0000 7ffa55600640 1 -- 172.21.15.2:0/2555170144 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa3c003520 con 0x7ffa580d4d90 2024-09-10T08:48:26.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.327+0000 7ffa55600640 1 -- 172.21.15.2:0/2555170144 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3928658711 0 0) 0x7ffa580d2080 con 0x7ffa580d0b50 2024-09-10T08:48:26.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.327+0000 7ffa55600640 1 -- 172.21.15.2:0/2555170144 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa580d0350 con 0x7ffa580d0b50 2024-09-10T08:48:26.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.327+0000 7ffa56a00640 1 -- 172.21.15.2:0/2555170144 >> v1:172.21.15.155:6789/0 conn(0x7ffa580d0b50 legacy=0x7ffa580b7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:26.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.327+0000 7ffa56a00640 1 -- 172.21.15.2:0/2555170144 >> v1:172.21.15.2:6789/0 conn(0x7ffa580d4d90 legacy=0x7ffa580d2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:26.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.327+0000 7ffa56a00640 1 -- 172.21.15.2:0/2555170144 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa580d2360 con 0x7ffa5815e500 2024-09-10T08:48:26.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.328+0000 7ffa56a00640 1 --2- 172.21.15.2:0/2555170144 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa5815e500 0x7ffa580cefb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ffa480097d0 tx=0x7ffa4802a200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87a8e29822c79ea2 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:26.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.328+0000 7ffa55600640 1 -- 172.21.15.2:0/2555170144 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa48037070 con 0x7ffa5815e500 2024-09-10T08:48:26.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.329+0000 7ffa55600640 1 -- 172.21.15.2:0/2555170144 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa48032440 con 0x7ffa5815e500 2024-09-10T08:48:26.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.329+0000 7ffa55600640 1 -- 172.21.15.2:0/2555170144 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa48032810 con 0x7ffa5815e500 2024-09-10T08:48:26.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.329+0000 7ffa57e00640 1 -- 172.21.15.2:0/2555170144 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa5815e500 msgr2=0x7ffa580cefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:26.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.329+0000 7ffa57e00640 1 --2- 172.21.15.2:0/2555170144 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa5815e500 0x7ffa580cefb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ffa480097d0 tx=0x7ffa4802a200 comp rx=0 tx=0).stop 2024-09-10T08:48:26.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.329+0000 7ffa57e00640 1 -- 172.21.15.2:0/2555170144 shutdown_connections 2024-09-10T08:48:26.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.329+0000 7ffa57e00640 1 --2- 172.21.15.2:0/2555170144 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa5815e500 0x7ffa580cefb0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:26.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.329+0000 7ffa57e00640 1 -- 172.21.15.2:0/2555170144 >> 172.21.15.2:0/2555170144 conn(0x7ffa5809d720 msgr2=0x7ffa580d4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:26.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.329+0000 7ffa57e00640 1 -- 172.21.15.2:0/2555170144 shutdown_connections 2024-09-10T08:48:26.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.329+0000 7ffa57e00640 1 -- 172.21.15.2:0/2555170144 wait complete. 2024-09-10T08:48:26.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.331+0000 7ffa57e00640 1 Processor -- start 2024-09-10T08:48:26.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.331+0000 7ffa57e00640 1 -- start start 2024-09-10T08:48:26.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.332+0000 7ffa57e00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa580d0b50 0x7ffa581e87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:26.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.332+0000 7ffa57e00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa580d4d90 0x7ffa581e8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:26.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.332+0000 7ffa57e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa5815e500 0x7ffa5814bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:26.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.332+0000 7ffa57e00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7ffa580cff90 con 0x7ffa5815e500 2024-09-10T08:48:26.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.332+0000 7ffa57e00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ffa580d2920 con 0x7ffa580d4d90 2024-09-10T08:48:26.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.332+0000 7ffa57e00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7ffa580d0110 con 0x7ffa580d0b50 2024-09-10T08:48:26.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.332+0000 7ffa57400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa5815e500 0x7ffa5814bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:26.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.332+0000 7ffa56000640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa580d4d90 0x7ffa581e8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:26.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.332+0000 7ffa57400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa5815e500 0x7ffa5814bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46454/0 (socket says 172.21.15.2:46454) 2024-09-10T08:48:26.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.332+0000 7ffa57400640 1 -- 172.21.15.2:0/16243470 learned_addr learned my addr 172.21.15.2:0/16243470 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:26.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.332+0000 7ffa56a00640 1 --2- 172.21.15.2:0/16243470 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa580d0b50 0x7ffa581e87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:26.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.333+0000 7ffa57400640 1 -- 172.21.15.2:0/16243470 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa580d0b50 msgr2=0x7ffa581e87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:26.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.333+0000 7ffa57400640 1 --2- 172.21.15.2:0/16243470 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa580d0b50 0x7ffa581e87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:26.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.333+0000 7ffa57400640 1 -- 172.21.15.2:0/16243470 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa580d4d90 msgr2=0x7ffa581e8ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:26.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.333+0000 7ffa57400640 1 --2- 172.21.15.2:0/16243470 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa580d4d90 0x7ffa581e8ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:26.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.333+0000 7ffa57400640 1 -- 172.21.15.2:0/16243470 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa581e7d00 con 0x7ffa5815e500 2024-09-10T08:48:26.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.333+0000 7ffa57400640 1 --2- 172.21.15.2:0/16243470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa5815e500 0x7ffa5814bf90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ffa5000c710 tx=0x7ffa5000cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:26.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.333+0000 7ffa4ea00640 1 -- 172.21.15.2:0/16243470 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa50003b70 con 0x7ffa5815e500 2024-09-10T08:48:26.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.333+0000 7ffa4ea00640 1 -- 172.21.15.2:0/16243470 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa50003d10 con 0x7ffa5815e500 2024-09-10T08:48:26.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.333+0000 7ffa4ea00640 1 -- 172.21.15.2:0/16243470 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa5000a9f0 con 0x7ffa5815e500 2024-09-10T08:48:26.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.333+0000 7ffa57e00640 1 -- 172.21.15.2:0/16243470 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa5814d080 con 0x7ffa5815e500 2024-09-10T08:48:26.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.334+0000 7ffa57e00640 1 -- 172.21.15.2:0/16243470 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa581e8280 con 0x7ffa5815e500 2024-09-10T08:48:26.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.334+0000 7ffa57e00640 1 -- 172.21.15.2:0/16243470 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa581e8480 con 0x7ffa5815e500 2024-09-10T08:48:26.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.336+0000 7ffa4ea00640 1 -- 172.21.15.2:0/16243470 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 14) ==== 90498+0+0 (secure 0 0 0) 0x7ffa5000ab90 con 0x7ffa5815e500 2024-09-10T08:48:26.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.336+0000 7ffa4ea00640 1 --2- 172.21.15.2:0/16243470 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7ffa3806be30 0x7ffa3806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:26.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.336+0000 7ffa4ea00640 1 -- 172.21.15.2:0/16243470 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5980+0+0 (secure 0 0 0) 0x7ffa5008ad40 con 0x7ffa5815e500 2024-09-10T08:48:26.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.337+0000 7ffa56a00640 1 --2- 172.21.15.2:0/16243470 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7ffa3806be30 0x7ffa3806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:26.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.338+0000 7ffa56a00640 1 --2- 172.21.15.2:0/16243470 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7ffa3806be30 0x7ffa3806e2f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ffa48034000 tx=0x7ffa4802e000 comp rx=0 tx=0).ready entity=mgr.4862 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:26.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.341+0000 7ffa4ea00640 1 -- 172.21.15.2:0/16243470 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ffa581e8480 con 0x7ffa5815e500 2024-09-10T08:48:26.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.526+0000 7ffa57e00640 1 -- 172.21.15.2:0/16243470 --> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7ffa5815f3b0 con 0x7ffa3806be30 2024-09-10T08:48:26.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.527+0000 7ffa4ea00640 1 -- 172.21.15.2:0/16243470 <== mgr.4862 v2:172.21.15.155:6832/2264044153 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ffa480325c0 con 0x7ffa3806be30 2024-09-10T08:48:26.527 INFO:teuthology.orchestra.run.smithi002.stderr:instructed osd(s) 2 to deep-scrub 2024-09-10T08:48:26.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.529+0000 7ffa57e00640 1 -- 172.21.15.2:0/16243470 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7ffa3806be30 msgr2=0x7ffa3806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:26.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.529+0000 7ffa57e00640 1 --2- 172.21.15.2:0/16243470 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7ffa3806be30 0x7ffa3806e2f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ffa48034000 tx=0x7ffa4802e000 comp rx=0 tx=0).stop 2024-09-10T08:48:26.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.529+0000 7ffa57e00640 1 -- 172.21.15.2:0/16243470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa5815e500 msgr2=0x7ffa5814bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:26.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.529+0000 7ffa57e00640 1 --2- 172.21.15.2:0/16243470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa5815e500 0x7ffa5814bf90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ffa5000c710 tx=0x7ffa5000cbd0 comp rx=0 tx=0).stop 2024-09-10T08:48:26.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.529+0000 7ffa57e00640 1 -- 172.21.15.2:0/16243470 shutdown_connections 2024-09-10T08:48:26.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.529+0000 7ffa57e00640 1 --2- 172.21.15.2:0/16243470 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7ffa3806be30 0x7ffa3806e2f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:26.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.529+0000 7ffa57e00640 1 --2- 172.21.15.2:0/16243470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa5815e500 0x7ffa5814bf90 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:26.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.529+0000 7ffa57e00640 1 --2- 172.21.15.2:0/16243470 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa580d4d90 0x7ffa581e8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:26.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.529+0000 7ffa57e00640 1 --2- 172.21.15.2:0/16243470 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa580d0b50 0x7ffa581e87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:26.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.529+0000 7ffa57e00640 1 -- 172.21.15.2:0/16243470 >> 172.21.15.2:0/16243470 conn(0x7ffa5809d720 msgr2=0x7ffa58069ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:26.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.529+0000 7ffa57e00640 1 -- 172.21.15.2:0/16243470 shutdown_connections 2024-09-10T08:48:26.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.529+0000 7ffa57e00640 1 -- 172.21.15.2:0/16243470 wait complete. 2024-09-10T08:48:26.545 INFO:tasks.ceph:Scrubbing osd.3 2024-09-10T08:48:26.545 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-10T08:48:26.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.707+0000 7f3ad8400640 1 Processor -- start 2024-09-10T08:48:26.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.707+0000 7f3ad8400640 1 -- start start 2024-09-10T08:48:26.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.708+0000 7f3ad8400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3ad015b560 0x7f3ad00b3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:26.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.708+0000 7f3ad8400640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3ad00cba60 0x7f3ad00b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:26.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.708+0000 7f3ad8400640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ad015b940 con 0x7f3ad00d07d0 2024-09-10T08:48:26.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.708+0000 7f3ad8400640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f3ad00cefb0 con 0x7f3ad015b560 2024-09-10T08:48:26.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.708+0000 7f3ad8400640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f3ad00ce0c0 con 0x7f3ad00cba60 2024-09-10T08:48:26.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.708+0000 7f3ad5a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3ad015b560 0x7f3ad00b3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:26.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.708+0000 7f3ad5a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3ad015b560 0x7f3ad00b3050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46470/0 (socket says 172.21.15.2:46470) 2024-09-10T08:48:26.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.708+0000 7f3ad5a00640 1 -- 172.21.15.2:0/2347250099 learned_addr learned my addr 172.21.15.2:0/2347250099 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:26.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.708+0000 7f3ad6400640 1 --2- 172.21.15.2:0/2347250099 >> v2:172.21.15.155:3300/0 conn(0x7f3ad00cba60 0x7f3ad00b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:26.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.709+0000 7f3ad5a00640 1 -- 172.21.15.2:0/2347250099 >> v2:172.21.15.155:3300/0 conn(0x7f3ad00cba60 msgr2=0x7f3ad00b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:48:26.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.709+0000 7f3ad5a00640 1 --2- 172.21.15.2:0/2347250099 >> v2:172.21.15.155:3300/0 conn(0x7f3ad00cba60 0x7f3ad00b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:26.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.709+0000 7f3ad5a00640 1 -- 172.21.15.2:0/2347250099 >> v1:172.21.15.155:6789/0 conn(0x7f3ad00d07d0 legacy=0x7f3ad015f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:48:26.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.709+0000 7f3ad5a00640 1 -- 172.21.15.2:0/2347250099 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ad00ce3a0 con 0x7f3ad015b560 2024-09-10T08:48:26.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.710+0000 7f3ad5a00640 1 --2- 172.21.15.2:0/2347250099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ad015b560 0x7f3ad00b3050 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f3ad00c3c20 tx=0x7f3ac402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8973d1d7ffde88f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:26.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.710+0000 7f3acfe00640 1 -- 172.21.15.2:0/2347250099 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac4037070 con 0x7f3ad015b560 2024-09-10T08:48:26.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.710+0000 7f3acfe00640 1 -- 172.21.15.2:0/2347250099 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ac4032440 con 0x7f3ad015b560 2024-09-10T08:48:26.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.710+0000 7f3acfe00640 1 -- 172.21.15.2:0/2347250099 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac4032810 con 0x7f3ad015b560 2024-09-10T08:48:26.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.710+0000 7f3ad8400640 1 -- 172.21.15.2:0/2347250099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ad015b560 msgr2=0x7f3ad00b3050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:26.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.710+0000 7f3ad8400640 1 --2- 172.21.15.2:0/2347250099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ad015b560 0x7f3ad00b3050 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f3ad00c3c20 tx=0x7f3ac402a230 comp rx=0 tx=0).stop 2024-09-10T08:48:26.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.711+0000 7f3ad8400640 1 -- 172.21.15.2:0/2347250099 shutdown_connections 2024-09-10T08:48:26.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.711+0000 7f3ad8400640 1 --2- 172.21.15.2:0/2347250099 >> v2:172.21.15.155:3300/0 conn(0x7f3ad00cba60 0x7f3ad00b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:26.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.711+0000 7f3ad8400640 1 --2- 172.21.15.2:0/2347250099 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ad015b560 0x7f3ad00b3050 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:26.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.711+0000 7f3ad8400640 1 -- 172.21.15.2:0/2347250099 >> 172.21.15.2:0/2347250099 conn(0x7f3ad006bdf0 msgr2=0x7f3ad006c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:26.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.711+0000 7f3ad8400640 1 -- 172.21.15.2:0/2347250099 shutdown_connections 2024-09-10T08:48:26.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.711+0000 7f3ad8400640 1 -- 172.21.15.2:0/2347250099 wait complete. 2024-09-10T08:48:26.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.712+0000 7f3ad8400640 1 Processor -- start 2024-09-10T08:48:26.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.712+0000 7f3ad8400640 1 -- start start 2024-09-10T08:48:26.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.713+0000 7f3ad8400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3ad00cba60 0x7f3ad0153200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:26.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.713+0000 7f3ad8400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3ad00d07d0 0x7f3ad00b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:26.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.713+0000 7f3ad8400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ad015b560 0x7f3ad00b37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:26.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.713+0000 7f3ad8400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f3ad00cec40 con 0x7f3ad015b560 2024-09-10T08:48:26.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.713+0000 7f3ad8400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3ad00ce960 con 0x7f3ad00d07d0 2024-09-10T08:48:26.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.713+0000 7f3ad8400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f3ad00cc6e0 con 0x7f3ad00cba60 2024-09-10T08:48:26.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.714+0000 7f3ad6400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ad015b560 0x7f3ad00b37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:26.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.714+0000 7f3ad6400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ad015b560 0x7f3ad00b37a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46476/0 (socket says 172.21.15.2:46476) 2024-09-10T08:48:26.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.714+0000 7f3ad6400640 1 -- 172.21.15.2:0/65068857 learned_addr learned my addr 172.21.15.2:0/65068857 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:26.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.714+0000 7f3ad5000640 1 --2- 172.21.15.2:0/65068857 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3ad00d07d0 0x7f3ad00b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:26.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.714+0000 7f3ad5a00640 1 --2- 172.21.15.2:0/65068857 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3ad00cba60 0x7f3ad0153200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:26.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.714+0000 7f3ad6400640 1 -- 172.21.15.2:0/65068857 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3ad00cba60 msgr2=0x7f3ad0153200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:26.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.714+0000 7f3ad6400640 1 --2- 172.21.15.2:0/65068857 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3ad00cba60 0x7f3ad0153200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:26.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.714+0000 7f3ad6400640 1 -- 172.21.15.2:0/65068857 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3ad00d07d0 msgr2=0x7f3ad00b3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:26.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.714+0000 7f3ad6400640 1 --2- 172.21.15.2:0/65068857 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3ad00d07d0 0x7f3ad00b3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:26.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.714+0000 7f3ad6400640 1 -- 172.21.15.2:0/65068857 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ad0072120 con 0x7f3ad015b560 2024-09-10T08:48:26.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.715+0000 7f3ad6400640 1 --2- 172.21.15.2:0/65068857 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ad015b560 0x7f3ad00b37a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f3ac8007e30 tx=0x7f3ac800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:26.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.715+0000 7f3acd600640 1 -- 172.21.15.2:0/65068857 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac8014620 con 0x7f3ad015b560 2024-09-10T08:48:26.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.715+0000 7f3acd600640 1 -- 172.21.15.2:0/65068857 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ac8019070 con 0x7f3ad015b560 2024-09-10T08:48:26.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.715+0000 7f3ad8400640 1 -- 172.21.15.2:0/65068857 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ad0072400 con 0x7f3ad015b560 2024-09-10T08:48:26.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.715+0000 7f3acd600640 1 -- 172.21.15.2:0/65068857 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ac8014a00 con 0x7f3ad015b560 2024-09-10T08:48:26.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.715+0000 7f3ad8400640 1 -- 172.21.15.2:0/65068857 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ad00729c0 con 0x7f3ad015b560 2024-09-10T08:48:26.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.716+0000 7f3ad8400640 1 -- 172.21.15.2:0/65068857 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3ad00b0dc0 con 0x7f3ad015b560 2024-09-10T08:48:26.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.717+0000 7f3acd600640 1 -- 172.21.15.2:0/65068857 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 14) ==== 90498+0+0 (secure 0 0 0) 0x7f3ac8014ba0 con 0x7f3ad015b560 2024-09-10T08:48:26.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.718+0000 7f3acd600640 1 --2- 172.21.15.2:0/65068857 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f3ab006be30 0x7f3ab006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:26.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.718+0000 7f3acd600640 1 -- 172.21.15.2:0/65068857 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5980+0+0 (secure 0 0 0) 0x7f3ac808c210 con 0x7f3ad015b560 2024-09-10T08:48:26.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.718+0000 7f3acd600640 1 --2- 172.21.15.2:0/65068857 >> [v2:172.21.15.2:6816/1270626884,v1:172.21.15.2:6817/1270626884] conn(0x7f3ab0072870 0x7f3ab0074cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:26.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.718+0000 7f3acd600640 1 -- 172.21.15.2:0/65068857 --> [v2:172.21.15.2:6816/1270626884,v1:172.21.15.2:6817/1270626884] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3ac8016e70 con 0x7f3ab0072870 2024-09-10T08:48:26.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.718+0000 7f3acd600640 1 -- 172.21.15.2:0/65068857 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f3ac808c5c0 con 0x7f3ad015b560 2024-09-10T08:48:26.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.718+0000 7f3ad5a00640 1 --2- 172.21.15.2:0/65068857 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f3ab006be30 0x7f3ab006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:26.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.718+0000 7f3ad5000640 1 --2- 172.21.15.2:0/65068857 >> [v2:172.21.15.2:6816/1270626884,v1:172.21.15.2:6817/1270626884] conn(0x7f3ab0072870 0x7f3ab0074cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:26.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.719+0000 7f3ad5000640 1 --2- 172.21.15.2:0/65068857 >> [v2:172.21.15.2:6816/1270626884,v1:172.21.15.2:6817/1270626884] conn(0x7f3ab0072870 0x7f3ab0074cb0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:26.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.719+0000 7f3ad5a00640 1 --2- 172.21.15.2:0/65068857 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f3ab006be30 0x7f3ab006e2f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3ac4034000 tx=0x7f3ac402e000 comp rx=0 tx=0).ready entity=mgr.4862 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:26.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.720+0000 7f3acd600640 1 -- 172.21.15.2:0/65068857 <== osd.3 v2:172.21.15.2:6816/1270626884 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3ac8016e70 con 0x7f3ab0072870 2024-09-10T08:48:26.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.733+0000 7f3ad8400640 1 -- 172.21.15.2:0/65068857 --> [v2:172.21.15.2:6816/1270626884,v1:172.21.15.2:6817/1270626884] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f3ad00b3050 con 0x7f3ab0072870 2024-09-10T08:48:26.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.733+0000 7f3acd600640 1 -- 172.21.15.2:0/65068857 <== osd.3 v2:172.21.15.2:6816/1270626884 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f3ad00b3050 con 0x7f3ab0072870 2024-09-10T08:48:26.734 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T08:48:26.734 INFO:teuthology.orchestra.run.smithi002.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T08:48:26.734 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T08:48:26.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.733+0000 7f3ad8400640 1 -- 172.21.15.2:0/65068857 >> [v2:172.21.15.2:6816/1270626884,v1:172.21.15.2:6817/1270626884] conn(0x7f3ab0072870 msgr2=0x7f3ab0074cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:26.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.733+0000 7f3ad8400640 1 --2- 172.21.15.2:0/65068857 >> [v2:172.21.15.2:6816/1270626884,v1:172.21.15.2:6817/1270626884] conn(0x7f3ab0072870 0x7f3ab0074cb0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:26.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.734+0000 7f3ad8400640 1 -- 172.21.15.2:0/65068857 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f3ab006be30 msgr2=0x7f3ab006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:26.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.734+0000 7f3ad8400640 1 --2- 172.21.15.2:0/65068857 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f3ab006be30 0x7f3ab006e2f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3ac4034000 tx=0x7f3ac402e000 comp rx=0 tx=0).stop 2024-09-10T08:48:26.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.734+0000 7f3ad8400640 1 -- 172.21.15.2:0/65068857 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ad015b560 msgr2=0x7f3ad00b37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:26.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.734+0000 7f3ad8400640 1 --2- 172.21.15.2:0/65068857 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ad015b560 0x7f3ad00b37a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f3ac8007e30 tx=0x7f3ac800e4b0 comp rx=0 tx=0).stop 2024-09-10T08:48:26.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.734+0000 7f3ad6400640 1 -- 172.21.15.2:0/65068857 reap_dead start 2024-09-10T08:48:26.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.734+0000 7f3ad8400640 1 -- 172.21.15.2:0/65068857 shutdown_connections 2024-09-10T08:48:26.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.734+0000 7f3ad8400640 1 -- 172.21.15.2:0/65068857 >> 172.21.15.2:0/65068857 conn(0x7f3ad006bdf0 msgr2=0x7f3ad00b1320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:26.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.734+0000 7f3ad8400640 1 -- 172.21.15.2:0/65068857 shutdown_connections 2024-09-10T08:48:26.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.734+0000 7f3ad8400640 1 -- 172.21.15.2:0/65068857 wait complete. 2024-09-10T08:48:26.749 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-10T08:48:26.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.906+0000 7fb44e200640 1 Processor -- start 2024-09-10T08:48:26.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.906+0000 7fb44e200640 1 -- start start 2024-09-10T08:48:26.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.907+0000 7fb44e200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb44815b4c0 0x7fb4480cf6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:26.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.907+0000 7fb44e200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb4480af590 0x7fb44806f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:26.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.907+0000 7fb44e200640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4480af160 con 0x7fb44806f5a0 2024-09-10T08:48:26.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.907+0000 7fb44e200640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fb4480d1130 con 0x7fb44815b4c0 2024-09-10T08:48:26.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.907+0000 7fb44e200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb4480ad140 con 0x7fb4480af590 2024-09-10T08:48:26.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.908+0000 7fb447400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb44815b4c0 0x7fb4480cf6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:26.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.908+0000 7fb447400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb44815b4c0 0x7fb4480cf6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46480/0 (socket says 172.21.15.2:46480) 2024-09-10T08:48:26.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.908+0000 7fb447400640 1 -- 172.21.15.2:0/1907629520 learned_addr learned my addr 172.21.15.2:0/1907629520 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:26.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.908+0000 7fb43fe00640 1 --2- 172.21.15.2:0/1907629520 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb4480af590 0x7fb44806f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:26.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.908+0000 7fb447400640 1 -- 172.21.15.2:0/1907629520 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb4480af590 msgr2=0x7fb44806f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:48:26.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.908+0000 7fb447400640 1 --2- 172.21.15.2:0/1907629520 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb4480af590 0x7fb44806f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:26.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.908+0000 7fb447400640 1 -- 172.21.15.2:0/1907629520 >> v1:172.21.15.155:6789/0 conn(0x7fb44806f5a0 legacy=0x7fb4480ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:26.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.908+0000 7fb447400640 1 -- 172.21.15.2:0/1907629520 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4480ad390 con 0x7fb44815b4c0 2024-09-10T08:48:26.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.909+0000 7fb447400640 1 --2- 172.21.15.2:0/1907629520 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb44815b4c0 0x7fb4480cf6d0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb438009870 tx=0x7fb43802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80d8453ce9f448b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:26.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.910+0000 7fb446a00640 1 -- 172.21.15.2:0/1907629520 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb438037070 con 0x7fb44815b4c0 2024-09-10T08:48:26.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.910+0000 7fb446a00640 1 -- 172.21.15.2:0/1907629520 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb438032440 con 0x7fb44815b4c0 2024-09-10T08:48:26.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.910+0000 7fb446a00640 1 -- 172.21.15.2:0/1907629520 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb438032810 con 0x7fb44815b4c0 2024-09-10T08:48:26.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.910+0000 7fb44e200640 1 -- 172.21.15.2:0/1907629520 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb44815b4c0 msgr2=0x7fb4480cf6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:26.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.910+0000 7fb44e200640 1 --2- 172.21.15.2:0/1907629520 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb44815b4c0 0x7fb4480cf6d0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb438009870 tx=0x7fb43802a1c0 comp rx=0 tx=0).stop 2024-09-10T08:48:26.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.910+0000 7fb44e200640 1 -- 172.21.15.2:0/1907629520 shutdown_connections 2024-09-10T08:48:26.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.910+0000 7fb44e200640 1 --2- 172.21.15.2:0/1907629520 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb4480af590 0x7fb44806f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:26.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.910+0000 7fb44e200640 1 --2- 172.21.15.2:0/1907629520 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb44815b4c0 0x7fb4480cf6d0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:26.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.910+0000 7fb44e200640 1 -- 172.21.15.2:0/1907629520 >> 172.21.15.2:0/1907629520 conn(0x7fb4480d02c0 msgr2=0x7fb4480d06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:26.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.910+0000 7fb44e200640 1 -- 172.21.15.2:0/1907629520 shutdown_connections 2024-09-10T08:48:26.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.910+0000 7fb44e200640 1 -- 172.21.15.2:0/1907629520 wait complete. 2024-09-10T08:48:26.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.912+0000 7fb44e200640 1 Processor -- start 2024-09-10T08:48:26.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.912+0000 7fb44e200640 1 -- start start 2024-09-10T08:48:26.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.913+0000 7fb44e200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb44806f5a0 0x7fb448146b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:26.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.913+0000 7fb44e200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4480af590 0x7fb4481f4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:26.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.913+0000 7fb44e200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb44815b4c0 0x7fb4481481b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:26.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.913+0000 7fb44e200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fb4480ad950 con 0x7fb4480af590 2024-09-10T08:48:26.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.913+0000 7fb44e200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb4480af9d0 con 0x7fb44806f5a0 2024-09-10T08:48:26.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.913+0000 7fb44e200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fb4480adc30 con 0x7fb44815b4c0 2024-09-10T08:48:26.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.913+0000 7fb43fe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4480af590 0x7fb4481f4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:26.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.913+0000 7fb43fe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4480af590 0x7fb4481f4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46494/0 (socket says 172.21.15.2:46494) 2024-09-10T08:48:26.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.913+0000 7fb43fe00640 1 -- 172.21.15.2:0/3338745765 learned_addr learned my addr 172.21.15.2:0/3338745765 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:26.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.913+0000 7fb447400640 1 --2- 172.21.15.2:0/3338745765 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb44806f5a0 0x7fb448146b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:26.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.913+0000 7fb447e00640 1 --2- 172.21.15.2:0/3338745765 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb44815b4c0 0x7fb4481481b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:26.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.914+0000 7fb43fe00640 1 -- 172.21.15.2:0/3338745765 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb44815b4c0 msgr2=0x7fb4481481b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:26.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.914+0000 7fb43fe00640 1 --2- 172.21.15.2:0/3338745765 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb44815b4c0 0x7fb4481481b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:26.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.914+0000 7fb43fe00640 1 -- 172.21.15.2:0/3338745765 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb44806f5a0 msgr2=0x7fb448146b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:26.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.914+0000 7fb43fe00640 1 --2- 172.21.15.2:0/3338745765 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb44806f5a0 0x7fb448146b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:26.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.914+0000 7fb43fe00640 1 -- 172.21.15.2:0/3338745765 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb448147110 con 0x7fb4480af590 2024-09-10T08:48:26.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.914+0000 7fb43fe00640 1 --2- 172.21.15.2:0/3338745765 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4480af590 0x7fb4481f4120 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb43000d830 tx=0x7fb43000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:26.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.914+0000 7fb43f400640 1 -- 172.21.15.2:0/3338745765 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb43000b6c0 con 0x7fb4480af590 2024-09-10T08:48:26.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.914+0000 7fb43f400640 1 -- 172.21.15.2:0/3338745765 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb430019070 con 0x7fb4480af590 2024-09-10T08:48:26.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.914+0000 7fb43f400640 1 -- 172.21.15.2:0/3338745765 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb43000bac0 con 0x7fb4480af590 2024-09-10T08:48:26.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.914+0000 7fb44e200640 1 -- 172.21.15.2:0/3338745765 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4481473f0 con 0x7fb4480af590 2024-09-10T08:48:26.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.914+0000 7fb44e200640 1 -- 172.21.15.2:0/3338745765 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4481479b0 con 0x7fb4480af590 2024-09-10T08:48:26.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.915+0000 7fb44e200640 1 -- 172.21.15.2:0/3338745765 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb448071ef0 con 0x7fb4480af590 2024-09-10T08:48:26.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.916+0000 7fb43f400640 1 -- 172.21.15.2:0/3338745765 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 14) ==== 90498+0+0 (secure 0 0 0) 0x7fb43001e460 con 0x7fb4480af590 2024-09-10T08:48:26.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.917+0000 7fb43f400640 1 --2- 172.21.15.2:0/3338745765 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7fb42406be30 0x7fb42406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:26.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.917+0000 7fb43f400640 1 -- 172.21.15.2:0/3338745765 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5980+0+0 (secure 0 0 0) 0x7fb43008b650 con 0x7fb4480af590 2024-09-10T08:48:26.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.918+0000 7fb447400640 1 --2- 172.21.15.2:0/3338745765 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7fb42406be30 0x7fb42406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:26.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.919+0000 7fb447400640 1 --2- 172.21.15.2:0/3338745765 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7fb42406be30 0x7fb42406e2f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb438034000 tx=0x7fb43802e000 comp rx=0 tx=0).ready entity=mgr.4862 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:26.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:26.922+0000 7fb43f400640 1 -- 172.21.15.2:0/3338745765 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb430059ee0 con 0x7fb4480af590 2024-09-10T08:48:27.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.108+0000 7fb44e200640 1 -- 172.21.15.2:0/3338745765 --> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fb448072cb0 con 0x7fb42406be30 2024-09-10T08:48:27.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.108+0000 7fb43f400640 1 -- 172.21.15.2:0/3338745765 <== mgr.4862 v2:172.21.15.155:6832/2264044153 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb448072cb0 con 0x7fb42406be30 2024-09-10T08:48:27.109 INFO:teuthology.orchestra.run.smithi002.stderr:instructed osd(s) 3 to deep-scrub 2024-09-10T08:48:27.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.111+0000 7fb44e200640 1 -- 172.21.15.2:0/3338745765 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7fb42406be30 msgr2=0x7fb42406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:27.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.111+0000 7fb44e200640 1 --2- 172.21.15.2:0/3338745765 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7fb42406be30 0x7fb42406e2f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb438034000 tx=0x7fb43802e000 comp rx=0 tx=0).stop 2024-09-10T08:48:27.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.111+0000 7fb44e200640 1 -- 172.21.15.2:0/3338745765 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4480af590 msgr2=0x7fb4481f4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:27.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.111+0000 7fb44e200640 1 --2- 172.21.15.2:0/3338745765 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4480af590 0x7fb4481f4120 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb43000d830 tx=0x7fb43000dcf0 comp rx=0 tx=0).stop 2024-09-10T08:48:27.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.111+0000 7fb44e200640 1 -- 172.21.15.2:0/3338745765 shutdown_connections 2024-09-10T08:48:27.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.111+0000 7fb44e200640 1 --2- 172.21.15.2:0/3338745765 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7fb42406be30 0x7fb42406e2f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:27.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.111+0000 7fb44e200640 1 --2- 172.21.15.2:0/3338745765 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb44815b4c0 0x7fb4481481b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:27.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.111+0000 7fb44e200640 1 --2- 172.21.15.2:0/3338745765 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb4480af590 0x7fb4481f4120 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:27.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.111+0000 7fb44e200640 1 --2- 172.21.15.2:0/3338745765 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb44806f5a0 0x7fb448146b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:27.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.111+0000 7fb44e200640 1 -- 172.21.15.2:0/3338745765 >> 172.21.15.2:0/3338745765 conn(0x7fb4480d02c0 msgr2=0x7fb4480b0760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:27.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.111+0000 7fb44e200640 1 -- 172.21.15.2:0/3338745765 shutdown_connections 2024-09-10T08:48:27.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.111+0000 7fb44e200640 1 -- 172.21.15.2:0/3338745765 wait complete. 2024-09-10T08:48:27.126 INFO:tasks.ceph:Scrubbing osd.4 2024-09-10T08:48:27.127 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-10T08:48:27.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.286+0000 7f606f800640 1 Processor -- start 2024-09-10T08:48:27.287 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.287+0000 7f606f800640 1 -- start start 2024-09-10T08:48:27.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.287+0000 7f606f800640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f606815b560 0x7f60680b3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:27.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.288+0000 7f606f800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f60680d07d0 0x7f60680b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:27.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.288+0000 7f606f800640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f606815b940 con 0x7f60680cc6e0 2024-09-10T08:48:27.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.288+0000 7f606f800640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f60680cefb0 con 0x7f60680d07d0 2024-09-10T08:48:27.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.288+0000 7f606f800640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f60680ce0c0 con 0x7f606815b560 2024-09-10T08:48:27.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.288+0000 7f606d800640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f60680cc6e0 0x7f606815f040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41766/0 (socket says 172.21.15.2:41766) 2024-09-10T08:48:27.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.288+0000 7f6067e00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f60680d07d0 0x7f60680b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:27.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.288+0000 7f606d800640 1 -- 172.21.15.2:0/559770079 learned_addr learned my addr 172.21.15.2:0/559770079 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:48:27.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.288+0000 7f606ce00640 1 --2- 172.21.15.2:0/559770079 >> v2:172.21.15.155:3300/0 conn(0x7f606815b560 0x7f60680b3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:27.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.288+0000 7f6067e00640 1 -- 172.21.15.2:0/559770079 >> v2:172.21.15.155:3300/0 conn(0x7f606815b560 msgr2=0x7f60680b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:48:27.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.288+0000 7f6067e00640 1 --2- 172.21.15.2:0/559770079 >> v2:172.21.15.155:3300/0 conn(0x7f606815b560 0x7f60680b3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:27.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.288+0000 7f6067400640 1 -- 172.21.15.2:0/559770079 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2682059179 0 0) 0x7f6060001490 con 0x7f60680cc6e0 2024-09-10T08:48:27.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.288+0000 7f6067e00640 1 -- 172.21.15.2:0/559770079 >> v1:172.21.15.2:6789/0 conn(0x7f60680cc6e0 legacy=0x7f606815f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:27.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.288+0000 7f6067e00640 1 -- 172.21.15.2:0/559770079 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60680ce3a0 con 0x7f60680d07d0 2024-09-10T08:48:27.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.289+0000 7f6067e00640 1 --2- 172.21.15.2:0/559770079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60680d07d0 0x7f60680b3590 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f60680b5290 tx=0x7f605402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d616953d70fd4aa server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:27.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.290+0000 7f6067400640 1 -- 172.21.15.2:0/559770079 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6054037070 con 0x7f60680d07d0 2024-09-10T08:48:27.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.290+0000 7f6067400640 1 -- 172.21.15.2:0/559770079 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6054032440 con 0x7f60680d07d0 2024-09-10T08:48:27.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.290+0000 7f6067400640 1 -- 172.21.15.2:0/559770079 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6054032810 con 0x7f60680d07d0 2024-09-10T08:48:27.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.290+0000 7f606f800640 1 -- 172.21.15.2:0/559770079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60680d07d0 msgr2=0x7f60680b3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:27.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.290+0000 7f606f800640 1 --2- 172.21.15.2:0/559770079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60680d07d0 0x7f60680b3590 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f60680b5290 tx=0x7f605402a1a0 comp rx=0 tx=0).stop 2024-09-10T08:48:27.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.290+0000 7f606f800640 1 -- 172.21.15.2:0/559770079 shutdown_connections 2024-09-10T08:48:27.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.290+0000 7f606f800640 1 --2- 172.21.15.2:0/559770079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60680d07d0 0x7f60680b3590 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:27.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.290+0000 7f606f800640 1 --2- 172.21.15.2:0/559770079 >> v2:172.21.15.155:3300/0 conn(0x7f606815b560 0x7f60680b3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:27.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.290+0000 7f606f800640 1 -- 172.21.15.2:0/559770079 >> 172.21.15.2:0/559770079 conn(0x7f606806bdf0 msgr2=0x7f606806c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:27.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.290+0000 7f606f800640 1 -- 172.21.15.2:0/559770079 shutdown_connections 2024-09-10T08:48:27.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.290+0000 7f606f800640 1 -- 172.21.15.2:0/559770079 wait complete. 2024-09-10T08:48:27.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.292+0000 7f606f800640 1 Processor -- start 2024-09-10T08:48:27.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.292+0000 7f606f800640 1 -- start start 2024-09-10T08:48:27.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.293+0000 7f606f800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60680cc6e0 0x7f60681f26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:27.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.293+0000 7f606f800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f60680d07d0 0x7f6068158810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:27.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.293+0000 7f606f800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f606815b560 0x7f60680c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:27.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.293+0000 7f606f800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f60680cec40 con 0x7f60680cc6e0 2024-09-10T08:48:27.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.293+0000 7f606f800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f60680ce960 con 0x7f606815b560 2024-09-10T08:48:27.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.293+0000 7f606f800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f60680cba60 con 0x7f60680d07d0 2024-09-10T08:48:27.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.293+0000 7f606ce00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60680cc6e0 0x7f60681f26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:27.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.293+0000 7f606ce00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60680cc6e0 0x7f60681f26c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46508/0 (socket says 172.21.15.2:46508) 2024-09-10T08:48:27.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.293+0000 7f606ce00640 1 -- 172.21.15.2:0/2977966179 learned_addr learned my addr 172.21.15.2:0/2977966179 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:27.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.294+0000 7f606ce00640 1 -- 172.21.15.2:0/2977966179 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f60680d07d0 msgr2=0x7f6068158810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:27.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.294+0000 7f606ce00640 1 --2- 172.21.15.2:0/2977966179 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f60680d07d0 0x7f6068158810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:27.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.294+0000 7f606ce00640 1 -- 172.21.15.2:0/2977966179 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f606815b560 msgr2=0x7f60680c91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:27.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.294+0000 7f606ce00640 1 --2- 172.21.15.2:0/2977966179 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f606815b560 0x7f60680c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:27.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.294+0000 7f606ce00640 1 -- 172.21.15.2:0/2977966179 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6068158d50 con 0x7f60680cc6e0 2024-09-10T08:48:27.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.294+0000 7f606ce00640 1 --2- 172.21.15.2:0/2977966179 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60680cc6e0 0x7f60681f26c0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f605c00e870 tx=0x7f605c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:27.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.294+0000 7f6064c00640 1 -- 172.21.15.2:0/2977966179 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f605c017070 con 0x7f60680cc6e0 2024-09-10T08:48:27.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.294+0000 7f6064c00640 1 -- 172.21.15.2:0/2977966179 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f605c00ee60 con 0x7f60680cc6e0 2024-09-10T08:48:27.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.294+0000 7f6064c00640 1 -- 172.21.15.2:0/2977966179 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f605c00cb00 con 0x7f60680cc6e0 2024-09-10T08:48:27.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.294+0000 7f606f800640 1 -- 172.21.15.2:0/2977966179 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60680c83f0 con 0x7f60680cc6e0 2024-09-10T08:48:27.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.294+0000 7f606f800640 1 -- 172.21.15.2:0/2977966179 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60680c89b0 con 0x7f60680cc6e0 2024-09-10T08:48:27.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.295+0000 7f606f800640 1 -- 172.21.15.2:0/2977966179 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f60680b3050 con 0x7f60680cc6e0 2024-09-10T08:48:27.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.296+0000 7f6064c00640 1 -- 172.21.15.2:0/2977966179 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 14) ==== 90498+0+0 (secure 0 0 0) 0x7f605c01a070 con 0x7f60680cc6e0 2024-09-10T08:48:27.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.297+0000 7f6064c00640 1 --2- 172.21.15.2:0/2977966179 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f604806be30 0x7f604806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:27.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.297+0000 7f6064c00640 1 -- 172.21.15.2:0/2977966179 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5980+0+0 (secure 0 0 0) 0x7f605c08b1f0 con 0x7f60680cc6e0 2024-09-10T08:48:27.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.298+0000 7f6064c00640 1 --2- 172.21.15.2:0/2977966179 >> [v2:172.21.15.155:6803/553254873,v1:172.21.15.155:6806/553254873] conn(0x7f6048072870 0x7f6048074cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:27.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.298+0000 7f6064c00640 1 -- 172.21.15.2:0/2977966179 --> [v2:172.21.15.155:6803/553254873,v1:172.21.15.155:6806/553254873] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f605c011e50 con 0x7f6048072870 2024-09-10T08:48:27.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.298+0000 7f6064c00640 1 -- 172.21.15.2:0/2977966179 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f605c092050 con 0x7f60680cc6e0 2024-09-10T08:48:27.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.298+0000 7f6067e00640 1 --2- 172.21.15.2:0/2977966179 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f604806be30 0x7f604806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:27.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.298+0000 7f606d800640 1 --2- 172.21.15.2:0/2977966179 >> [v2:172.21.15.155:6803/553254873,v1:172.21.15.155:6806/553254873] conn(0x7f6048072870 0x7f6048074cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:27.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.299+0000 7f6067e00640 1 --2- 172.21.15.2:0/2977966179 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f604806be30 0x7f604806e2f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6054034000 tx=0x7f605402c000 comp rx=0 tx=0).ready entity=mgr.4862 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:27.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.299+0000 7f606d800640 1 --2- 172.21.15.2:0/2977966179 >> [v2:172.21.15.155:6803/553254873,v1:172.21.15.155:6806/553254873] conn(0x7f6048072870 0x7f6048074cb0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:27.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.300+0000 7f6064c00640 1 -- 172.21.15.2:0/2977966179 <== osd.4 v2:172.21.15.155:6803/553254873 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f605c011e50 con 0x7f6048072870 2024-09-10T08:48:27.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.313+0000 7f606f800640 1 -- 172.21.15.2:0/2977966179 --> [v2:172.21.15.155:6803/553254873,v1:172.21.15.155:6806/553254873] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f60680cf970 con 0x7f6048072870 2024-09-10T08:48:27.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.313+0000 7f6064c00640 1 -- 172.21.15.2:0/2977966179 <== osd.4 v2:172.21.15.155:6803/553254873 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f60680cf970 con 0x7f6048072870 2024-09-10T08:48:27.314 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T08:48:27.314 INFO:teuthology.orchestra.run.smithi002.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T08:48:27.314 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T08:48:27.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.314+0000 7f606f800640 1 -- 172.21.15.2:0/2977966179 >> [v2:172.21.15.155:6803/553254873,v1:172.21.15.155:6806/553254873] conn(0x7f6048072870 msgr2=0x7f6048074cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:27.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.314+0000 7f606f800640 1 --2- 172.21.15.2:0/2977966179 >> [v2:172.21.15.155:6803/553254873,v1:172.21.15.155:6806/553254873] conn(0x7f6048072870 0x7f6048074cb0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:27.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.314+0000 7f606f800640 1 -- 172.21.15.2:0/2977966179 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f604806be30 msgr2=0x7f604806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:27.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.314+0000 7f606f800640 1 --2- 172.21.15.2:0/2977966179 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f604806be30 0x7f604806e2f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6054034000 tx=0x7f605402c000 comp rx=0 tx=0).stop 2024-09-10T08:48:27.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.314+0000 7f606f800640 1 -- 172.21.15.2:0/2977966179 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60680cc6e0 msgr2=0x7f60681f26c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:27.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.314+0000 7f606f800640 1 --2- 172.21.15.2:0/2977966179 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60680cc6e0 0x7f60681f26c0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f605c00e870 tx=0x7f605c00ed30 comp rx=0 tx=0).stop 2024-09-10T08:48:27.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.314+0000 7f606d800640 1 -- 172.21.15.2:0/2977966179 reap_dead start 2024-09-10T08:48:27.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.314+0000 7f606f800640 1 -- 172.21.15.2:0/2977966179 shutdown_connections 2024-09-10T08:48:27.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.314+0000 7f606f800640 1 -- 172.21.15.2:0/2977966179 >> 172.21.15.2:0/2977966179 conn(0x7f606806bdf0 msgr2=0x7f60680b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:27.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.314+0000 7f606f800640 1 -- 172.21.15.2:0/2977966179 shutdown_connections 2024-09-10T08:48:27.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.314+0000 7f606f800640 1 -- 172.21.15.2:0/2977966179 wait complete. 2024-09-10T08:48:27.329 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-10T08:48:27.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.486+0000 7f2bcd200640 1 Processor -- start 2024-09-10T08:48:27.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.486+0000 7f2bcd200640 1 -- start start 2024-09-10T08:48:27.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.487+0000 7f2bcd200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2bc80d4d90 0x7f2bc80cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:27.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.487+0000 7f2bcd200640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bc80d0350 con 0x7f2bc815e500 2024-09-10T08:48:27.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.487+0000 7f2bcd200640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bc80d2080 con 0x7f2bc80d0b50 2024-09-10T08:48:27.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.487+0000 7f2bcd200640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f2bc815e8e0 con 0x7f2bc80d4d90 2024-09-10T08:48:27.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.487+0000 7f2bc6a00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2bc80d4d90 0x7f2bc80cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:27.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.487+0000 7f2bc7400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f2bc815e500 0x7f2bc80d2e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41774/0 (socket says 172.21.15.2:41774) 2024-09-10T08:48:27.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.487+0000 7f2bc7400640 1 -- 172.21.15.2:0/3652137587 learned_addr learned my addr 172.21.15.2:0/3652137587 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:48:27.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.488+0000 7f2bc6a00640 1 -- 172.21.15.2:0/3652137587 >> v1:172.21.15.155:6789/0 conn(0x7f2bc80d0b50 legacy=0x7f2bc80d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:48:27.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.488+0000 7f2bc6a00640 1 -- 172.21.15.2:0/3652137587 >> v1:172.21.15.2:6789/0 conn(0x7f2bc815e500 legacy=0x7f2bc80d2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:27.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.488+0000 7f2bc6a00640 1 -- 172.21.15.2:0/3652137587 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bc80d2360 con 0x7f2bc80d4d90 2024-09-10T08:48:27.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.489+0000 7f2bc6a00640 1 --2- 172.21.15.2:0/3652137587 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bc80d4d90 0x7f2bc80cefb0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f2bb40097a0 tx=0x7f2bb402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d66e30105e87748 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:27.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.489+0000 7f2bc6000640 1 -- 172.21.15.2:0/3652137587 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb4037070 con 0x7f2bc80d4d90 2024-09-10T08:48:27.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.489+0000 7f2bc6000640 1 -- 172.21.15.2:0/3652137587 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bb4032440 con 0x7f2bc80d4d90 2024-09-10T08:48:27.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.489+0000 7f2bc6000640 1 -- 172.21.15.2:0/3652137587 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb4032810 con 0x7f2bc80d4d90 2024-09-10T08:48:27.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.490+0000 7f2bcd200640 1 -- 172.21.15.2:0/3652137587 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bc80d4d90 msgr2=0x7f2bc80cefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:27.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.490+0000 7f2bcd200640 1 --2- 172.21.15.2:0/3652137587 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bc80d4d90 0x7f2bc80cefb0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f2bb40097a0 tx=0x7f2bb402a1e0 comp rx=0 tx=0).stop 2024-09-10T08:48:27.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.490+0000 7f2bcd200640 1 -- 172.21.15.2:0/3652137587 shutdown_connections 2024-09-10T08:48:27.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.490+0000 7f2bcd200640 1 --2- 172.21.15.2:0/3652137587 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bc80d4d90 0x7f2bc80cefb0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:27.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.490+0000 7f2bcd200640 1 -- 172.21.15.2:0/3652137587 >> 172.21.15.2:0/3652137587 conn(0x7f2bc809d720 msgr2=0x7f2bc80d4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:27.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.490+0000 7f2bcd200640 1 -- 172.21.15.2:0/3652137587 shutdown_connections 2024-09-10T08:48:27.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.490+0000 7f2bcd200640 1 -- 172.21.15.2:0/3652137587 wait complete. 2024-09-10T08:48:27.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.491+0000 7f2bcd200640 1 Processor -- start 2024-09-10T08:48:27.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.492+0000 7f2bcd200640 1 -- start start 2024-09-10T08:48:27.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.492+0000 7f2bcd200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2bc80d0b50 0x7f2bc815cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:27.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.492+0000 7f2bcd200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bc80d4d90 0x7f2bc80cbc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:27.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.492+0000 7f2bcd200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bc815e500 0x7f2bc80c9d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:27.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.493+0000 7f2bcd200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f2bc80cff90 con 0x7f2bc80d4d90 2024-09-10T08:48:27.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.493+0000 7f2bcd200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2bc80d2920 con 0x7f2bc815e500 2024-09-10T08:48:27.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.493+0000 7f2bcd200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f2bc80d0110 con 0x7f2bc80d0b50 2024-09-10T08:48:27.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.493+0000 7f2bc6a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bc80d4d90 0x7f2bc80cbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:27.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.493+0000 7f2bc6a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bc80d4d90 0x7f2bc80cbc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46534/0 (socket says 172.21.15.2:46534) 2024-09-10T08:48:27.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.493+0000 7f2bc6a00640 1 -- 172.21.15.2:0/2369329252 learned_addr learned my addr 172.21.15.2:0/2369329252 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:27.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.493+0000 7f2bc7400640 1 --2- 172.21.15.2:0/2369329252 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2bc80d0b50 0x7f2bc815cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:27.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.493+0000 7f2bc7e00640 1 --2- 172.21.15.2:0/2369329252 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bc815e500 0x7f2bc80c9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:27.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.493+0000 7f2bc6a00640 1 -- 172.21.15.2:0/2369329252 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2bc80d0b50 msgr2=0x7f2bc815cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:27.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.493+0000 7f2bc6a00640 1 --2- 172.21.15.2:0/2369329252 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2bc80d0b50 0x7f2bc815cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:27.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.493+0000 7f2bc6a00640 1 -- 172.21.15.2:0/2369329252 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bc815e500 msgr2=0x7f2bc80c9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:27.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.493+0000 7f2bc6a00640 1 --2- 172.21.15.2:0/2369329252 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bc815e500 0x7f2bc80c9d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:27.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.493+0000 7f2bc6a00640 1 -- 172.21.15.2:0/2369329252 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bc80cc490 con 0x7f2bc80d4d90 2024-09-10T08:48:27.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.494+0000 7f2bc6a00640 1 --2- 172.21.15.2:0/2369329252 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bc80d4d90 0x7f2bc80cbc40 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2bb4000c00 tx=0x7f2bb40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:27.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.494+0000 7f2bbf400640 1 -- 172.21.15.2:0/2369329252 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb4037040 con 0x7f2bc80d4d90 2024-09-10T08:48:27.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.494+0000 7f2bbf400640 1 -- 172.21.15.2:0/2369329252 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bb4042070 con 0x7f2bc80d4d90 2024-09-10T08:48:27.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.494+0000 7f2bbf400640 1 -- 172.21.15.2:0/2369329252 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb4030a70 con 0x7f2bc80d4d90 2024-09-10T08:48:27.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.494+0000 7f2bcd200640 1 -- 172.21.15.2:0/2369329252 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bc80cc770 con 0x7f2bc80d4d90 2024-09-10T08:48:27.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.494+0000 7f2bcd200640 1 -- 172.21.15.2:0/2369329252 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bc80ccd30 con 0x7f2bc80d4d90 2024-09-10T08:48:27.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.495+0000 7f2bcd200640 1 -- 172.21.15.2:0/2369329252 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bc80cefb0 con 0x7f2bc80d4d90 2024-09-10T08:48:27.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.496+0000 7f2bbf400640 1 -- 172.21.15.2:0/2369329252 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 14) ==== 90498+0+0 (secure 0 0 0) 0x7f2bb4030c10 con 0x7f2bc80d4d90 2024-09-10T08:48:27.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.497+0000 7f2bbf400640 1 --2- 172.21.15.2:0/2369329252 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f2ba806be30 0x7f2ba806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:27.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.497+0000 7f2bbf400640 1 -- 172.21.15.2:0/2369329252 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5980+0+0 (secure 0 0 0) 0x7f2bb40ab9a0 con 0x7f2bc80d4d90 2024-09-10T08:48:27.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.497+0000 7f2bc7400640 1 --2- 172.21.15.2:0/2369329252 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f2ba806be30 0x7f2ba806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:27.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.498+0000 7f2bc7400640 1 --2- 172.21.15.2:0/2369329252 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f2ba806be30 0x7f2ba806e2f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2bc80a1df0 tx=0x7f2bb8007e80 comp rx=0 tx=0).ready entity=mgr.4862 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:27.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.501+0000 7f2bbf400640 1 -- 172.21.15.2:0/2369329252 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2bb4079b50 con 0x7f2bc80d4d90 2024-09-10T08:48:27.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.687+0000 7f2bcd200640 1 -- 172.21.15.2:0/2369329252 --> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f2bc815d190 con 0x7f2ba806be30 2024-09-10T08:48:27.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.687+0000 7f2bbf400640 1 -- 172.21.15.2:0/2369329252 <== mgr.4862 v2:172.21.15.155:6832/2264044153 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f2bb8001460 con 0x7f2ba806be30 2024-09-10T08:48:27.688 INFO:teuthology.orchestra.run.smithi002.stderr:instructed osd(s) 4 to deep-scrub 2024-09-10T08:48:27.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.690+0000 7f2bcd200640 1 -- 172.21.15.2:0/2369329252 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f2ba806be30 msgr2=0x7f2ba806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:27.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.690+0000 7f2bcd200640 1 --2- 172.21.15.2:0/2369329252 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f2ba806be30 0x7f2ba806e2f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2bc80a1df0 tx=0x7f2bb8007e80 comp rx=0 tx=0).stop 2024-09-10T08:48:27.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.690+0000 7f2bcd200640 1 -- 172.21.15.2:0/2369329252 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bc80d4d90 msgr2=0x7f2bc80cbc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:27.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.690+0000 7f2bcd200640 1 --2- 172.21.15.2:0/2369329252 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bc80d4d90 0x7f2bc80cbc40 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2bb4000c00 tx=0x7f2bb40046c0 comp rx=0 tx=0).stop 2024-09-10T08:48:27.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.690+0000 7f2bcd200640 1 -- 172.21.15.2:0/2369329252 shutdown_connections 2024-09-10T08:48:27.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.690+0000 7f2bcd200640 1 --2- 172.21.15.2:0/2369329252 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f2ba806be30 0x7f2ba806e2f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:27.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.690+0000 7f2bcd200640 1 --2- 172.21.15.2:0/2369329252 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bc815e500 0x7f2bc80c9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:27.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.690+0000 7f2bcd200640 1 --2- 172.21.15.2:0/2369329252 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bc80d4d90 0x7f2bc80cbc40 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:27.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.690+0000 7f2bcd200640 1 --2- 172.21.15.2:0/2369329252 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2bc80d0b50 0x7f2bc815cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:27.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.690+0000 7f2bcd200640 1 -- 172.21.15.2:0/2369329252 >> 172.21.15.2:0/2369329252 conn(0x7f2bc809d720 msgr2=0x7f2bc80b8c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:27.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.690+0000 7f2bcd200640 1 -- 172.21.15.2:0/2369329252 shutdown_connections 2024-09-10T08:48:27.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.690+0000 7f2bcd200640 1 -- 172.21.15.2:0/2369329252 wait complete. 2024-09-10T08:48:27.706 INFO:tasks.ceph:Scrubbing osd.5 2024-09-10T08:48:27.706 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-10T08:48:27.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.866+0000 7f61ebe00640 1 Processor -- start 2024-09-10T08:48:27.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.866+0000 7f61ebe00640 1 -- start start 2024-09-10T08:48:27.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.867+0000 7f61ebe00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61ec0d0d90 0x7f61ec0d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:27.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.867+0000 7f61ebe00640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61ec0d16b0 con 0x7f61ec15e7a0 2024-09-10T08:48:27.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.867+0000 7f61ebe00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61ec0d0330 con 0x7f61ec0d4b00 2024-09-10T08:48:27.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.867+0000 7f61ebe00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f61ec06cd30 con 0x7f61ec0d0d90 2024-09-10T08:48:27.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.868+0000 7f61ea000640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f61ec15e7a0 0x7f61ec06d4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41788/0 (socket says 172.21.15.2:41788) 2024-09-10T08:48:27.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.868+0000 7f61ea000640 1 -- 172.21.15.2:0/3522580369 learned_addr learned my addr 172.21.15.2:0/3522580369 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:48:27.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.868+0000 7f61eaa00640 1 --2- 172.21.15.2:0/3522580369 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61ec0d0d90 0x7f61ec0d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:27.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.868+0000 7f61e9600640 1 -- 172.21.15.2:0/3522580369 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1868791024 0 0) 0x7f61ec0d16b0 con 0x7f61ec15e7a0 2024-09-10T08:48:27.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.868+0000 7f61e9600640 1 -- 172.21.15.2:0/3522580369 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61d0003520 con 0x7f61ec15e7a0 2024-09-10T08:48:27.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.868+0000 7f61e9600640 1 -- 172.21.15.2:0/3522580369 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3355017003 0 0) 0x7f61ec0d0330 con 0x7f61ec0d4b00 2024-09-10T08:48:27.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.868+0000 7f61e9600640 1 -- 172.21.15.2:0/3522580369 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61ec0d16b0 con 0x7f61ec0d4b00 2024-09-10T08:48:27.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.868+0000 7f61eaa00640 1 -- 172.21.15.2:0/3522580369 >> v1:172.21.15.155:6789/0 conn(0x7f61ec0d4b00 legacy=0x7f61ec06dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:27.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.868+0000 7f61eaa00640 1 -- 172.21.15.2:0/3522580369 >> v1:172.21.15.2:6789/0 conn(0x7f61ec15e7a0 legacy=0x7f61ec06d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:27.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.868+0000 7f61eaa00640 1 -- 172.21.15.2:0/3522580369 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61ec0d0610 con 0x7f61ec0d0d90 2024-09-10T08:48:27.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.869+0000 7f61eaa00640 1 --2- 172.21.15.2:0/3522580369 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61ec0d0d90 0x7f61ec0d1170 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f61dc0097d0 tx=0x7f61dc02a200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=514a3faffe0ed2db server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:27.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.870+0000 7f61e9600640 1 -- 172.21.15.2:0/3522580369 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61dc037070 con 0x7f61ec0d0d90 2024-09-10T08:48:27.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.870+0000 7f61e9600640 1 -- 172.21.15.2:0/3522580369 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61dc032440 con 0x7f61ec0d0d90 2024-09-10T08:48:27.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.870+0000 7f61e9600640 1 -- 172.21.15.2:0/3522580369 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61dc032810 con 0x7f61ec0d0d90 2024-09-10T08:48:27.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.870+0000 7f61ebe00640 1 -- 172.21.15.2:0/3522580369 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61ec0d0d90 msgr2=0x7f61ec0d1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:27.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.870+0000 7f61ebe00640 1 --2- 172.21.15.2:0/3522580369 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61ec0d0d90 0x7f61ec0d1170 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f61dc0097d0 tx=0x7f61dc02a200 comp rx=0 tx=0).stop 2024-09-10T08:48:27.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.870+0000 7f61ebe00640 1 -- 172.21.15.2:0/3522580369 shutdown_connections 2024-09-10T08:48:27.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.870+0000 7f61ebe00640 1 --2- 172.21.15.2:0/3522580369 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61ec0d0d90 0x7f61ec0d1170 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:27.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.870+0000 7f61ebe00640 1 -- 172.21.15.2:0/3522580369 >> 172.21.15.2:0/3522580369 conn(0x7f61ec09d700 msgr2=0x7f61ec0d4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:27.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.870+0000 7f61ebe00640 1 -- 172.21.15.2:0/3522580369 shutdown_connections 2024-09-10T08:48:27.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.870+0000 7f61ebe00640 1 -- 172.21.15.2:0/3522580369 wait complete. 2024-09-10T08:48:27.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.872+0000 7f61ebe00640 1 Processor -- start 2024-09-10T08:48:27.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.872+0000 7f61ebe00640 1 -- start start 2024-09-10T08:48:27.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.873+0000 7f61ebe00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61ec0d0d90 0x7f61ec150c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:27.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.873+0000 7f61ebe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61ec0d4b00 0x7f61ec0b99d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:27.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.873+0000 7f61ebe00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61ec15e7a0 0x7f61ec0cec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:27.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.873+0000 7f61ebe00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f61ec0cfdc0 con 0x7f61ec0d4b00 2024-09-10T08:48:27.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.873+0000 7f61ebe00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f61ec06cf80 con 0x7f61ec0d0d90 2024-09-10T08:48:27.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.873+0000 7f61ebe00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f61ec0cff40 con 0x7f61ec15e7a0 2024-09-10T08:48:27.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.873+0000 7f61ea000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61ec0d4b00 0x7f61ec0b99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:27.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.873+0000 7f61ea000640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61ec0d4b00 0x7f61ec0b99d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46548/0 (socket says 172.21.15.2:46548) 2024-09-10T08:48:27.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.873+0000 7f61ea000640 1 -- 172.21.15.2:0/3406894505 learned_addr learned my addr 172.21.15.2:0/3406894505 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:27.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.873+0000 7f61eaa00640 1 --2- 172.21.15.2:0/3406894505 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61ec0d0d90 0x7f61ec150c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:27.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.874+0000 7f61eb400640 1 --2- 172.21.15.2:0/3406894505 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61ec15e7a0 0x7f61ec0cec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:27.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.874+0000 7f61ea000640 1 -- 172.21.15.2:0/3406894505 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61ec15e7a0 msgr2=0x7f61ec0cec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:27.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.874+0000 7f61ea000640 1 --2- 172.21.15.2:0/3406894505 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61ec15e7a0 0x7f61ec0cec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:27.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.874+0000 7f61ea000640 1 -- 172.21.15.2:0/3406894505 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61ec0d0d90 msgr2=0x7f61ec150c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:27.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.874+0000 7f61ea000640 1 --2- 172.21.15.2:0/3406894505 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61ec0d0d90 0x7f61ec150c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:27.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.874+0000 7f61ea000640 1 -- 172.21.15.2:0/3406894505 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61ec152b20 con 0x7f61ec0d4b00 2024-09-10T08:48:27.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.874+0000 7f61ea000640 1 --2- 172.21.15.2:0/3406894505 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61ec0d4b00 0x7f61ec0b99d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f61d800c390 tx=0x7f61d800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:27.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.874+0000 7f61e2a00640 1 -- 172.21.15.2:0/3406894505 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d8017070 con 0x7f61ec0d4b00 2024-09-10T08:48:27.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.874+0000 7f61e2a00640 1 -- 172.21.15.2:0/3406894505 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61d8005ce0 con 0x7f61ec0d4b00 2024-09-10T08:48:27.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.874+0000 7f61e2a00640 1 -- 172.21.15.2:0/3406894505 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d80072f0 con 0x7f61ec0d4b00 2024-09-10T08:48:27.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.874+0000 7f61ebe00640 1 -- 172.21.15.2:0/3406894505 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61ec151440 con 0x7f61ec0d4b00 2024-09-10T08:48:27.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.875+0000 7f61ebe00640 1 -- 172.21.15.2:0/3406894505 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61ec151a00 con 0x7f61ec0d4b00 2024-09-10T08:48:27.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.875+0000 7f61ebe00640 1 -- 172.21.15.2:0/3406894505 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f61ec0b38b0 con 0x7f61ec0d4b00 2024-09-10T08:48:27.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.876+0000 7f61e2a00640 1 -- 172.21.15.2:0/3406894505 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 14) ==== 90498+0+0 (secure 0 0 0) 0x7f61d801a070 con 0x7f61ec0d4b00 2024-09-10T08:48:27.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.877+0000 7f61e2a00640 1 --2- 172.21.15.2:0/3406894505 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f61cc06be30 0x7f61cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:27.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.877+0000 7f61e2a00640 1 -- 172.21.15.2:0/3406894505 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5980+0+0 (secure 0 0 0) 0x7f61d808a300 con 0x7f61ec0d4b00 2024-09-10T08:48:27.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.878+0000 7f61e2a00640 1 --2- 172.21.15.2:0/3406894505 >> [v2:172.21.15.155:6802/2107688472,v1:172.21.15.155:6805/2107688472] conn(0x7f61cc072870 0x7f61cc074cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:27.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.878+0000 7f61e2a00640 1 -- 172.21.15.2:0/3406894505 --> [v2:172.21.15.155:6802/2107688472,v1:172.21.15.155:6805/2107688472] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f61d8014ec0 con 0x7f61cc072870 2024-09-10T08:48:27.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.878+0000 7f61e2a00640 1 -- 172.21.15.2:0/3406894505 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f61d8091050 con 0x7f61ec0d4b00 2024-09-10T08:48:27.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.878+0000 7f61eaa00640 1 --2- 172.21.15.2:0/3406894505 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f61cc06be30 0x7f61cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:27.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.878+0000 7f61eb400640 1 --2- 172.21.15.2:0/3406894505 >> [v2:172.21.15.155:6802/2107688472,v1:172.21.15.155:6805/2107688472] conn(0x7f61cc072870 0x7f61cc074cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:27.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.879+0000 7f61eb400640 1 --2- 172.21.15.2:0/3406894505 >> [v2:172.21.15.155:6802/2107688472,v1:172.21.15.155:6805/2107688472] conn(0x7f61cc072870 0x7f61cc074cb0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:27.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.879+0000 7f61eaa00640 1 --2- 172.21.15.2:0/3406894505 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f61cc06be30 0x7f61cc06e2f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f61dc034000 tx=0x7f61dc02e000 comp rx=0 tx=0).ready entity=mgr.4862 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:27.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.880+0000 7f61e2a00640 1 -- 172.21.15.2:0/3406894505 <== osd.5 v2:172.21.15.155:6802/2107688472 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f61d8014ec0 con 0x7f61cc072870 2024-09-10T08:48:27.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.893+0000 7f61ebe00640 1 -- 172.21.15.2:0/3406894505 --> [v2:172.21.15.155:6802/2107688472,v1:172.21.15.155:6805/2107688472] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f61ec0b2430 con 0x7f61cc072870 2024-09-10T08:48:27.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.893+0000 7f61e2a00640 1 -- 172.21.15.2:0/3406894505 <== osd.5 v2:172.21.15.155:6802/2107688472 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f61ec0b2430 con 0x7f61cc072870 2024-09-10T08:48:27.893 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T08:48:27.894 INFO:teuthology.orchestra.run.smithi002.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T08:48:27.894 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T08:48:27.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.894+0000 7f61ebe00640 1 -- 172.21.15.2:0/3406894505 >> [v2:172.21.15.155:6802/2107688472,v1:172.21.15.155:6805/2107688472] conn(0x7f61cc072870 msgr2=0x7f61cc074cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:27.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.894+0000 7f61ebe00640 1 --2- 172.21.15.2:0/3406894505 >> [v2:172.21.15.155:6802/2107688472,v1:172.21.15.155:6805/2107688472] conn(0x7f61cc072870 0x7f61cc074cb0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:27.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.894+0000 7f61ebe00640 1 -- 172.21.15.2:0/3406894505 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f61cc06be30 msgr2=0x7f61cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:27.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.894+0000 7f61ebe00640 1 --2- 172.21.15.2:0/3406894505 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f61cc06be30 0x7f61cc06e2f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f61dc034000 tx=0x7f61dc02e000 comp rx=0 tx=0).stop 2024-09-10T08:48:27.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.894+0000 7f61ebe00640 1 -- 172.21.15.2:0/3406894505 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61ec0d4b00 msgr2=0x7f61ec0b99d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:27.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.894+0000 7f61ebe00640 1 --2- 172.21.15.2:0/3406894505 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61ec0d4b00 0x7f61ec0b99d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f61d800c390 tx=0x7f61d800c850 comp rx=0 tx=0).stop 2024-09-10T08:48:27.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.894+0000 7f61eb400640 1 -- 172.21.15.2:0/3406894505 reap_dead start 2024-09-10T08:48:27.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.894+0000 7f61ebe00640 1 -- 172.21.15.2:0/3406894505 shutdown_connections 2024-09-10T08:48:27.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.894+0000 7f61ebe00640 1 -- 172.21.15.2:0/3406894505 >> 172.21.15.2:0/3406894505 conn(0x7f61ec09d700 msgr2=0x7f61ec0b4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:27.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.894+0000 7f61ebe00640 1 -- 172.21.15.2:0/3406894505 shutdown_connections 2024-09-10T08:48:27.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:27.894+0000 7f61ebe00640 1 -- 172.21.15.2:0/3406894505 wait complete. 2024-09-10T08:48:27.908 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-10T08:48:28.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.066+0000 7f895f200640 1 Processor -- start 2024-09-10T08:48:28.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.067+0000 7f895f200640 1 -- start start 2024-09-10T08:48:28.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.068+0000 7f895f200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f895806f770 0x7f89580cf6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:28.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.068+0000 7f895f200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89580af590 0x7f89580ae150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:28.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.068+0000 7f895f200640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89580ad390 con 0x7f895815b4c0 2024-09-10T08:48:28.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.068+0000 7f895f200640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f89580afa00 con 0x7f895806f770 2024-09-10T08:48:28.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.068+0000 7f895f200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f89580d1130 con 0x7f89580af590 2024-09-10T08:48:28.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.068+0000 7f894fe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f895806f770 0x7f89580cf6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:28.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.068+0000 7f894fe00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f895806f770 0x7f89580cf6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46564/0 (socket says 172.21.15.2:46564) 2024-09-10T08:48:28.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.068+0000 7f894fe00640 1 -- 172.21.15.2:0/1982764841 learned_addr learned my addr 172.21.15.2:0/1982764841 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:28.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.068+0000 7f895d200640 1 --2- 172.21.15.2:0/1982764841 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89580af590 0x7f89580ae150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:28.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.069+0000 7f894fe00640 1 -- 172.21.15.2:0/1982764841 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89580af590 msgr2=0x7f89580ae150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:48:28.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.069+0000 7f894fe00640 1 --2- 172.21.15.2:0/1982764841 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89580af590 0x7f89580ae150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:28.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.069+0000 7f894fe00640 1 -- 172.21.15.2:0/1982764841 >> v1:172.21.15.155:6789/0 conn(0x7f895815b4c0 legacy=0x7f895806f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:28.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.069+0000 7f894fe00640 1 -- 172.21.15.2:0/1982764841 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89580ad670 con 0x7f895806f770 2024-09-10T08:48:28.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.070+0000 7f894fe00640 1 --2- 172.21.15.2:0/1982764841 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f895806f770 0x7f89580cf6d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f8940009870 tx=0x7f894002c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20aa009d6f75292f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:28.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.070+0000 7f8957400640 1 -- 172.21.15.2:0/1982764841 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8940038070 con 0x7f895806f770 2024-09-10T08:48:28.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.070+0000 7f8957400640 1 -- 172.21.15.2:0/1982764841 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8940031710 con 0x7f895806f770 2024-09-10T08:48:28.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.070+0000 7f8957400640 1 -- 172.21.15.2:0/1982764841 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8940031ae0 con 0x7f895806f770 2024-09-10T08:48:28.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.070+0000 7f895f200640 1 -- 172.21.15.2:0/1982764841 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f895806f770 msgr2=0x7f89580cf6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:28.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.070+0000 7f895f200640 1 --2- 172.21.15.2:0/1982764841 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f895806f770 0x7f89580cf6d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f8940009870 tx=0x7f894002c3d0 comp rx=0 tx=0).stop 2024-09-10T08:48:28.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.070+0000 7f895f200640 1 -- 172.21.15.2:0/1982764841 shutdown_connections 2024-09-10T08:48:28.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.070+0000 7f895f200640 1 --2- 172.21.15.2:0/1982764841 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f89580af590 0x7f89580ae150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:28.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.070+0000 7f895f200640 1 --2- 172.21.15.2:0/1982764841 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f895806f770 0x7f89580cf6d0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:28.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.070+0000 7f895f200640 1 -- 172.21.15.2:0/1982764841 >> 172.21.15.2:0/1982764841 conn(0x7f89580d02c0 msgr2=0x7f89580d06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:28.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.071+0000 7f895f200640 1 -- 172.21.15.2:0/1982764841 shutdown_connections 2024-09-10T08:48:28.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.071+0000 7f895f200640 1 -- 172.21.15.2:0/1982764841 wait complete. 2024-09-10T08:48:28.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.072+0000 7f895f200640 1 Processor -- start 2024-09-10T08:48:28.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.072+0000 7f895f200640 1 -- start start 2024-09-10T08:48:28.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.073+0000 7f895f200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f895806f770 0x7f895815eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:28.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.073+0000 7f895f200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f89580af590 0x7f89581485b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:28.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.073+0000 7f895f200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f895815b4c0 0x7f89581f4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:28.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.073+0000 7f895f200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f89580adc30 con 0x7f895806f770 2024-09-10T08:48:28.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.073+0000 7f895f200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f89580ad140 con 0x7f89580af590 2024-09-10T08:48:28.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.073+0000 7f895f200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f8958071ef0 con 0x7f895815b4c0 2024-09-10T08:48:28.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.073+0000 7f8957e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f895806f770 0x7f895815eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:28.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.074+0000 7f8957e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f895806f770 0x7f895815eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46576/0 (socket says 172.21.15.2:46576) 2024-09-10T08:48:28.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.074+0000 7f8957e00640 1 -- 172.21.15.2:0/3113586253 learned_addr learned my addr 172.21.15.2:0/3113586253 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:28.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.074+0000 7f894fe00640 1 --2- 172.21.15.2:0/3113586253 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f89580af590 0x7f89581485b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:28.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.074+0000 7f8957e00640 1 -- 172.21.15.2:0/3113586253 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f895815b4c0 msgr2=0x7f89581f4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:28.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.074+0000 7f895d200640 1 --2- 172.21.15.2:0/3113586253 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f895815b4c0 0x7f89581f4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:28.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.074+0000 7f8957e00640 1 --2- 172.21.15.2:0/3113586253 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f895815b4c0 0x7f89581f4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:28.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.074+0000 7f8957e00640 1 -- 172.21.15.2:0/3113586253 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f89580af590 msgr2=0x7f89581485b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:28.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.074+0000 7f8957e00640 1 --2- 172.21.15.2:0/3113586253 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f89580af590 0x7f89581485b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:28.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.074+0000 7f8957e00640 1 -- 172.21.15.2:0/3113586253 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8958155f90 con 0x7f895806f770 2024-09-10T08:48:28.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.074+0000 7f894fe00640 1 --2- 172.21.15.2:0/3113586253 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f89580af590 0x7f89581485b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:48:28.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.074+0000 7f895d200640 1 --2- 172.21.15.2:0/3113586253 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f895815b4c0 0x7f89581f4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-10T08:48:28.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.074+0000 7f8957e00640 1 --2- 172.21.15.2:0/3113586253 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f895806f770 0x7f895815eaa0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f894800c3c0 tx=0x7f894800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:28.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.074+0000 7f8954c00640 1 -- 172.21.15.2:0/3113586253 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89480052d0 con 0x7f895806f770 2024-09-10T08:48:28.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.074+0000 7f8954c00640 1 -- 172.21.15.2:0/3113586253 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8948005490 con 0x7f895806f770 2024-09-10T08:48:28.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.074+0000 7f8954c00640 1 -- 172.21.15.2:0/3113586253 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8948007260 con 0x7f895806f770 2024-09-10T08:48:28.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.074+0000 7f895f200640 1 -- 172.21.15.2:0/3113586253 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f895815bd00 con 0x7f895806f770 2024-09-10T08:48:28.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.075+0000 7f895f200640 1 -- 172.21.15.2:0/3113586253 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89581539d0 con 0x7f895806f770 2024-09-10T08:48:28.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.076+0000 7f895f200640 1 -- 172.21.15.2:0/3113586253 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89580afea0 con 0x7f895806f770 2024-09-10T08:48:28.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.077+0000 7f8954c00640 1 -- 172.21.15.2:0/3113586253 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 14) ==== 90498+0+0 (secure 0 0 0) 0x7f8948007400 con 0x7f895806f770 2024-09-10T08:48:28.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.077+0000 7f8954c00640 1 --2- 172.21.15.2:0/3113586253 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f893406be60 0x7f893406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:28.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.078+0000 7f8954c00640 1 -- 172.21.15.2:0/3113586253 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5980+0+0 (secure 0 0 0) 0x7f894808a520 con 0x7f895806f770 2024-09-10T08:48:28.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.078+0000 7f894fe00640 1 --2- 172.21.15.2:0/3113586253 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f893406be60 0x7f893406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:28.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.079+0000 7f894fe00640 1 --2- 172.21.15.2:0/3113586253 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f893406be60 0x7f893406e320 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8940035000 tx=0x7f8940008030 comp rx=0 tx=0).ready entity=mgr.4862 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:28.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.082+0000 7f8954c00640 1 -- 172.21.15.2:0/3113586253 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8948058c90 con 0x7f895806f770 2024-09-10T08:48:28.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.267+0000 7f895f200640 1 -- 172.21.15.2:0/3113586253 --> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f8958148af0 con 0x7f893406be60 2024-09-10T08:48:28.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.268+0000 7f8954c00640 1 -- 172.21.15.2:0/3113586253 <== mgr.4862 v2:172.21.15.155:6832/2264044153 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f8958148af0 con 0x7f893406be60 2024-09-10T08:48:28.268 INFO:teuthology.orchestra.run.smithi002.stderr:instructed osd(s) 5 to deep-scrub 2024-09-10T08:48:28.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.270+0000 7f895f200640 1 -- 172.21.15.2:0/3113586253 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f893406be60 msgr2=0x7f893406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:28.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.270+0000 7f895f200640 1 --2- 172.21.15.2:0/3113586253 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f893406be60 0x7f893406e320 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8940035000 tx=0x7f8940008030 comp rx=0 tx=0).stop 2024-09-10T08:48:28.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.270+0000 7f895f200640 1 -- 172.21.15.2:0/3113586253 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f895806f770 msgr2=0x7f895815eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:28.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.270+0000 7f895f200640 1 --2- 172.21.15.2:0/3113586253 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f895806f770 0x7f895815eaa0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f894800c3c0 tx=0x7f894800c880 comp rx=0 tx=0).stop 2024-09-10T08:48:28.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.270+0000 7f895f200640 1 -- 172.21.15.2:0/3113586253 shutdown_connections 2024-09-10T08:48:28.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.270+0000 7f895f200640 1 --2- 172.21.15.2:0/3113586253 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f893406be60 0x7f893406e320 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:28.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.270+0000 7f895f200640 1 --2- 172.21.15.2:0/3113586253 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f895815b4c0 0x7f89581f4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:28.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.270+0000 7f895f200640 1 --2- 172.21.15.2:0/3113586253 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f89580af590 0x7f89581485b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:28.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.270+0000 7f895f200640 1 --2- 172.21.15.2:0/3113586253 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f895806f770 0x7f895815eaa0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:28.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.270+0000 7f895f200640 1 -- 172.21.15.2:0/3113586253 >> 172.21.15.2:0/3113586253 conn(0x7f89580d02c0 msgr2=0x7f89580aeca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:28.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.270+0000 7f895f200640 1 -- 172.21.15.2:0/3113586253 shutdown_connections 2024-09-10T08:48:28.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.270+0000 7f895f200640 1 -- 172.21.15.2:0/3113586253 wait complete. 2024-09-10T08:48:28.286 INFO:tasks.ceph:Scrubbing osd.6 2024-09-10T08:48:28.286 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-10T08:48:28.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.447+0000 7f5572a00640 1 Processor -- start 2024-09-10T08:48:28.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.447+0000 7f5572a00640 1 -- start start 2024-09-10T08:48:28.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.448+0000 7f5572a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f556c15e940 0x7f556c0d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:28.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.448+0000 7f5572a00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f556c0cde30 0x7f556c0cc050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:28.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.448+0000 7f5572a00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f556c0b0b80 con 0x7f556c0d0b50 2024-09-10T08:48:28.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.448+0000 7f5572a00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f556c0ce450 con 0x7f556c0cde30 2024-09-10T08:48:28.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.448+0000 7f5572a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f556c0ce730 con 0x7f556c15e940 2024-09-10T08:48:28.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.449+0000 7f5570a00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f556c0cde30 0x7f556c0cc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:28.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.449+0000 7f556be00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f556c15e940 0x7f556c0d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:28.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.449+0000 7f556be00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f556c15e940 0x7f556c0d0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.2:53700/0 (socket says 172.21.15.2:53700) 2024-09-10T08:48:28.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.449+0000 7f556be00640 1 -- 172.21.15.2:0/2879261387 learned_addr learned my addr 172.21.15.2:0/2879261387 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:28.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.449+0000 7f556be00640 1 -- 172.21.15.2:0/2879261387 >> v2:172.21.15.155:3300/0 conn(0x7f556c0cde30 msgr2=0x7f556c0cc050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:48:28.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.449+0000 7f556be00640 1 --2- 172.21.15.2:0/2879261387 >> v2:172.21.15.155:3300/0 conn(0x7f556c0cde30 0x7f556c0cc050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:28.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.449+0000 7f556be00640 1 -- 172.21.15.2:0/2879261387 >> v1:172.21.15.155:6789/0 conn(0x7f556c0d0b50 legacy=0x7f556c0cd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:28.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.449+0000 7f556be00640 1 -- 172.21.15.2:0/2879261387 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f556c0cea10 con 0x7f556c15e940 2024-09-10T08:48:28.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.449+0000 7f5570a00640 1 --2- 172.21.15.2:0/2879261387 >> v2:172.21.15.155:3300/0 conn(0x7f556c0cde30 0x7f556c0cc050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:48:28.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.450+0000 7f556be00640 1 --2- 172.21.15.2:0/2879261387 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f556c15e940 0x7f556c0d0610 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f555c009870 tx=0x7f555c02a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4bf2765a86a7da29 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:28.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.451+0000 7f556b400640 1 -- 172.21.15.2:0/2879261387 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f555c037070 con 0x7f556c15e940 2024-09-10T08:48:28.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.451+0000 7f556b400640 1 -- 172.21.15.2:0/2879261387 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f555c032440 con 0x7f556c15e940 2024-09-10T08:48:28.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.451+0000 7f556b400640 1 -- 172.21.15.2:0/2879261387 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f555c032810 con 0x7f556c15e940 2024-09-10T08:48:28.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.451+0000 7f5572a00640 1 -- 172.21.15.2:0/2879261387 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f556c15e940 msgr2=0x7f556c0d0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:28.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.451+0000 7f5572a00640 1 --2- 172.21.15.2:0/2879261387 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f556c15e940 0x7f556c0d0610 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f555c009870 tx=0x7f555c02a1c0 comp rx=0 tx=0).stop 2024-09-10T08:48:28.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.451+0000 7f5572a00640 1 -- 172.21.15.2:0/2879261387 shutdown_connections 2024-09-10T08:48:28.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.451+0000 7f5572a00640 1 --2- 172.21.15.2:0/2879261387 >> v2:172.21.15.155:3300/0 conn(0x7f556c0cde30 0x7f556c0cc050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:28.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.451+0000 7f5572a00640 1 --2- 172.21.15.2:0/2879261387 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f556c15e940 0x7f556c0d0610 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:28.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.451+0000 7f5572a00640 1 -- 172.21.15.2:0/2879261387 >> 172.21.15.2:0/2879261387 conn(0x7f556c09aa40 msgr2=0x7f556c0b2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:28.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.451+0000 7f5572a00640 1 -- 172.21.15.2:0/2879261387 shutdown_connections 2024-09-10T08:48:28.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.451+0000 7f5572a00640 1 -- 172.21.15.2:0/2879261387 wait complete. 2024-09-10T08:48:28.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.453+0000 7f5572a00640 1 Processor -- start 2024-09-10T08:48:28.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.453+0000 7f5572a00640 1 -- start start 2024-09-10T08:48:28.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.454+0000 7f5572a00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f556c0cde30 0x7f556c162950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:28.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.454+0000 7f5572a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f556c0d0b50 0x7f556c0cad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:28.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.454+0000 7f5572a00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f556c15e940 0x7f556c0c5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:28.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.454+0000 7f5572a00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f556c15ed20 con 0x7f556c0d0b50 2024-09-10T08:48:28.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.454+0000 7f5572a00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f556c0d0f90 con 0x7f556c0cde30 2024-09-10T08:48:28.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.454+0000 7f5572a00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f556c0c6450 con 0x7f556c15e940 2024-09-10T08:48:28.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.454+0000 7f5563e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f556c0d0b50 0x7f556c0cad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:28.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.454+0000 7f5563e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f556c0d0b50 0x7f556c0cad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46592/0 (socket says 172.21.15.2:46592) 2024-09-10T08:48:28.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.454+0000 7f5563e00640 1 -- 172.21.15.2:0/1066531894 learned_addr learned my addr 172.21.15.2:0/1066531894 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:28.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.454+0000 7f556be00640 1 --2- 172.21.15.2:0/1066531894 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f556c0cde30 0x7f556c162950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:28.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.455+0000 7f5570a00640 1 --2- 172.21.15.2:0/1066531894 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f556c15e940 0x7f556c0c5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:28.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.455+0000 7f5563e00640 1 -- 172.21.15.2:0/1066531894 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f556c15e940 msgr2=0x7f556c0c5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:28.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.455+0000 7f5563e00640 1 --2- 172.21.15.2:0/1066531894 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f556c15e940 0x7f556c0c5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:28.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.455+0000 7f5563e00640 1 -- 172.21.15.2:0/1066531894 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f556c0cde30 msgr2=0x7f556c162950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:28.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.455+0000 7f5563e00640 1 --2- 172.21.15.2:0/1066531894 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f556c0cde30 0x7f556c162950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:28.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.455+0000 7f5563e00640 1 -- 172.21.15.2:0/1066531894 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f556c0c97b0 con 0x7f556c0d0b50 2024-09-10T08:48:28.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.455+0000 7f5563e00640 1 --2- 172.21.15.2:0/1066531894 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f556c0d0b50 0x7f556c0cad10 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f555400c440 tx=0x7f555400c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:28.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.455+0000 7f5568c00640 1 -- 172.21.15.2:0/1066531894 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55540052d0 con 0x7f556c0d0b50 2024-09-10T08:48:28.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.455+0000 7f5568c00640 1 -- 172.21.15.2:0/1066531894 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5554005470 con 0x7f556c0d0b50 2024-09-10T08:48:28.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.455+0000 7f5568c00640 1 -- 172.21.15.2:0/1066531894 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5554007260 con 0x7f556c0d0b50 2024-09-10T08:48:28.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.455+0000 7f5572a00640 1 -- 172.21.15.2:0/1066531894 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f556c0c9f50 con 0x7f556c0d0b50 2024-09-10T08:48:28.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.456+0000 7f5572a00640 1 -- 172.21.15.2:0/1066531894 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f556c0ca510 con 0x7f556c0d0b50 2024-09-10T08:48:28.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.456+0000 7f5572a00640 1 -- 172.21.15.2:0/1066531894 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f556c0ca8f0 con 0x7f556c0d0b50 2024-09-10T08:48:28.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.457+0000 7f5568c00640 1 -- 172.21.15.2:0/1066531894 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 14) ==== 90498+0+0 (secure 0 0 0) 0x7f55540074c0 con 0x7f556c0d0b50 2024-09-10T08:48:28.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.458+0000 7f5568c00640 1 --2- 172.21.15.2:0/1066531894 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f554806be30 0x7f554806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:28.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.458+0000 7f5568c00640 1 -- 172.21.15.2:0/1066531894 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5980+0+0 (secure 0 0 0) 0x7f555408a270 con 0x7f556c0d0b50 2024-09-10T08:48:28.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.459+0000 7f5568c00640 1 --2- 172.21.15.2:0/1066531894 >> [v2:172.21.15.155:6824/944542383,v1:172.21.15.155:6825/944542383] conn(0x7f5548072870 0x7f5548074cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:28.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.459+0000 7f5568c00640 1 -- 172.21.15.2:0/1066531894 --> [v2:172.21.15.155:6824/944542383,v1:172.21.15.155:6825/944542383] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5554009e50 con 0x7f5548072870 2024-09-10T08:48:28.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.459+0000 7f5568c00640 1 -- 172.21.15.2:0/1066531894 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f5554091050 con 0x7f556c0d0b50 2024-09-10T08:48:28.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.459+0000 7f556be00640 1 --2- 172.21.15.2:0/1066531894 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f554806be30 0x7f554806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:28.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.459+0000 7f5570a00640 1 --2- 172.21.15.2:0/1066531894 >> [v2:172.21.15.155:6824/944542383,v1:172.21.15.155:6825/944542383] conn(0x7f5548072870 0x7f5548074cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:28.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.460+0000 7f556be00640 1 --2- 172.21.15.2:0/1066531894 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f554806be30 0x7f554806e2f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f555c034000 tx=0x7f555c02e000 comp rx=0 tx=0).ready entity=mgr.4862 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:28.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.460+0000 7f5570a00640 1 --2- 172.21.15.2:0/1066531894 >> [v2:172.21.15.155:6824/944542383,v1:172.21.15.155:6825/944542383] conn(0x7f5548072870 0x7f5548074cb0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:28.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.461+0000 7f5568c00640 1 -- 172.21.15.2:0/1066531894 <== osd.6 v2:172.21.15.155:6824/944542383 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5554009e50 con 0x7f5548072870 2024-09-10T08:48:28.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.474+0000 7f5572a00640 1 -- 172.21.15.2:0/1066531894 --> [v2:172.21.15.155:6824/944542383,v1:172.21.15.155:6825/944542383] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f556c0cb4a0 con 0x7f5548072870 2024-09-10T08:48:28.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.475+0000 7f5568c00640 1 -- 172.21.15.2:0/1066531894 <== osd.6 v2:172.21.15.155:6824/944542383 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f556c0cb4a0 con 0x7f5548072870 2024-09-10T08:48:28.475 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T08:48:28.475 INFO:teuthology.orchestra.run.smithi002.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T08:48:28.475 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T08:48:28.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.475+0000 7f5572a00640 1 -- 172.21.15.2:0/1066531894 >> [v2:172.21.15.155:6824/944542383,v1:172.21.15.155:6825/944542383] conn(0x7f5548072870 msgr2=0x7f5548074cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:28.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.475+0000 7f5572a00640 1 --2- 172.21.15.2:0/1066531894 >> [v2:172.21.15.155:6824/944542383,v1:172.21.15.155:6825/944542383] conn(0x7f5548072870 0x7f5548074cb0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:28.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.475+0000 7f5572a00640 1 -- 172.21.15.2:0/1066531894 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f554806be30 msgr2=0x7f554806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:28.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.475+0000 7f5572a00640 1 --2- 172.21.15.2:0/1066531894 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f554806be30 0x7f554806e2f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f555c034000 tx=0x7f555c02e000 comp rx=0 tx=0).stop 2024-09-10T08:48:28.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.475+0000 7f5572a00640 1 -- 172.21.15.2:0/1066531894 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f556c0d0b50 msgr2=0x7f556c0cad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:28.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.475+0000 7f5572a00640 1 --2- 172.21.15.2:0/1066531894 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f556c0d0b50 0x7f556c0cad10 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f555400c440 tx=0x7f555400c840 comp rx=0 tx=0).stop 2024-09-10T08:48:28.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.475+0000 7f5570a00640 1 -- 172.21.15.2:0/1066531894 reap_dead start 2024-09-10T08:48:28.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.475+0000 7f5572a00640 1 -- 172.21.15.2:0/1066531894 shutdown_connections 2024-09-10T08:48:28.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.475+0000 7f5572a00640 1 -- 172.21.15.2:0/1066531894 >> 172.21.15.2:0/1066531894 conn(0x7f556c09aa40 msgr2=0x7f556c0ae250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:28.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.475+0000 7f5572a00640 1 -- 172.21.15.2:0/1066531894 shutdown_connections 2024-09-10T08:48:28.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.475+0000 7f5572a00640 1 -- 172.21.15.2:0/1066531894 wait complete. 2024-09-10T08:48:28.491 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-10T08:48:28.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.646+0000 7f3932800640 1 Processor -- start 2024-09-10T08:48:28.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.647+0000 7f3932800640 1 -- start start 2024-09-10T08:48:28.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.648+0000 7f3932800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f392c15e6a0 0x7f392c0d01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:28.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.648+0000 7f3932800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f392c09b150 0x7f392c168510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:28.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.648+0000 7f3932800640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f392c0cda20 con 0x7f392c06eb00 2024-09-10T08:48:28.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.648+0000 7f3932800640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f392c0ce630 con 0x7f392c09b150 2024-09-10T08:48:28.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.648+0000 7f3932800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f392c0cdd00 con 0x7f392c15e6a0 2024-09-10T08:48:28.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.648+0000 7f3922a00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f392c06eb00 0x7f392c09aa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41804/0 (socket says 172.21.15.2:41804) 2024-09-10T08:48:28.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.648+0000 7f3922a00640 1 -- 172.21.15.2:0/3312776902 learned_addr learned my addr 172.21.15.2:0/3312776902 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:48:28.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.648+0000 7f392be00640 1 --2- 172.21.15.2:0/3312776902 >> v2:172.21.15.2:3300/0 conn(0x7f392c09b150 0x7f392c168510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:28.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.648+0000 7f392b400640 1 --2- 172.21.15.2:0/3312776902 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f392c15e6a0 0x7f392c0d01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:28.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.649+0000 7f392aa00640 1 -- 172.21.15.2:0/3312776902 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 122558518 0 0) 0x7f392c0cda20 con 0x7f392c06eb00 2024-09-10T08:48:28.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.649+0000 7f392aa00640 1 -- 172.21.15.2:0/3312776902 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3910003520 con 0x7f392c06eb00 2024-09-10T08:48:28.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.649+0000 7f392be00640 1 -- 172.21.15.2:0/3312776902 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f392c15e6a0 msgr2=0x7f392c0d01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:48:28.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.649+0000 7f392be00640 1 --2- 172.21.15.2:0/3312776902 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f392c15e6a0 0x7f392c0d01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:28.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.649+0000 7f392be00640 1 -- 172.21.15.2:0/3312776902 >> v1:172.21.15.2:6789/0 conn(0x7f392c06eb00 legacy=0x7f392c09aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:28.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.649+0000 7f392be00640 1 -- 172.21.15.2:0/3312776902 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f392c0cdfe0 con 0x7f392c09b150 2024-09-10T08:48:28.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.650+0000 7f392be00640 1 --2- 172.21.15.2:0/3312776902 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f392c09b150 0x7f392c168510 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f3924009d90 tx=0x7f392402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34df0435679f517f server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:28.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.650+0000 7f392aa00640 1 -- 172.21.15.2:0/3312776902 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3924007740 con 0x7f392c09b150 2024-09-10T08:48:28.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.650+0000 7f392aa00640 1 -- 172.21.15.2:0/3312776902 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39240078e0 con 0x7f392c09b150 2024-09-10T08:48:28.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.650+0000 7f392aa00640 1 -- 172.21.15.2:0/3312776902 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3924007cb0 con 0x7f392c09b150 2024-09-10T08:48:28.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.651+0000 7f3932800640 1 -- 172.21.15.2:0/3312776902 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f392c09b150 msgr2=0x7f392c168510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:28.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.651+0000 7f3932800640 1 --2- 172.21.15.2:0/3312776902 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f392c09b150 0x7f392c168510 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f3924009d90 tx=0x7f392402a660 comp rx=0 tx=0).stop 2024-09-10T08:48:28.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.651+0000 7f3932800640 1 -- 172.21.15.2:0/3312776902 shutdown_connections 2024-09-10T08:48:28.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.651+0000 7f3932800640 1 --2- 172.21.15.2:0/3312776902 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f392c09b150 0x7f392c168510 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:28.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.651+0000 7f3932800640 1 --2- 172.21.15.2:0/3312776902 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f392c15e6a0 0x7f392c0d01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:28.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.651+0000 7f3932800640 1 -- 172.21.15.2:0/3312776902 >> 172.21.15.2:0/3312776902 conn(0x7f392c0b3ed0 msgr2=0x7f392c0b42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:28.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.651+0000 7f3932800640 1 -- 172.21.15.2:0/3312776902 shutdown_connections 2024-09-10T08:48:28.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.651+0000 7f3932800640 1 -- 172.21.15.2:0/3312776902 wait complete. 2024-09-10T08:48:28.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.653+0000 7f3932800640 1 Processor -- start 2024-09-10T08:48:28.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.653+0000 7f3932800640 1 -- start start 2024-09-10T08:48:28.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.654+0000 7f3932800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f392c06eb00 0x7f392c15b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:28.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.654+0000 7f3932800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f392c09b150 0x7f392c0cc180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:28.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.654+0000 7f3932800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f392c15e6a0 0x7f392c09dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:28.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.654+0000 7f3932800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f392c0d0720 con 0x7f392c15e6a0 2024-09-10T08:48:28.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.654+0000 7f3932800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f392c15ea80 con 0x7f392c06eb00 2024-09-10T08:48:28.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.654+0000 7f3932800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f392c0d08a0 con 0x7f392c09b150 2024-09-10T08:48:28.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.654+0000 7f392be00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f392c15e6a0 0x7f392c09dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:28.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.654+0000 7f392be00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f392c15e6a0 0x7f392c09dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46616/0 (socket says 172.21.15.2:46616) 2024-09-10T08:48:28.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.654+0000 7f392be00640 1 -- 172.21.15.2:0/536604386 learned_addr learned my addr 172.21.15.2:0/536604386 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:28.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.654+0000 7f3922a00640 1 --2- 172.21.15.2:0/536604386 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f392c09b150 0x7f392c0cc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:28.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.654+0000 7f392b400640 1 --2- 172.21.15.2:0/536604386 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f392c06eb00 0x7f392c15b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:28.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.654+0000 7f392be00640 1 -- 172.21.15.2:0/536604386 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f392c09b150 msgr2=0x7f392c0cc180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:28.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.654+0000 7f392be00640 1 --2- 172.21.15.2:0/536604386 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f392c09b150 0x7f392c0cc180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:28.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.654+0000 7f392be00640 1 -- 172.21.15.2:0/536604386 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f392c06eb00 msgr2=0x7f392c15b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:28.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.654+0000 7f392be00640 1 --2- 172.21.15.2:0/536604386 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f392c06eb00 0x7f392c15b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:28.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.654+0000 7f392be00640 1 -- 172.21.15.2:0/536604386 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f392c14c860 con 0x7f392c15e6a0 2024-09-10T08:48:28.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.655+0000 7f392be00640 1 --2- 172.21.15.2:0/536604386 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f392c15e6a0 0x7f392c09dbc0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f3924009eb0 tx=0x7f3924004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:28.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.655+0000 7f3923e00640 1 -- 172.21.15.2:0/536604386 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3924040070 con 0x7f392c15e6a0 2024-09-10T08:48:28.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.655+0000 7f3923e00640 1 -- 172.21.15.2:0/536604386 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3924031bc0 con 0x7f392c15e6a0 2024-09-10T08:48:28.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.655+0000 7f3923e00640 1 -- 172.21.15.2:0/536604386 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3924009450 con 0x7f392c15e6a0 2024-09-10T08:48:28.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.655+0000 7f3932800640 1 -- 172.21.15.2:0/536604386 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f392c14cb40 con 0x7f392c15e6a0 2024-09-10T08:48:28.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.655+0000 7f3932800640 1 -- 172.21.15.2:0/536604386 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f392c14d100 con 0x7f392c15e6a0 2024-09-10T08:48:28.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.656+0000 7f3932800640 1 -- 172.21.15.2:0/536604386 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f392c14c340 con 0x7f392c15e6a0 2024-09-10T08:48:28.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.657+0000 7f3923e00640 1 -- 172.21.15.2:0/536604386 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 14) ==== 90498+0+0 (secure 0 0 0) 0x7f3924039040 con 0x7f392c15e6a0 2024-09-10T08:48:28.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.658+0000 7f3923e00640 1 --2- 172.21.15.2:0/536604386 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f390806be60 0x7f390806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:28.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.659+0000 7f3923e00640 1 -- 172.21.15.2:0/536604386 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5980+0+0 (secure 0 0 0) 0x7f39240ac700 con 0x7f392c15e6a0 2024-09-10T08:48:28.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.659+0000 7f392b400640 1 --2- 172.21.15.2:0/536604386 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f390806be60 0x7f390806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:28.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.660+0000 7f392b400640 1 --2- 172.21.15.2:0/536604386 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f390806be60 0x7f390806e320 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f391c009aa0 tx=0x7f391c009190 comp rx=0 tx=0).ready entity=mgr.4862 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:28.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.663+0000 7f3923e00640 1 -- 172.21.15.2:0/536604386 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f392407a9d0 con 0x7f392c15e6a0 2024-09-10T08:48:28.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.846+0000 7f3932800640 1 -- 172.21.15.2:0/536604386 --> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f392c0cd4b0 con 0x7f390806be60 2024-09-10T08:48:28.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.847+0000 7f3923e00640 1 -- 172.21.15.2:0/536604386 <== mgr.4862 v2:172.21.15.155:6832/2264044153 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f392c0cd4b0 con 0x7f390806be60 2024-09-10T08:48:28.847 INFO:teuthology.orchestra.run.smithi002.stderr:instructed osd(s) 6 to deep-scrub 2024-09-10T08:48:28.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.849+0000 7f3932800640 1 -- 172.21.15.2:0/536604386 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f390806be60 msgr2=0x7f390806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:28.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.849+0000 7f3932800640 1 --2- 172.21.15.2:0/536604386 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f390806be60 0x7f390806e320 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f391c009aa0 tx=0x7f391c009190 comp rx=0 tx=0).stop 2024-09-10T08:48:28.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.849+0000 7f3932800640 1 -- 172.21.15.2:0/536604386 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f392c15e6a0 msgr2=0x7f392c09dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:28.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.849+0000 7f3932800640 1 --2- 172.21.15.2:0/536604386 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f392c15e6a0 0x7f392c09dbc0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f3924009eb0 tx=0x7f3924004a40 comp rx=0 tx=0).stop 2024-09-10T08:48:28.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.849+0000 7f3932800640 1 -- 172.21.15.2:0/536604386 shutdown_connections 2024-09-10T08:48:28.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.849+0000 7f3932800640 1 --2- 172.21.15.2:0/536604386 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f390806be60 0x7f390806e320 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:28.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.849+0000 7f3932800640 1 --2- 172.21.15.2:0/536604386 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f392c15e6a0 0x7f392c09dbc0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:28.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.849+0000 7f3932800640 1 --2- 172.21.15.2:0/536604386 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f392c09b150 0x7f392c0cc180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:28.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.849+0000 7f3932800640 1 --2- 172.21.15.2:0/536604386 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f392c06eb00 0x7f392c15b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:28.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.849+0000 7f3932800640 1 -- 172.21.15.2:0/536604386 >> 172.21.15.2:0/536604386 conn(0x7f392c0b3ed0 msgr2=0x7f392c15d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:28.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.850+0000 7f3932800640 1 -- 172.21.15.2:0/536604386 shutdown_connections 2024-09-10T08:48:28.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:28.850+0000 7f3932800640 1 -- 172.21.15.2:0/536604386 wait complete. 2024-09-10T08:48:28.865 INFO:tasks.ceph:Scrubbing osd.7 2024-09-10T08:48:28.865 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-10T08:48:29.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.026+0000 7f784a400640 1 Processor -- start 2024-09-10T08:48:29.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.026+0000 7f784a400640 1 -- start start 2024-09-10T08:48:29.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.027+0000 7f784a400640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f78440d0d90 0x7f78440d1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:29.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.027+0000 7f784a400640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78440d16b0 con 0x7f784415e7a0 2024-09-10T08:48:29.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.027+0000 7f784a400640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78440d0330 con 0x7f78440d4b00 2024-09-10T08:48:29.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.027+0000 7f784a400640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f784406cd30 con 0x7f78440d0d90 2024-09-10T08:48:29.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.027+0000 7f7843e00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f784415e7a0 0x7f784406d4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41814/0 (socket says 172.21.15.2:41814) 2024-09-10T08:48:29.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.027+0000 7f7843e00640 1 -- 172.21.15.2:0/2105352365 learned_addr learned my addr 172.21.15.2:0/2105352365 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:48:29.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.028+0000 7f7849000640 1 --2- 172.21.15.2:0/2105352365 >> v2:172.21.15.155:3300/0 conn(0x7f78440d0d90 0x7f78440d1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:29.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.028+0000 7f7843400640 1 -- 172.21.15.2:0/2105352365 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4282654691 0 0) 0x7f78440d16b0 con 0x7f784415e7a0 2024-09-10T08:48:29.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.028+0000 7f7843400640 1 -- 172.21.15.2:0/2105352365 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f782c003520 con 0x7f784415e7a0 2024-09-10T08:48:29.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.028+0000 7f7849000640 1 -- 172.21.15.2:0/2105352365 >> v1:172.21.15.155:6789/0 conn(0x7f78440d4b00 legacy=0x7f784406dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:29.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.028+0000 7f7843400640 1 -- 172.21.15.2:0/2105352365 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3999050238 0 0) 0x7f78440d0330 con 0x7f78440d4b00 2024-09-10T08:48:29.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.028+0000 7f7849000640 1 -- 172.21.15.2:0/2105352365 >> v1:172.21.15.2:6789/0 conn(0x7f784415e7a0 legacy=0x7f784406d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:29.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.028+0000 7f7849000640 1 -- 172.21.15.2:0/2105352365 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78440d0610 con 0x7f78440d0d90 2024-09-10T08:48:29.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.029+0000 7f7849000640 1 --2- 172.21.15.2:0/2105352365 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78440d0d90 0x7f78440d1170 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f78380097a0 tx=0x7f783802a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6dc37190bd9d7e1a server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:29.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.029+0000 7f7843400640 1 -- 172.21.15.2:0/2105352365 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7838037070 con 0x7f78440d0d90 2024-09-10T08:48:29.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.029+0000 7f7843400640 1 -- 172.21.15.2:0/2105352365 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7838032440 con 0x7f78440d0d90 2024-09-10T08:48:29.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.029+0000 7f7843400640 1 -- 172.21.15.2:0/2105352365 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7838032810 con 0x7f78440d0d90 2024-09-10T08:48:29.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.030+0000 7f784a400640 1 -- 172.21.15.2:0/2105352365 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78440d0d90 msgr2=0x7f78440d1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:29.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.030+0000 7f784a400640 1 --2- 172.21.15.2:0/2105352365 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78440d0d90 0x7f78440d1170 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f78380097a0 tx=0x7f783802a230 comp rx=0 tx=0).stop 2024-09-10T08:48:29.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.030+0000 7f784a400640 1 -- 172.21.15.2:0/2105352365 shutdown_connections 2024-09-10T08:48:29.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.030+0000 7f784a400640 1 --2- 172.21.15.2:0/2105352365 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78440d0d90 0x7f78440d1170 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:29.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.030+0000 7f784a400640 1 -- 172.21.15.2:0/2105352365 >> 172.21.15.2:0/2105352365 conn(0x7f784409d700 msgr2=0x7f78440d4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:29.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.030+0000 7f784a400640 1 -- 172.21.15.2:0/2105352365 shutdown_connections 2024-09-10T08:48:29.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.030+0000 7f784a400640 1 -- 172.21.15.2:0/2105352365 wait complete. 2024-09-10T08:48:29.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.032+0000 7f784a400640 1 Processor -- start 2024-09-10T08:48:29.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.032+0000 7f784a400640 1 -- start start 2024-09-10T08:48:29.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.033+0000 7f784a400640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78440d0d90 0x7f78440a15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:29.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.033+0000 7f784a400640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78440d4b00 0x7f78440cef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:29.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.033+0000 7f784a400640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f784415e7a0 0x7f78440cf440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:29.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.033+0000 7f784a400640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f78440cfdc0 con 0x7f784415e7a0 2024-09-10T08:48:29.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.033+0000 7f784a400640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f784406cf80 con 0x7f78440d4b00 2024-09-10T08:48:29.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.033+0000 7f784a400640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f78440cff40 con 0x7f78440d0d90 2024-09-10T08:48:29.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.033+0000 7f7849a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f784415e7a0 0x7f78440cf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:29.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.033+0000 7f7849a00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f784415e7a0 0x7f78440cf440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46632/0 (socket says 172.21.15.2:46632) 2024-09-10T08:48:29.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.033+0000 7f7849a00640 1 -- 172.21.15.2:0/3604279444 learned_addr learned my addr 172.21.15.2:0/3604279444 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:29.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.033+0000 7f7849000640 1 --2- 172.21.15.2:0/3604279444 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78440d0d90 0x7f78440a15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:29.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.033+0000 7f7843e00640 1 --2- 172.21.15.2:0/3604279444 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78440d4b00 0x7f78440cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:29.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.033+0000 7f7849a00640 1 -- 172.21.15.2:0/3604279444 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78440d0d90 msgr2=0x7f78440a15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:29.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.033+0000 7f7849a00640 1 --2- 172.21.15.2:0/3604279444 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78440d0d90 0x7f78440a15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:29.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.033+0000 7f7849a00640 1 -- 172.21.15.2:0/3604279444 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78440d4b00 msgr2=0x7f78440cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:29.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.033+0000 7f7849a00640 1 --2- 172.21.15.2:0/3604279444 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78440d4b00 0x7f78440cef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:29.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.033+0000 7f7849a00640 1 -- 172.21.15.2:0/3604279444 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78440ce440 con 0x7f784415e7a0 2024-09-10T08:48:29.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.033+0000 7f7849000640 1 --2- 172.21.15.2:0/3604279444 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f78440d0d90 0x7f78440a15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:48:29.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.033+0000 7f7843e00640 1 --2- 172.21.15.2:0/3604279444 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f78440d4b00 0x7f78440cef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:48:29.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.034+0000 7f7849a00640 1 --2- 172.21.15.2:0/3604279444 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f784415e7a0 0x7f78440cf440 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f783c00c790 tx=0x7f783c00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:29.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.034+0000 7f7840c00640 1 -- 172.21.15.2:0/3604279444 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f783c003da0 con 0x7f784415e7a0 2024-09-10T08:48:29.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.034+0000 7f7840c00640 1 -- 172.21.15.2:0/3604279444 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f783c005070 con 0x7f784415e7a0 2024-09-10T08:48:29.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.034+0000 7f784a400640 1 -- 172.21.15.2:0/3604279444 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78440ce160 con 0x7f784415e7a0 2024-09-10T08:48:29.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.034+0000 7f7840c00640 1 -- 172.21.15.2:0/3604279444 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f783c005460 con 0x7f784415e7a0 2024-09-10T08:48:29.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.034+0000 7f784a400640 1 -- 172.21.15.2:0/3604279444 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78440c8530 con 0x7f784415e7a0 2024-09-10T08:48:29.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.035+0000 7f784a400640 1 -- 172.21.15.2:0/3604279444 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f78440c8910 con 0x7f784415e7a0 2024-09-10T08:48:29.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.036+0000 7f7840c00640 1 -- 172.21.15.2:0/3604279444 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 14) ==== 90498+0+0 (secure 0 0 0) 0x7f783c005600 con 0x7f784415e7a0 2024-09-10T08:48:29.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.037+0000 7f7840c00640 1 --2- 172.21.15.2:0/3604279444 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f782406be30 0x7f782406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:29.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.037+0000 7f7840c00640 1 -- 172.21.15.2:0/3604279444 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5980+0+0 (secure 0 0 0) 0x7f783c08afb0 con 0x7f784415e7a0 2024-09-10T08:48:29.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.037+0000 7f7840c00640 1 --2- 172.21.15.2:0/3604279444 >> [v2:172.21.15.155:6800/2220093913,v1:172.21.15.155:6801/2220093913] conn(0x7f7824072870 0x7f7824074cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:29.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.037+0000 7f7840c00640 1 -- 172.21.15.2:0/3604279444 --> [v2:172.21.15.155:6800/2220093913,v1:172.21.15.155:6801/2220093913] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7824075380 con 0x7f7824072870 2024-09-10T08:48:29.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.038+0000 7f7840c00640 1 -- 172.21.15.2:0/3604279444 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f783c08d5d0 con 0x7f784415e7a0 2024-09-10T08:48:29.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.038+0000 7f7849000640 1 --2- 172.21.15.2:0/3604279444 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f782406be30 0x7f782406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:29.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.038+0000 7f7843e00640 1 --2- 172.21.15.2:0/3604279444 >> [v2:172.21.15.155:6800/2220093913,v1:172.21.15.155:6801/2220093913] conn(0x7f7824072870 0x7f7824074cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:29.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.038+0000 7f7849000640 1 --2- 172.21.15.2:0/3604279444 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f782406be30 0x7f782406e2f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7838034000 tx=0x7f783802e000 comp rx=0 tx=0).ready entity=mgr.4862 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:29.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.039+0000 7f7843e00640 1 --2- 172.21.15.2:0/3604279444 >> [v2:172.21.15.155:6800/2220093913,v1:172.21.15.155:6801/2220093913] conn(0x7f7824072870 0x7f7824074cb0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:29.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.039+0000 7f7840c00640 1 -- 172.21.15.2:0/3604279444 <== osd.7 v2:172.21.15.155:6800/2220093913 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7824075380 con 0x7f7824072870 2024-09-10T08:48:29.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.053+0000 7f784a400640 1 -- 172.21.15.2:0/3604279444 --> [v2:172.21.15.155:6800/2220093913,v1:172.21.15.155:6801/2220093913] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f78440b38b0 con 0x7f7824072870 2024-09-10T08:48:29.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.053+0000 7f7840c00640 1 -- 172.21.15.2:0/3604279444 <== osd.7 v2:172.21.15.155:6800/2220093913 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f78440b38b0 con 0x7f7824072870 2024-09-10T08:48:29.054 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-10T08:48:29.054 INFO:teuthology.orchestra.run.smithi002.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T08:48:29.054 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-10T08:48:29.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.054+0000 7f784a400640 1 -- 172.21.15.2:0/3604279444 >> [v2:172.21.15.155:6800/2220093913,v1:172.21.15.155:6801/2220093913] conn(0x7f7824072870 msgr2=0x7f7824074cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:29.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.054+0000 7f784a400640 1 --2- 172.21.15.2:0/3604279444 >> [v2:172.21.15.155:6800/2220093913,v1:172.21.15.155:6801/2220093913] conn(0x7f7824072870 0x7f7824074cb0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:29.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.054+0000 7f784a400640 1 -- 172.21.15.2:0/3604279444 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f782406be30 msgr2=0x7f782406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:29.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.054+0000 7f784a400640 1 --2- 172.21.15.2:0/3604279444 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f782406be30 0x7f782406e2f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7838034000 tx=0x7f783802e000 comp rx=0 tx=0).stop 2024-09-10T08:48:29.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.054+0000 7f784a400640 1 -- 172.21.15.2:0/3604279444 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f784415e7a0 msgr2=0x7f78440cf440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:29.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.054+0000 7f784a400640 1 --2- 172.21.15.2:0/3604279444 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f784415e7a0 0x7f78440cf440 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f783c00c790 tx=0x7f783c00cc50 comp rx=0 tx=0).stop 2024-09-10T08:48:29.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.054+0000 7f7849a00640 1 -- 172.21.15.2:0/3604279444 reap_dead start 2024-09-10T08:48:29.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.054+0000 7f784a400640 1 -- 172.21.15.2:0/3604279444 shutdown_connections 2024-09-10T08:48:29.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.054+0000 7f784a400640 1 -- 172.21.15.2:0/3604279444 >> 172.21.15.2:0/3604279444 conn(0x7f784409d700 msgr2=0x7f78440b5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:29.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.054+0000 7f784a400640 1 -- 172.21.15.2:0/3604279444 shutdown_connections 2024-09-10T08:48:29.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.054+0000 7f784a400640 1 -- 172.21.15.2:0/3604279444 wait complete. 2024-09-10T08:48:29.069 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-10T08:48:29.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.225+0000 7f9962200640 1 Processor -- start 2024-09-10T08:48:29.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.225+0000 7f9962200640 1 -- start start 2024-09-10T08:48:29.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.226+0000 7f9962200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f995c161b20 0x7f995c0adb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:29.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.226+0000 7f9962200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f995c073340 0x7f995c073780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:29.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.226+0000 7f9962200640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f995c06ea00 con 0x7f995c0b44f0 2024-09-10T08:48:29.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.226+0000 7f9962200640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f995c161f00 con 0x7f995c161b20 2024-09-10T08:48:29.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.226+0000 7f9962200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f995c0ae040 con 0x7f995c073340 2024-09-10T08:48:29.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.226+0000 7f995b400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f995c161b20 0x7f995c0adb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:29.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.227+0000 7f995b400640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f995c161b20 0x7f995c0adb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46646/0 (socket says 172.21.15.2:46646) 2024-09-10T08:48:29.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.227+0000 7f995b400640 1 -- 172.21.15.2:0/3398704818 learned_addr learned my addr 172.21.15.2:0/3398704818 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:29.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.227+0000 7f995aa00640 1 --2- 172.21.15.2:0/3398704818 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f995c073340 0x7f995c073780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:29.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.227+0000 7f995b400640 1 -- 172.21.15.2:0/3398704818 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f995c073340 msgr2=0x7f995c073780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:48:29.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.227+0000 7f995b400640 1 --2- 172.21.15.2:0/3398704818 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f995c073340 0x7f995c073780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:29.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.227+0000 7f995b400640 1 -- 172.21.15.2:0/3398704818 >> v1:172.21.15.155:6789/0 conn(0x7f995c0b44f0 legacy=0x7f995c06faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:29.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.227+0000 7f995b400640 1 -- 172.21.15.2:0/3398704818 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f995c06ece0 con 0x7f995c161b20 2024-09-10T08:48:29.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.227+0000 7f995aa00640 1 --2- 172.21.15.2:0/3398704818 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f995c073340 0x7f995c073780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:48:29.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.228+0000 7f995b400640 1 --2- 172.21.15.2:0/3398704818 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f995c161b20 0x7f995c0adb00 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f994c009870 tx=0x7f994c02a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2c252103c2d40e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:29.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.228+0000 7f995a000640 1 -- 172.21.15.2:0/3398704818 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f994c037070 con 0x7f995c161b20 2024-09-10T08:48:29.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.228+0000 7f995a000640 1 -- 172.21.15.2:0/3398704818 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f994c032440 con 0x7f995c161b20 2024-09-10T08:48:29.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.228+0000 7f995a000640 1 -- 172.21.15.2:0/3398704818 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f994c032810 con 0x7f995c161b20 2024-09-10T08:48:29.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.229+0000 7f9962200640 1 -- 172.21.15.2:0/3398704818 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f995c161b20 msgr2=0x7f995c0adb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:29.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.229+0000 7f9962200640 1 --2- 172.21.15.2:0/3398704818 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f995c161b20 0x7f995c0adb00 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f994c009870 tx=0x7f994c02a250 comp rx=0 tx=0).stop 2024-09-10T08:48:29.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.229+0000 7f9962200640 1 -- 172.21.15.2:0/3398704818 shutdown_connections 2024-09-10T08:48:29.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.229+0000 7f9962200640 1 --2- 172.21.15.2:0/3398704818 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f995c073340 0x7f995c073780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:29.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.229+0000 7f9962200640 1 --2- 172.21.15.2:0/3398704818 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f995c161b20 0x7f995c0adb00 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:29.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.229+0000 7f9962200640 1 -- 172.21.15.2:0/3398704818 >> 172.21.15.2:0/3398704818 conn(0x7f995c072820 msgr2=0x7f995c072c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:29.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.229+0000 7f9962200640 1 -- 172.21.15.2:0/3398704818 shutdown_connections 2024-09-10T08:48:29.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.229+0000 7f9962200640 1 -- 172.21.15.2:0/3398704818 wait complete. 2024-09-10T08:48:29.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.230+0000 7f9962200640 1 Processor -- start 2024-09-10T08:48:29.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.231+0000 7f9962200640 1 -- start start 2024-09-10T08:48:29.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.231+0000 7f9962200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f995c073340 0x7f995c1e9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:29.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.231+0000 7f9962200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f995c0b44f0 0x7f995c15f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:29.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.231+0000 7f9962200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f995c161b20 0x7f995c15f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:29.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.231+0000 7f9962200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f995c06f580 con 0x7f995c161b20 2024-09-10T08:48:29.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.231+0000 7f9962200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f995c06f2a0 con 0x7f995c0b44f0 2024-09-10T08:48:29.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.231+0000 7f9962200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f995c0b3d30 con 0x7f995c073340 2024-09-10T08:48:29.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.232+0000 7f995be00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f995c161b20 0x7f995c15f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:29.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.232+0000 7f995be00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f995c161b20 0x7f995c15f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46662/0 (socket says 172.21.15.2:46662) 2024-09-10T08:48:29.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.232+0000 7f995be00640 1 -- 172.21.15.2:0/2009870148 learned_addr learned my addr 172.21.15.2:0/2009870148 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:29.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.232+0000 7f995b400640 1 --2- 172.21.15.2:0/2009870148 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f995c073340 0x7f995c1e9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:29.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.232+0000 7f995aa00640 1 --2- 172.21.15.2:0/2009870148 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f995c0b44f0 0x7f995c15f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:29.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.232+0000 7f995be00640 1 -- 172.21.15.2:0/2009870148 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f995c073340 msgr2=0x7f995c1e9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:29.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.232+0000 7f995be00640 1 --2- 172.21.15.2:0/2009870148 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f995c073340 0x7f995c1e9ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:29.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.232+0000 7f995be00640 1 -- 172.21.15.2:0/2009870148 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f995c0b44f0 msgr2=0x7f995c15f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:29.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.232+0000 7f995be00640 1 --2- 172.21.15.2:0/2009870148 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f995c0b44f0 0x7f995c15f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:29.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.232+0000 7f995be00640 1 -- 172.21.15.2:0/2009870148 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f995c0cd430 con 0x7f995c161b20 2024-09-10T08:48:29.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.233+0000 7f995be00640 1 --2- 172.21.15.2:0/2009870148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f995c161b20 0x7f995c15f9c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f995400c7d0 tx=0x7f995400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:29.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.233+0000 7f9953400640 1 -- 172.21.15.2:0/2009870148 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9954003b70 con 0x7f995c161b20 2024-09-10T08:48:29.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.233+0000 7f9953400640 1 -- 172.21.15.2:0/2009870148 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9954003d30 con 0x7f995c161b20 2024-09-10T08:48:29.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.233+0000 7f9953400640 1 -- 172.21.15.2:0/2009870148 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f995400aa90 con 0x7f995c161b20 2024-09-10T08:48:29.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.233+0000 7f9962200640 1 -- 172.21.15.2:0/2009870148 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f995c0cf150 con 0x7f995c161b20 2024-09-10T08:48:29.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.233+0000 7f9962200640 1 -- 172.21.15.2:0/2009870148 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f995c0cd6a0 con 0x7f995c161b20 2024-09-10T08:48:29.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.234+0000 7f9962200640 1 -- 172.21.15.2:0/2009870148 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f995c073780 con 0x7f995c161b20 2024-09-10T08:48:29.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.235+0000 7f9953400640 1 -- 172.21.15.2:0/2009870148 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 14) ==== 90498+0+0 (secure 0 0 0) 0x7f995400ac30 con 0x7f995c161b20 2024-09-10T08:48:29.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.236+0000 7f9953400640 1 --2- 172.21.15.2:0/2009870148 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f993c06be30 0x7f993c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:29.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.236+0000 7f9953400640 1 -- 172.21.15.2:0/2009870148 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5980+0+0 (secure 0 0 0) 0x7f995408adc0 con 0x7f995c161b20 2024-09-10T08:48:29.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.236+0000 7f995b400640 1 --2- 172.21.15.2:0/2009870148 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f993c06be30 0x7f993c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:29.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.237+0000 7f995b400640 1 --2- 172.21.15.2:0/2009870148 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f993c06be30 0x7f993c06e2f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f994c034000 tx=0x7f994c02e000 comp rx=0 tx=0).ready entity=mgr.4862 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:29.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.240+0000 7f9953400640 1 -- 172.21.15.2:0/2009870148 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9954058f70 con 0x7f995c161b20 2024-09-10T08:48:29.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.427+0000 7f9962200640 1 -- 172.21.15.2:0/2009870148 --> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f995c072e10 con 0x7f993c06be30 2024-09-10T08:48:29.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.428+0000 7f9953400640 1 -- 172.21.15.2:0/2009870148 <== mgr.4862 v2:172.21.15.155:6832/2264044153 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f995c072e10 con 0x7f993c06be30 2024-09-10T08:48:29.429 INFO:teuthology.orchestra.run.smithi002.stderr:instructed osd(s) 7 to deep-scrub 2024-09-10T08:48:29.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.430+0000 7f9962200640 1 -- 172.21.15.2:0/2009870148 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f993c06be30 msgr2=0x7f993c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:29.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.430+0000 7f9962200640 1 --2- 172.21.15.2:0/2009870148 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f993c06be30 0x7f993c06e2f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f994c034000 tx=0x7f994c02e000 comp rx=0 tx=0).stop 2024-09-10T08:48:29.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.431+0000 7f9962200640 1 -- 172.21.15.2:0/2009870148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f995c161b20 msgr2=0x7f995c15f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:29.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.431+0000 7f9962200640 1 --2- 172.21.15.2:0/2009870148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f995c161b20 0x7f995c15f9c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f995400c7d0 tx=0x7f995400cc90 comp rx=0 tx=0).stop 2024-09-10T08:48:29.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.431+0000 7f9962200640 1 -- 172.21.15.2:0/2009870148 shutdown_connections 2024-09-10T08:48:29.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.431+0000 7f9962200640 1 --2- 172.21.15.2:0/2009870148 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f993c06be30 0x7f993c06e2f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:29.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.431+0000 7f9962200640 1 --2- 172.21.15.2:0/2009870148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f995c161b20 0x7f995c15f9c0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:29.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.431+0000 7f9962200640 1 --2- 172.21.15.2:0/2009870148 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f995c0b44f0 0x7f995c15f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:29.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.431+0000 7f9962200640 1 --2- 172.21.15.2:0/2009870148 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f995c073340 0x7f995c1e9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:29.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.431+0000 7f9962200640 1 -- 172.21.15.2:0/2009870148 >> 172.21.15.2:0/2009870148 conn(0x7f995c072820 msgr2=0x7f995c070160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:29.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.431+0000 7f9962200640 1 -- 172.21.15.2:0/2009870148 shutdown_connections 2024-09-10T08:48:29.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.431+0000 7f9962200640 1 -- 172.21.15.2:0/2009870148 wait complete. 2024-09-10T08:48:29.448 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:48:29.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.603+0000 7fc92f200640 1 Processor -- start 2024-09-10T08:48:29.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.603+0000 7fc92f200640 1 -- start start 2024-09-10T08:48:29.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.604+0000 7fc92f200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc928147ef0 0x7fc92806d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:29.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.604+0000 7fc92f200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc9280b58c0 0x7fc92815ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:29.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.604+0000 7fc92f200640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc92806dab0 con 0x7fc928072450 2024-09-10T08:48:29.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.604+0000 7fc92f200640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7fc92806dd90 con 0x7fc9280b58c0 2024-09-10T08:48:29.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.604+0000 7fc92f200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc92806e070 con 0x7fc928147ef0 2024-09-10T08:48:29.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.604+0000 7fc92e800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc9280b58c0 0x7fc92815ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:29.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.604+0000 7fc92d400640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fc928072450 0x7fc9280b51b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:41816/0 (socket says 172.21.15.2:41816) 2024-09-10T08:48:29.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.604+0000 7fc92d400640 1 -- 172.21.15.2:0/3377261799 learned_addr learned my addr 172.21.15.2:0/3377261799 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:48:29.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.605+0000 7fc92de00640 1 --2- 172.21.15.2:0/3377261799 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc928147ef0 0x7fc92806d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:29.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.605+0000 7fc92e800640 1 -- 172.21.15.2:0/3377261799 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc928147ef0 msgr2=0x7fc92806d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:48:29.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.605+0000 7fc92e800640 1 --2- 172.21.15.2:0/3377261799 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc928147ef0 0x7fc92806d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:29.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.605+0000 7fc92e800640 1 -- 172.21.15.2:0/3377261799 >> v1:172.21.15.2:6789/0 conn(0x7fc928072450 legacy=0x7fc9280b51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:29.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.605+0000 7fc92e800640 1 -- 172.21.15.2:0/3377261799 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc92806e350 con 0x7fc9280b58c0 2024-09-10T08:48:29.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.606+0000 7fc92e800640 1 --2- 172.21.15.2:0/3377261799 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9280b58c0 0x7fc92815ee90 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc924009d90 tx=0x7fc92402a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e9ae15c1a18e1e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:29.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.606+0000 7fc92ca00640 1 -- 172.21.15.2:0/3377261799 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc924031600 con 0x7fc9280b58c0 2024-09-10T08:48:29.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.606+0000 7fc92ca00640 1 -- 172.21.15.2:0/3377261799 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9240317a0 con 0x7fc9280b58c0 2024-09-10T08:48:29.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.606+0000 7fc92ca00640 1 -- 172.21.15.2:0/3377261799 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc924031b70 con 0x7fc9280b58c0 2024-09-10T08:48:29.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.607+0000 7fc92f200640 1 -- 172.21.15.2:0/3377261799 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9280b58c0 msgr2=0x7fc92815ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:29.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.607+0000 7fc92f200640 1 --2- 172.21.15.2:0/3377261799 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9280b58c0 0x7fc92815ee90 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc924009d90 tx=0x7fc92402a5d0 comp rx=0 tx=0).stop 2024-09-10T08:48:29.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.607+0000 7fc92f200640 1 -- 172.21.15.2:0/3377261799 shutdown_connections 2024-09-10T08:48:29.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.607+0000 7fc92f200640 1 --2- 172.21.15.2:0/3377261799 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc9280b58c0 0x7fc92815ee90 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:29.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.607+0000 7fc92f200640 1 --2- 172.21.15.2:0/3377261799 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc928147ef0 0x7fc92806d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:29.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.607+0000 7fc92f200640 1 -- 172.21.15.2:0/3377261799 >> 172.21.15.2:0/3377261799 conn(0x7fc9280b3eb0 msgr2=0x7fc9280b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:29.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.607+0000 7fc92f200640 1 -- 172.21.15.2:0/3377261799 shutdown_connections 2024-09-10T08:48:29.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.607+0000 7fc92f200640 1 -- 172.21.15.2:0/3377261799 wait complete. 2024-09-10T08:48:29.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.608+0000 7fc92f200640 1 Processor -- start 2024-09-10T08:48:29.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.609+0000 7fc92f200640 1 -- start start 2024-09-10T08:48:29.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.609+0000 7fc92f200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc928072450 0x7fc9281f4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:29.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.610+0000 7fc92f200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc9280b58c0 0x7fc928142a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:29.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.610+0000 7fc92f200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc928147ef0 0x7fc9280ce8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:29.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.610+0000 7fc92f200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7fc92815f3d0 con 0x7fc928072450 2024-09-10T08:48:29.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.610+0000 7fc92f200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc92806d730 con 0x7fc9280b58c0 2024-09-10T08:48:29.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.610+0000 7fc92f200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7fc92815f550 con 0x7fc928147ef0 2024-09-10T08:48:29.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.610+0000 7fc92de00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc928072450 0x7fc9281f4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:29.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.610+0000 7fc92de00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc928072450 0x7fc9281f4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:46668/0 (socket says 172.21.15.2:46668) 2024-09-10T08:48:29.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.610+0000 7fc92de00640 1 -- 172.21.15.2:0/3609248689 learned_addr learned my addr 172.21.15.2:0/3609248689 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:29.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.610+0000 7fc92de00640 1 -- 172.21.15.2:0/3609248689 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc928147ef0 msgr2=0x7fc9280ce8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:29.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.610+0000 7fc92de00640 1 --2- 172.21.15.2:0/3609248689 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc928147ef0 0x7fc9280ce8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:29.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.610+0000 7fc92de00640 1 -- 172.21.15.2:0/3609248689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc9280b58c0 msgr2=0x7fc928142a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:29.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.610+0000 7fc92de00640 1 --2- 172.21.15.2:0/3609248689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc9280b58c0 0x7fc928142a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:29.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.610+0000 7fc92de00640 1 -- 172.21.15.2:0/3609248689 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc928142f70 con 0x7fc928072450 2024-09-10T08:48:29.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.610+0000 7fc92de00640 1 --2- 172.21.15.2:0/3609248689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc928072450 0x7fc9281f4f10 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fc91c00d5f0 tx=0x7fc91c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:29.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.611+0000 7fc922000640 1 -- 172.21.15.2:0/3609248689 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc91c0125f0 con 0x7fc928072450 2024-09-10T08:48:29.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.611+0000 7fc922000640 1 -- 172.21.15.2:0/3609248689 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc91c019070 con 0x7fc928072450 2024-09-10T08:48:29.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.611+0000 7fc922000640 1 -- 172.21.15.2:0/3609248689 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc91c0129b0 con 0x7fc928072450 2024-09-10T08:48:29.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.611+0000 7fc92f200640 1 -- 172.21.15.2:0/3609248689 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9281f5490 con 0x7fc928072450 2024-09-10T08:48:29.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.611+0000 7fc92f200640 1 -- 172.21.15.2:0/3609248689 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9280cf3d0 con 0x7fc928072450 2024-09-10T08:48:29.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.612+0000 7fc92f200640 1 -- 172.21.15.2:0/3609248689 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc92815ee90 con 0x7fc928072450 2024-09-10T08:48:29.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.613+0000 7fc922000640 1 -- 172.21.15.2:0/3609248689 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 14) ==== 90498+0+0 (secure 0 0 0) 0x7fc91c012b50 con 0x7fc928072450 2024-09-10T08:48:29.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.614+0000 7fc922000640 1 --2- 172.21.15.2:0/3609248689 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7fc90c06be30 0x7fc90c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:29.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.614+0000 7fc922000640 1 -- 172.21.15.2:0/3609248689 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5980+0+0 (secure 0 0 0) 0x7fc91c08b430 con 0x7fc928072450 2024-09-10T08:48:29.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.614+0000 7fc92d400640 1 --2- 172.21.15.2:0/3609248689 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7fc90c06be30 0x7fc90c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:29.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.615+0000 7fc92d400640 1 --2- 172.21.15.2:0/3609248689 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7fc90c06be30 0x7fc90c06e2f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc918000f60 tx=0x7fc918007a80 comp rx=0 tx=0).ready entity=mgr.4862 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:29.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.618+0000 7fc922000640 1 -- 172.21.15.2:0/3609248689 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc91c059c30 con 0x7fc928072450 2024-09-10T08:48:29.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.798+0000 7fc92f200640 1 -- 172.21.15.2:0/3609248689 --> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc9280d2950 con 0x7fc90c06be30 2024-09-10T08:48:29.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.799+0000 7fc922000640 1 -- 172.21.15.2:0/3609248689 <== mgr.4862 v2:172.21.15.155:6832/2264044153 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13356 (secure 0 0 0) 0x7fc918019440 con 0x7fc90c06be30 2024-09-10T08:48:29.799 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:48:29.799 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-10T08:48:29.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.801+0000 7fc92f200640 1 -- 172.21.15.2:0/3609248689 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7fc90c06be30 msgr2=0x7fc90c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:29.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.801+0000 7fc92f200640 1 --2- 172.21.15.2:0/3609248689 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7fc90c06be30 0x7fc90c06e2f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc918000f60 tx=0x7fc918007a80 comp rx=0 tx=0).stop 2024-09-10T08:48:29.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.801+0000 7fc92f200640 1 -- 172.21.15.2:0/3609248689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc928072450 msgr2=0x7fc9281f4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:29.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.801+0000 7fc92f200640 1 --2- 172.21.15.2:0/3609248689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc928072450 0x7fc9281f4f10 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fc91c00d5f0 tx=0x7fc91c00dab0 comp rx=0 tx=0).stop 2024-09-10T08:48:29.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.801+0000 7fc92f200640 1 -- 172.21.15.2:0/3609248689 shutdown_connections 2024-09-10T08:48:29.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.801+0000 7fc92f200640 1 --2- 172.21.15.2:0/3609248689 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7fc90c06be30 0x7fc90c06e2f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:29.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.801+0000 7fc92f200640 1 --2- 172.21.15.2:0/3609248689 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc928147ef0 0x7fc9280ce8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:29.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.801+0000 7fc92f200640 1 --2- 172.21.15.2:0/3609248689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc9280b58c0 0x7fc928142a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:29.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.801+0000 7fc92f200640 1 --2- 172.21.15.2:0/3609248689 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc928072450 0x7fc9281f4f10 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:29.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.801+0000 7fc92f200640 1 -- 172.21.15.2:0/3609248689 >> 172.21.15.2:0/3609248689 conn(0x7fc9280b3eb0 msgr2=0x7fc9281454e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:29.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.801+0000 7fc92f200640 1 -- 172.21.15.2:0/3609248689 shutdown_connections 2024-09-10T08:48:29.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:29.801+0000 7fc92f200640 1 -- 172.21.15.2:0/3609248689 wait complete. 2024-09-10T08:48:29.818 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":12,"stamp":"2024-09-10T08:48:29.296975+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":238024,"kb_used_data":5128,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736696,"statfs":{"total":773094113280,"available":772850376704,"internally_reserved":0,"allocated":5251072,"data_stored":2979192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":206,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.004641"},"pg_stats":[{"pgid":"1.0","version":"42'139","reported_seq":289,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-10T08:48:18.375156+0000","last_change":"2024-09-10T08:46:42.177049+0000","last_active":"2024-09-10T08:48:18.375156+0000","last_peered":"2024-09-10T08:48:18.375156+0000","last_clean":"2024-09-10T08:48:18.375156+0000","last_became_active":"2024-09-10T08:46:42.175678+0000","last_became_peered":"2024-09-10T08:46:42.175678+0000","last_unstale":"2024-09-10T08:48:18.375156+0000","last_undegraded":"2024-09-10T08:48:18.375156+0000","last_fullsized":"2024-09-10T08:48:18.375156+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T08:46:40.326212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T08:46:40.326212+0000","last_clean_scrub_stamp":"2024-09-10T08:46:40.326212+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T14:52:06.642437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28108,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343732,"statfs":{"total":96636764160,"available":96607981568,"internally_reserved":0,"allocated":1101824,"data_stored":815175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27532,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":507904,"data_stored":224807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27528,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":507904,"data_stored":224807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27528,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":507904,"data_stored":224807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31688,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340152,"statfs":{"total":96636764160,"available":96604315648,"internally_reserved":0,"allocated":507904,"data_stored":224807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31688,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340152,"statfs":{"total":96636764160,"available":96604315648,"internally_reserved":0,"allocated":507904,"data_stored":224807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31688,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340152,"statfs":{"total":96636764160,"available":96604315648,"internally_reserved":0,"allocated":507904,"data_stored":224807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32264,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339576,"statfs":{"total":96636764160,"available":96603725824,"internally_reserved":0,"allocated":1101824,"data_stored":815175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:48:29.821 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-10T08:46:40.326212+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=46, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=8, tm_min=48, tm_sec=23, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T08:48:29.821 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-10T08:48:38.326 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:48:38.331 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:48:49.822 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T08:48:49.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:49.990+0000 7f41e3200640 1 Processor -- start 2024-09-10T08:48:49.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:49.990+0000 7f41e3200640 1 -- start start 2024-09-10T08:48:49.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:49.991+0000 7f41e3200640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f41e40b40d0 0x7f41e4167010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:49.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:49.991+0000 7f41e3200640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41e40af840 con 0x7f41e40acf30 2024-09-10T08:48:49.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:49.991+0000 7f41e3200640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41e406eaf0 con 0x7f41e4145b20 2024-09-10T08:48:49.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:49.991+0000 7f41e3200640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f41e406f700 con 0x7f41e40b40d0 2024-09-10T08:48:49.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:49.991+0000 7f41e2800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f41e40b40d0 0x7f41e4167010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:49.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:49.991+0000 7f41dbe00640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f41e40acf30 0x7f41e40ad330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:44280/0 (socket says 172.21.15.2:44280) 2024-09-10T08:48:49.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:49.991+0000 7f41dbe00640 1 -- 172.21.15.2:0/2130004781 learned_addr learned my addr 172.21.15.2:0/2130004781 (peer_addr_for_me v1:172.21.15.2:0/0) 2024-09-10T08:48:49.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:49.992+0000 7f41e2800640 1 -- 172.21.15.2:0/2130004781 >> v1:172.21.15.155:6789/0 conn(0x7f41e4145b20 legacy=0x7f41e40af130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:48:49.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:49.992+0000 7f41e2800640 1 -- 172.21.15.2:0/2130004781 >> v1:172.21.15.2:6789/0 conn(0x7f41e40acf30 legacy=0x7f41e40ad330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:49.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:49.992+0000 7f41e2800640 1 -- 172.21.15.2:0/2130004781 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41e406edd0 con 0x7f41e40b40d0 2024-09-10T08:48:49.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:49.993+0000 7f41e2800640 1 --2- 172.21.15.2:0/2130004781 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41e40b40d0 0x7f41e4167010 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f41dc009d90 tx=0x7f41dc02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4c5b6d56db8e0d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:49.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:49.993+0000 7f41e1400640 1 -- 172.21.15.2:0/2130004781 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41dc007740 con 0x7f41e40b40d0 2024-09-10T08:48:49.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:49.993+0000 7f41e1400640 1 -- 172.21.15.2:0/2130004781 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41dc0078e0 con 0x7f41e40b40d0 2024-09-10T08:48:49.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:49.993+0000 7f41e1400640 1 -- 172.21.15.2:0/2130004781 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41dc007cb0 con 0x7f41e40b40d0 2024-09-10T08:48:49.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:49.994+0000 7f41e3200640 1 -- 172.21.15.2:0/2130004781 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41e40b40d0 msgr2=0x7f41e4167010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:49.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:49.994+0000 7f41e3200640 1 --2- 172.21.15.2:0/2130004781 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41e40b40d0 0x7f41e4167010 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f41dc009d90 tx=0x7f41dc02a6a0 comp rx=0 tx=0).stop 2024-09-10T08:48:49.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:49.994+0000 7f41e3200640 1 -- 172.21.15.2:0/2130004781 shutdown_connections 2024-09-10T08:48:49.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:49.994+0000 7f41e3200640 1 --2- 172.21.15.2:0/2130004781 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41e40b40d0 0x7f41e4167010 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:49.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:49.994+0000 7f41e3200640 1 -- 172.21.15.2:0/2130004781 >> 172.21.15.2:0/2130004781 conn(0x7f41e406c210 msgr2=0x7f41e40b1c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:49.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:49.994+0000 7f41e3200640 1 -- 172.21.15.2:0/2130004781 shutdown_connections 2024-09-10T08:48:49.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:49.994+0000 7f41e3200640 1 -- 172.21.15.2:0/2130004781 wait complete. 2024-09-10T08:48:49.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:49.995+0000 7f41e3200640 1 Processor -- start 2024-09-10T08:48:49.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:49.996+0000 7f41e3200640 1 -- start start 2024-09-10T08:48:50.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:49.996+0000 7f41e3200640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41e40acf30 0x7f41e40736d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:50.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:49.996+0000 7f41e3200640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41e40b40d0 0x7f41e4159c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:50.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:49.997+0000 7f41e3200640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41e4145b20 0x7f41e415a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:50.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:49.997+0000 7f41e3200640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f41e4145f00 con 0x7f41e40acf30 2024-09-10T08:48:50.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:49.997+0000 7f41e3200640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f41e406f390 con 0x7f41e4145b20 2024-09-10T08:48:50.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:49.997+0000 7f41e3200640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f41e406e6a0 con 0x7f41e40b40d0 2024-09-10T08:48:50.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:49.997+0000 7f41e1e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41e40acf30 0x7f41e40736d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:50.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:49.997+0000 7f41e1e00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41e40acf30 0x7f41e40736d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35904/0 (socket says 172.21.15.2:35904) 2024-09-10T08:48:50.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:49.997+0000 7f41e1e00640 1 -- 172.21.15.2:0/1149395386 learned_addr learned my addr 172.21.15.2:0/1149395386 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:50.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:49.997+0000 7f41e2800640 1 --2- 172.21.15.2:0/1149395386 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41e4145b20 0x7f41e415a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:50.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:49.997+0000 7f41dbe00640 1 --2- 172.21.15.2:0/1149395386 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41e40b40d0 0x7f41e4159c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:50.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:49.997+0000 7f41e1e00640 1 -- 172.21.15.2:0/1149395386 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41e40b40d0 msgr2=0x7f41e4159c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:50.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:49.997+0000 7f41e1e00640 1 --2- 172.21.15.2:0/1149395386 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41e40b40d0 0x7f41e4159c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:50.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:49.997+0000 7f41e1e00640 1 -- 172.21.15.2:0/1149395386 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41e4145b20 msgr2=0x7f41e415a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:50.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:49.997+0000 7f41e1e00640 1 --2- 172.21.15.2:0/1149395386 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41e4145b20 0x7f41e415a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:50.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:49.997+0000 7f41e1e00640 1 -- 172.21.15.2:0/1149395386 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41e413e4b0 con 0x7f41e40acf30 2024-09-10T08:48:50.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:49.997+0000 7f41e2800640 1 --2- 172.21.15.2:0/1149395386 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41e4145b20 0x7f41e415a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-10T08:48:50.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:49.998+0000 7f41e1e00640 1 --2- 172.21.15.2:0/1149395386 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41e40acf30 0x7f41e40736d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f41d400c430 tx=0x7f41d400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:50.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:49.998+0000 7f41da000640 1 -- 172.21.15.2:0/1149395386 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d4011790 con 0x7f41e40acf30 2024-09-10T08:48:50.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:49.998+0000 7f41da000640 1 -- 172.21.15.2:0/1149395386 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41d4017070 con 0x7f41e40acf30 2024-09-10T08:48:50.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:49.998+0000 7f41da000640 1 -- 172.21.15.2:0/1149395386 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d4011bb0 con 0x7f41e40acf30 2024-09-10T08:48:50.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:49.998+0000 7f41e3200640 1 -- 172.21.15.2:0/1149395386 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41e413f230 con 0x7f41e40acf30 2024-09-10T08:48:50.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:49.998+0000 7f41e3200640 1 -- 172.21.15.2:0/1149395386 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41e413e750 con 0x7f41e40acf30 2024-09-10T08:48:50.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:49.999+0000 7f41e3200640 1 -- 172.21.15.2:0/1149395386 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41e40ad330 con 0x7f41e40acf30 2024-09-10T08:48:50.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.000+0000 7f41da000640 1 -- 172.21.15.2:0/1149395386 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 14) ==== 90498+0+0 (secure 0 0 0) 0x7f41d401c460 con 0x7f41e40acf30 2024-09-10T08:48:50.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.001+0000 7f41da000640 1 --2- 172.21.15.2:0/1149395386 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f41c006be30 0x7f41c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:50.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.001+0000 7f41da000640 1 -- 172.21.15.2:0/1149395386 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5980+0+0 (secure 0 0 0) 0x7f41d408ade0 con 0x7f41e40acf30 2024-09-10T08:48:50.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.002+0000 7f41dbe00640 1 --2- 172.21.15.2:0/1149395386 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f41c006be30 0x7f41c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:50.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.003+0000 7f41dbe00640 1 --2- 172.21.15.2:0/1149395386 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f41c006be30 0x7f41c006e2f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f41e415a9d0 tx=0x7f41cc007e80 comp rx=0 tx=0).ready entity=mgr.4862 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:50.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.006+0000 7f41da000640 1 -- 172.21.15.2:0/1149395386 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f41d40595e0 con 0x7f41e40acf30 2024-09-10T08:48:50.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.187+0000 7f41e3200640 1 -- 172.21.15.2:0/1149395386 --> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f41e413efe0 con 0x7f41c006be30 2024-09-10T08:48:50.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.189+0000 7f41da000640 1 -- 172.21.15.2:0/1149395386 <== mgr.4862 v2:172.21.15.155:6832/2264044153 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13358 (secure 0 0 0) 0x7f41e413efe0 con 0x7f41c006be30 2024-09-10T08:48:50.190 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:48:50.190 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-10T08:48:50.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.190+0000 7f41e3200640 1 -- 172.21.15.2:0/1149395386 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f41c006be30 msgr2=0x7f41c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:50.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.190+0000 7f41e3200640 1 --2- 172.21.15.2:0/1149395386 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f41c006be30 0x7f41c006e2f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f41e415a9d0 tx=0x7f41cc007e80 comp rx=0 tx=0).stop 2024-09-10T08:48:50.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.190+0000 7f41e3200640 1 -- 172.21.15.2:0/1149395386 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41e40acf30 msgr2=0x7f41e40736d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:50.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.190+0000 7f41e3200640 1 --2- 172.21.15.2:0/1149395386 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41e40acf30 0x7f41e40736d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f41d400c430 tx=0x7f41d400c8f0 comp rx=0 tx=0).stop 2024-09-10T08:48:50.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.190+0000 7f41e3200640 1 -- 172.21.15.2:0/1149395386 shutdown_connections 2024-09-10T08:48:50.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.190+0000 7f41e3200640 1 --2- 172.21.15.2:0/1149395386 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f41c006be30 0x7f41c006e2f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:50.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.190+0000 7f41e3200640 1 --2- 172.21.15.2:0/1149395386 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41e4145b20 0x7f41e415a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:50.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.190+0000 7f41e3200640 1 --2- 172.21.15.2:0/1149395386 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f41e40b40d0 0x7f41e4159c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:50.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.190+0000 7f41e3200640 1 --2- 172.21.15.2:0/1149395386 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f41e40acf30 0x7f41e40736d0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:50.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.190+0000 7f41e3200640 1 -- 172.21.15.2:0/1149395386 >> 172.21.15.2:0/1149395386 conn(0x7f41e406c210 msgr2=0x7f41e40d0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:50.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.191+0000 7f41e3200640 1 -- 172.21.15.2:0/1149395386 shutdown_connections 2024-09-10T08:48:50.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.191+0000 7f41e3200640 1 -- 172.21.15.2:0/1149395386 wait complete. 2024-09-10T08:48:50.208 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-10T08:48:49.301290+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":140,"ondisk_log_size":140,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":238012,"kb_used_data":5128,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736708,"statfs":{"total":773094113280,"available":772850388992,"internally_reserved":0,"allocated":5251072,"data_stored":2979192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002641"},"pg_stats":[{"pgid":"1.0","version":"43'140","reported_seq":300,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-10T08:48:29.809575+0000","last_change":"2024-09-10T08:48:29.809575+0000","last_active":"2024-09-10T08:48:29.809575+0000","last_peered":"2024-09-10T08:48:29.809575+0000","last_clean":"2024-09-10T08:48:29.809575+0000","last_became_active":"2024-09-10T08:46:42.175678+0000","last_became_peered":"2024-09-10T08:46:42.175678+0000","last_unstale":"2024-09-10T08:48:29.809575+0000","last_undegraded":"2024-09-10T08:48:29.809575+0000","last_fullsized":"2024-09-10T08:48:29.809575+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'140","last_scrub_stamp":"2024-09-10T08:48:29.809467+0000","last_deep_scrub":"43'140","last_deep_scrub_stamp":"2024-09-10T08:48:29.809467+0000","last_clean_scrub_stamp":"2024-09-10T08:48:29.809467+0000","objects_scrubbed":2,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:29:23.525870+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":140,"ondisk_log_size":140,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574875,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28100,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343740,"statfs":{"total":96636764160,"available":96607989760,"internally_reserved":0,"allocated":1101824,"data_stored":815175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27532,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":507904,"data_stored":224807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27528,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":507904,"data_stored":224807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27528,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":507904,"data_stored":224807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31688,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340152,"statfs":{"total":96636764160,"available":96604315648,"internally_reserved":0,"allocated":507904,"data_stored":224807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31688,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340152,"statfs":{"total":96636764160,"available":96604315648,"internally_reserved":0,"allocated":507904,"data_stored":224807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31688,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340152,"statfs":{"total":96636764160,"available":96604315648,"internally_reserved":0,"allocated":507904,"data_stored":224807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574874,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32260,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339580,"statfs":{"total":96636764160,"available":96603729920,"internally_reserved":0,"allocated":1101824,"data_stored":815175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T08:48:50.209 DEBUG:teuthology.orchestra.run.smithi002:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-10T08:48:50.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.359+0000 7f6ddcc00640 1 Processor -- start 2024-09-10T08:48:50.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.360+0000 7f6ddcc00640 1 -- start start 2024-09-10T08:48:50.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.361+0000 7f6ddcc00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6dd815c460 0x7f6dd815d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:50.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.361+0000 7f6ddcc00640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6dd80cf310 0x7f6dd80b43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:50.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.361+0000 7f6ddcc00640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6dd81603b0 con 0x7f6dd806df50 2024-09-10T08:48:50.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.361+0000 7f6ddcc00640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 -- 0x7f6dd8161030 con 0x7f6dd80cf310 2024-09-10T08:48:50.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.361+0000 7f6ddcc00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6dd815da70 con 0x7f6dd815c460 2024-09-10T08:48:50.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.361+0000 7f6dd6800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6dd80cf310 0x7f6dd80b43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:50.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.361+0000 7f6dd6800640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6dd80cf310 0x7f6dd80b43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35920/0 (socket says 172.21.15.2:35920) 2024-09-10T08:48:50.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.361+0000 7f6dd6800640 1 -- 172.21.15.2:0/2817288280 learned_addr learned my addr 172.21.15.2:0/2817288280 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:50.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.361+0000 7f6dd5e00640 1 --2- 172.21.15.2:0/2817288280 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6dd815c460 0x7f6dd815d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:50.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.361+0000 7f6dd6800640 1 -- 172.21.15.2:0/2817288280 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6dd815c460 msgr2=0x7f6dd815d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:48:50.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.361+0000 7f6dd6800640 1 --2- 172.21.15.2:0/2817288280 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6dd815c460 0x7f6dd815d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:50.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.361+0000 7f6dd6800640 1 -- 172.21.15.2:0/2817288280 >> v1:172.21.15.155:6789/0 conn(0x7f6dd806df50 legacy=0x7f6dd80cec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:50.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.361+0000 7f6dd6800640 1 -- 172.21.15.2:0/2817288280 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dd8160690 con 0x7f6dd80cf310 2024-09-10T08:48:50.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.362+0000 7f6dd6800640 1 --2- 172.21.15.2:0/2817288280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6dd80cf310 0x7f6dd80b43d0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f6dd0009e80 tx=0x7f6dd002a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd115f46aaca00b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:50.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.363+0000 7f6dd5400640 1 -- 172.21.15.2:0/2817288280 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dd0036070 con 0x7f6dd80cf310 2024-09-10T08:48:50.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.363+0000 7f6dd5400640 1 -- 172.21.15.2:0/2817288280 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dd0031600 con 0x7f6dd80cf310 2024-09-10T08:48:50.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.363+0000 7f6dd5400640 1 -- 172.21.15.2:0/2817288280 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dd00319d0 con 0x7f6dd80cf310 2024-09-10T08:48:50.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.363+0000 7f6ddcc00640 1 -- 172.21.15.2:0/2817288280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6dd80cf310 msgr2=0x7f6dd80b43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:50.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.363+0000 7f6ddcc00640 1 --2- 172.21.15.2:0/2817288280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6dd80cf310 0x7f6dd80b43d0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f6dd0009e80 tx=0x7f6dd002a750 comp rx=0 tx=0).stop 2024-09-10T08:48:50.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.363+0000 7f6ddcc00640 1 -- 172.21.15.2:0/2817288280 shutdown_connections 2024-09-10T08:48:50.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.363+0000 7f6ddcc00640 1 --2- 172.21.15.2:0/2817288280 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6dd80cf310 0x7f6dd80b43d0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:50.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.363+0000 7f6ddcc00640 1 --2- 172.21.15.2:0/2817288280 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6dd815c460 0x7f6dd815d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:50.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.363+0000 7f6ddcc00640 1 -- 172.21.15.2:0/2817288280 >> 172.21.15.2:0/2817288280 conn(0x7f6dd80d02c0 msgr2=0x7f6dd80d06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:50.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.364+0000 7f6ddcc00640 1 -- 172.21.15.2:0/2817288280 shutdown_connections 2024-09-10T08:48:50.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.364+0000 7f6ddcc00640 1 -- 172.21.15.2:0/2817288280 wait complete. 2024-09-10T08:48:50.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.365+0000 7f6ddcc00640 1 Processor -- start 2024-09-10T08:48:50.368 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.365+0000 7f6ddcc00640 1 -- start start 2024-09-10T08:48:50.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.366+0000 7f6ddcc00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6dd806df50 0x7f6dd8148670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:50.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.366+0000 7f6ddcc00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6dd80cf310 0x7f6dd815a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:50.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.366+0000 7f6ddcc00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6dd815c460 0x7f6dd8153400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:50.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.366+0000 7f6ddcc00640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd8160080 con 0x7f6dd80cf310 2024-09-10T08:48:50.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.366+0000 7f6ddcc00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd8160c50 con 0x7f6dd806df50 2024-09-10T08:48:50.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.366+0000 7f6ddcc00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f6dd815c840 con 0x7f6dd815c460 2024-09-10T08:48:50.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.366+0000 7f6dcfe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6dd80cf310 0x7f6dd815a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:50.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.366+0000 7f6dcfe00640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6dd80cf310 0x7f6dd815a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35932/0 (socket says 172.21.15.2:35932) 2024-09-10T08:48:50.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.367+0000 7f6dcfe00640 1 -- 172.21.15.2:0/2178579957 learned_addr learned my addr 172.21.15.2:0/2178579957 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:50.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.367+0000 7f6dd5e00640 1 --2- 172.21.15.2:0/2178579957 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6dd806df50 0x7f6dd8148670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:50.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.367+0000 7f6dd6800640 1 --2- 172.21.15.2:0/2178579957 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6dd815c460 0x7f6dd8153400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:50.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.367+0000 7f6dcfe00640 1 -- 172.21.15.2:0/2178579957 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6dd815c460 msgr2=0x7f6dd8153400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:50.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.367+0000 7f6dcfe00640 1 --2- 172.21.15.2:0/2178579957 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6dd815c460 0x7f6dd8153400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:50.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.367+0000 7f6dcfe00640 1 -- 172.21.15.2:0/2178579957 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6dd806df50 msgr2=0x7f6dd8148670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:50.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.367+0000 7f6dcfe00640 1 --2- 172.21.15.2:0/2178579957 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6dd806df50 0x7f6dd8148670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:50.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.367+0000 7f6dcfe00640 1 -- 172.21.15.2:0/2178579957 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dd8158a40 con 0x7f6dd80cf310 2024-09-10T08:48:50.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.367+0000 7f6dcfe00640 1 --2- 172.21.15.2:0/2178579957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6dd80cf310 0x7f6dd815a110 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f6dc000c440 tx=0x7f6dc0001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:50.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.367+0000 7f6dce000640 1 -- 172.21.15.2:0/2178579957 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc00052d0 con 0x7f6dd80cf310 2024-09-10T08:48:50.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.367+0000 7f6dce000640 1 -- 172.21.15.2:0/2178579957 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dc0005470 con 0x7f6dd80cf310 2024-09-10T08:48:50.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.367+0000 7f6ddcc00640 1 -- 172.21.15.2:0/2178579957 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dd8158d20 con 0x7f6dd80cf310 2024-09-10T08:48:50.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.368+0000 7f6dce000640 1 -- 172.21.15.2:0/2178579957 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc0007260 con 0x7f6dd80cf310 2024-09-10T08:48:50.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.368+0000 7f6ddcc00640 1 -- 172.21.15.2:0/2178579957 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dd81592e0 con 0x7f6dd80cf310 2024-09-10T08:48:50.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.369+0000 7f6ddcc00640 1 -- 172.21.15.2:0/2178579957 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dd80cdea0 con 0x7f6dd80cf310 2024-09-10T08:48:50.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.370+0000 7f6dce000640 1 -- 172.21.15.2:0/2178579957 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 14) ==== 90498+0+0 (secure 0 0 0) 0x7f6dc0007400 con 0x7f6dd80cf310 2024-09-10T08:48:50.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.370+0000 7f6dce000640 1 --2- 172.21.15.2:0/2178579957 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f6db406be60 0x7f6db406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:50.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.371+0000 7f6dce000640 1 -- 172.21.15.2:0/2178579957 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5980+0+0 (secure 0 0 0) 0x7f6dc008a450 con 0x7f6dd80cf310 2024-09-10T08:48:50.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.371+0000 7f6dd5e00640 1 --2- 172.21.15.2:0/2178579957 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f6db406be60 0x7f6db406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:50.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.372+0000 7f6dd5e00640 1 --2- 172.21.15.2:0/2178579957 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f6db406be60 0x7f6db406e320 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6dc8009aa0 tx=0x7f6dc8009190 comp rx=0 tx=0).ready entity=mgr.4862 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:50.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.375+0000 7f6dce000640 1 -- 172.21.15.2:0/2178579957 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6dc0058600 con 0x7f6dd80cf310 2024-09-10T08:48:50.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.559+0000 7f6ddcc00640 1 -- 172.21.15.2:0/2178579957 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f6dd815f880 con 0x7f6dd80cf310 2024-09-10T08:48:50.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.563+0000 7f6dce000640 1 -- 172.21.15.2:0/2178579957 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v16)=0 v16) ==== 123+0+0 (secure 0 0 0) 0x7f6dc005c900 con 0x7f6dd80cf310 2024-09-10T08:48:50.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.563+0000 7f6dce000640 1 -- 172.21.15.2:0/2178579957 <== mon.0 v2:172.21.15.2:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f6dc0061130 con 0x7f6dd80cf310 2024-09-10T08:48:50.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.565+0000 7f6ddcc00640 1 -- 172.21.15.2:0/2178579957 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f6db406be60 msgr2=0x7f6db406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:50.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.565+0000 7f6ddcc00640 1 --2- 172.21.15.2:0/2178579957 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f6db406be60 0x7f6db406e320 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6dc8009aa0 tx=0x7f6dc8009190 comp rx=0 tx=0).stop 2024-09-10T08:48:50.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.565+0000 7f6ddcc00640 1 -- 172.21.15.2:0/2178579957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6dd80cf310 msgr2=0x7f6dd815a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:50.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.565+0000 7f6ddcc00640 1 --2- 172.21.15.2:0/2178579957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6dd80cf310 0x7f6dd815a110 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f6dc000c440 tx=0x7f6dc0001e70 comp rx=0 tx=0).stop 2024-09-10T08:48:50.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.565+0000 7f6ddcc00640 1 -- 172.21.15.2:0/2178579957 shutdown_connections 2024-09-10T08:48:50.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.565+0000 7f6ddcc00640 1 --2- 172.21.15.2:0/2178579957 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f6db406be60 0x7f6db406e320 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:50.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.565+0000 7f6ddcc00640 1 --2- 172.21.15.2:0/2178579957 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6dd815c460 0x7f6dd8153400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:50.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.565+0000 7f6ddcc00640 1 --2- 172.21.15.2:0/2178579957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6dd80cf310 0x7f6dd815a110 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:50.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.565+0000 7f6ddcc00640 1 --2- 172.21.15.2:0/2178579957 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6dd806df50 0x7f6dd8148670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:50.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.565+0000 7f6ddcc00640 1 -- 172.21.15.2:0/2178579957 >> 172.21.15.2:0/2178579957 conn(0x7f6dd80d02c0 msgr2=0x7f6dd80af600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:50.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.566+0000 7f6ddcc00640 1 -- 172.21.15.2:0/2178579957 shutdown_connections 2024-09-10T08:48:50.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.566+0000 7f6ddcc00640 1 -- 172.21.15.2:0/2178579957 wait complete. 2024-09-10T08:48:50.583 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-10T08:48:50.583 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-10T08:48:50.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.738+0000 7f67d8800640 1 Processor -- start 2024-09-10T08:48:50.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.738+0000 7f67d8800640 1 -- start start 2024-09-10T08:48:50.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.739+0000 7f67d8800640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f67d0144c90 0x7f67d00ccd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:50.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.739+0000 7f67d8800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f67d00cd2b0 0x7f67d00ce420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:50.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.739+0000 7f67d8800640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67d006f540 con 0x7f67d0144250 2024-09-10T08:48:50.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.739+0000 7f67d8800640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 -- 0x7f67d006f820 con 0x7f67d0144c90 2024-09-10T08:48:50.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.739+0000 7f67d8800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f67d006fb00 con 0x7f67d00cd2b0 2024-09-10T08:48:50.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.740+0000 7f67d6800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f67d00cd2b0 0x7f67d00ce420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:50.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.740+0000 7f67d5400640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f67d0144c90 0x7f67d00ccd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:50.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.740+0000 7f67d5400640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f67d0144c90 0x7f67d00ccd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.2:44642/0 (socket says 172.21.15.2:44642) 2024-09-10T08:48:50.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.740+0000 7f67d5e00640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f67d0144250 0x7f67d00cf8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.2:53130/0 (socket says 172.21.15.2:53130) 2024-09-10T08:48:50.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.740+0000 7f67d6800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f67d00cd2b0 0x7f67d00ce420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.2:42876/0 (socket says 172.21.15.2:42876) 2024-09-10T08:48:50.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.740+0000 7f67d5400640 1 -- 172.21.15.2:0/1813962033 learned_addr learned my addr 172.21.15.2:0/1813962033 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:50.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.740+0000 7f67d5400640 1 -- 172.21.15.2:0/1813962033 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f67d00cd2b0 msgr2=0x7f67d00ce420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T08:48:50.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.740+0000 7f67d5400640 1 --2- 172.21.15.2:0/1813962033 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f67d00cd2b0 0x7f67d00ce420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:50.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.740+0000 7f67d5400640 1 -- 172.21.15.2:0/1813962033 >> v1:172.21.15.155:6789/0 conn(0x7f67d0144250 legacy=0x7f67d00cf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:50.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.740+0000 7f67d5400640 1 -- 172.21.15.2:0/1813962033 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67d006fde0 con 0x7f67d0144c90 2024-09-10T08:48:50.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.740+0000 7f67d6800640 1 --2- 172.21.15.2:0/1813962033 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f67d00cd2b0 0x7f67d00ce420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-10T08:48:50.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.742+0000 7f67d5400640 1 --2- 172.21.15.2:0/1813962033 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67d0144c90 0x7f67d00ccd70 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f67c000bb10 tx=0x7f67c002c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc932c59f2404259 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:50.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.742+0000 7f67d4a00640 1 -- 172.21.15.2:0/1813962033 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67c0036020 con 0x7f67d0144c90 2024-09-10T08:48:50.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.742+0000 7f67d4a00640 1 -- 172.21.15.2:0/1813962033 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f67c0032820 con 0x7f67d0144c90 2024-09-10T08:48:50.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.742+0000 7f67d4a00640 1 -- 172.21.15.2:0/1813962033 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67c0032c10 con 0x7f67d0144c90 2024-09-10T08:48:50.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.742+0000 7f67d8800640 1 -- 172.21.15.2:0/1813962033 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67d0144c90 msgr2=0x7f67d00ccd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:50.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.742+0000 7f67d8800640 1 --2- 172.21.15.2:0/1813962033 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67d0144c90 0x7f67d00ccd70 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f67c000bb10 tx=0x7f67c002c920 comp rx=0 tx=0).stop 2024-09-10T08:48:50.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.742+0000 7f67d8800640 1 -- 172.21.15.2:0/1813962033 shutdown_connections 2024-09-10T08:48:50.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.742+0000 7f67d8800640 1 --2- 172.21.15.2:0/1813962033 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f67d00cd2b0 0x7f67d00ce420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:50.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.742+0000 7f67d8800640 1 --2- 172.21.15.2:0/1813962033 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67d0144c90 0x7f67d00ccd70 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:50.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.742+0000 7f67d8800640 1 -- 172.21.15.2:0/1813962033 >> 172.21.15.2:0/1813962033 conn(0x7f67d006bc10 msgr2=0x7f67d006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:50.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.743+0000 7f67d8800640 1 -- 172.21.15.2:0/1813962033 shutdown_connections 2024-09-10T08:48:50.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.743+0000 7f67d8800640 1 -- 172.21.15.2:0/1813962033 wait complete. 2024-09-10T08:48:50.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.744+0000 7f67d8800640 1 Processor -- start 2024-09-10T08:48:50.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.744+0000 7f67d8800640 1 -- start start 2024-09-10T08:48:50.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.745+0000 7f67d8800640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f67d00cd2b0 0x7f67d015a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:50.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.745+0000 7f67d8800640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67d0144250 0x7f67d015ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:50.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.745+0000 7f67d8800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67d0144c90 0x7f67d00af1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:50.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.745+0000 7f67d8800640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 -- 0x7f67d00ce960 con 0x7f67d0144c90 2024-09-10T08:48:50.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.745+0000 7f67d8800640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f67d00b3390 con 0x7f67d0144250 2024-09-10T08:48:50.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.745+0000 7f67d8800640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 -- 0x7f67d00ceae0 con 0x7f67d00cd2b0 2024-09-10T08:48:50.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.745+0000 7f67d6800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67d0144c90 0x7f67d00af1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:50.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.745+0000 7f67d6800640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67d0144c90 0x7f67d00af1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35936/0 (socket says 172.21.15.2:35936) 2024-09-10T08:48:50.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.746+0000 7f67d6800640 1 -- 172.21.15.2:0/2576310065 learned_addr learned my addr 172.21.15.2:0/2576310065 (peer_addr_for_me v2:172.21.15.2:0/0) 2024-09-10T08:48:50.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.746+0000 7f67d5e00640 1 --2- 172.21.15.2:0/2576310065 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f67d00cd2b0 0x7f67d015a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:50.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.746+0000 7f67d5400640 1 --2- 172.21.15.2:0/2576310065 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67d0144250 0x7f67d015ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:50.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.746+0000 7f67d6800640 1 -- 172.21.15.2:0/2576310065 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f67d00cd2b0 msgr2=0x7f67d015a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:50.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.746+0000 7f67d6800640 1 --2- 172.21.15.2:0/2576310065 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f67d00cd2b0 0x7f67d015a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:50.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.746+0000 7f67d6800640 1 -- 172.21.15.2:0/2576310065 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67d0144250 msgr2=0x7f67d015ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:50.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.746+0000 7f67d6800640 1 --2- 172.21.15.2:0/2576310065 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67d0144250 0x7f67d015ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:50.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.746+0000 7f67d6800640 1 -- 172.21.15.2:0/2576310065 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67d015ac10 con 0x7f67d0144c90 2024-09-10T08:48:50.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.746+0000 7f67d6800640 1 --2- 172.21.15.2:0/2576310065 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67d0144c90 0x7f67d00af1f0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f67cc009f00 tx=0x7f67cc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:50.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.747+0000 7f67ca000640 1 -- 172.21.15.2:0/2576310065 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67cc018030 con 0x7f67d0144c90 2024-09-10T08:48:50.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.747+0000 7f67ca000640 1 -- 172.21.15.2:0/2576310065 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f67cc00ce50 con 0x7f67d0144c90 2024-09-10T08:48:50.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.747+0000 7f67ca000640 1 -- 172.21.15.2:0/2576310065 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67cc003bd0 con 0x7f67d0144c90 2024-09-10T08:48:50.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.747+0000 7f67d8800640 1 -- 172.21.15.2:0/2576310065 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67d015b360 con 0x7f67d0144c90 2024-09-10T08:48:50.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.747+0000 7f67d8800640 1 -- 172.21.15.2:0/2576310065 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67d01e54b0 con 0x7f67d0144c90 2024-09-10T08:48:50.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.748+0000 7f67d8800640 1 -- 172.21.15.2:0/2576310065 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67d00ce420 con 0x7f67d0144c90 2024-09-10T08:48:50.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.749+0000 7f67ca000640 1 -- 172.21.15.2:0/2576310065 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 14) ==== 90498+0+0 (secure 0 0 0) 0x7f67cc005d10 con 0x7f67d0144c90 2024-09-10T08:48:50.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.749+0000 7f67ca000640 1 --2- 172.21.15.2:0/2576310065 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f67b406be30 0x7f67b406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-10T08:48:50.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.750+0000 7f67ca000640 1 -- 172.21.15.2:0/2576310065 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5980+0+0 (secure 0 0 0) 0x7f67cc08baa0 con 0x7f67d0144c90 2024-09-10T08:48:50.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.750+0000 7f67d5e00640 1 --2- 172.21.15.2:0/2576310065 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f67b406be30 0x7f67b406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-10T08:48:50.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.751+0000 7f67d5e00640 1 --2- 172.21.15.2:0/2576310065 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f67b406be30 0x7f67b406e2f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f67c4000f60 tx=0x7f67c4000ed0 comp rx=0 tx=0).ready entity=mgr.4862 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-10T08:48:50.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.754+0000 7f67ca000640 1 -- 172.21.15.2:0/2576310065 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f67cc022070 con 0x7f67d0144c90 2024-09-10T08:48:50.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.972+0000 7f67d8800640 1 -- 172.21.15.2:0/2576310065 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f67d006cf40 con 0x7f67d0144c90 2024-09-10T08:48:50.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.973+0000 7f67ca000640 1 -- 172.21.15.2:0/2576310065 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+3905 (secure 0 0 0) 0x7f67cc010040 con 0x7f67d0144c90 2024-09-10T08:48:50.974 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-10T08:48:50.974 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":20,"btime":"2024-09-10T08:48:16:080470+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4634,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3082437117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6835","nonce":3082437117},{"type":"v1","addr":"172.21.15.155:6837","nonce":3082437117}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4816,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6834/3193521843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":3193521843},{"type":"v1","addr":"172.21.15.2:6834","nonce":3193521843}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4822,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6836/164428463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":164428463},{"type":"v1","addr":"172.21.15.155:6836","nonce":164428463}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5169,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/908635030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6833","nonce":908635030},{"type":"v1","addr":"172.21.15.2:6835","nonce":908635030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[]} 2024-09-10T08:48:50.974 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 20 2024-09-10T08:48:50.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.975+0000 7f67d8800640 1 -- 172.21.15.2:0/2576310065 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f67b406be30 msgr2=0x7f67b406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:50.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.975+0000 7f67d8800640 1 --2- 172.21.15.2:0/2576310065 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f67b406be30 0x7f67b406e2f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f67c4000f60 tx=0x7f67c4000ed0 comp rx=0 tx=0).stop 2024-09-10T08:48:50.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.975+0000 7f67d8800640 1 -- 172.21.15.2:0/2576310065 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67d0144c90 msgr2=0x7f67d00af1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T08:48:50.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.975+0000 7f67d8800640 1 --2- 172.21.15.2:0/2576310065 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67d0144c90 0x7f67d00af1f0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f67cc009f00 tx=0x7f67cc00c490 comp rx=0 tx=0).stop 2024-09-10T08:48:50.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.975+0000 7f67d8800640 1 -- 172.21.15.2:0/2576310065 shutdown_connections 2024-09-10T08:48:50.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.975+0000 7f67d8800640 1 --2- 172.21.15.2:0/2576310065 >> [v2:172.21.15.155:6832/2264044153,v1:172.21.15.155:6833/2264044153] conn(0x7f67b406be30 0x7f67b406e2f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:50.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.975+0000 7f67d8800640 1 --2- 172.21.15.2:0/2576310065 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f67d0144c90 0x7f67d00af1f0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:50.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.975+0000 7f67d8800640 1 --2- 172.21.15.2:0/2576310065 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67d0144250 0x7f67d015ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:50.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.975+0000 7f67d8800640 1 --2- 172.21.15.2:0/2576310065 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f67d00cd2b0 0x7f67d015a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-10T08:48:50.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.975+0000 7f67d8800640 1 -- 172.21.15.2:0/2576310065 >> 172.21.15.2:0/2576310065 conn(0x7f67d006bc10 msgr2=0x7f67d0142d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T08:48:50.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.975+0000 7f67d8800640 1 -- 172.21.15.2:0/2576310065 shutdown_connections 2024-09-10T08:48:50.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-10T08:48:50.975+0000 7f67d8800640 1 -- 172.21.15.2:0/2576310065 wait complete. 2024-09-10T08:48:50.993 DEBUG:tasks.cephfs.filesystem:already dead... 2024-09-10T08:48:50.993 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-10T08:48:50.993 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-10T08:48:50.993 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:48:51.007 INFO:tasks.ceph.mds.a:Stopped 2024-09-10T08:48:51.007 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-10T08:48:51.007 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:48:51.062 INFO:tasks.ceph.mds.c:Stopped 2024-09-10T08:48:51.063 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-10T08:48:51.063 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:48:51.080 INFO:tasks.ceph.mds.b:Stopped 2024-09-10T08:48:51.081 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-10T08:48:51.081 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:48:51.136 INFO:tasks.ceph.mds.d:Stopped 2024-09-10T08:48:51.136 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-10T08:48:51.136 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-10T08:48:51.136 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:48:51.176 INFO:tasks.ceph.osd.0:Stopped 2024-09-10T08:48:51.176 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-10T08:48:51.176 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:48:51.264 INFO:tasks.ceph.osd.1:Stopped 2024-09-10T08:48:51.265 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-10T08:48:51.265 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:48:51.309 INFO:tasks.ceph.osd.2:Stopped 2024-09-10T08:48:51.310 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-10T08:48:51.310 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:48:51.368 INFO:tasks.ceph.osd.3:Stopped 2024-09-10T08:48:51.368 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-10T08:48:51.369 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:48:51.411 INFO:tasks.ceph.osd.4:Stopped 2024-09-10T08:48:51.411 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-10T08:48:51.411 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:48:51.467 INFO:tasks.ceph.osd.5:Stopped 2024-09-10T08:48:51.467 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-10T08:48:51.467 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:48:51.515 INFO:tasks.ceph.osd.6:Stopped 2024-09-10T08:48:51.516 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-10T08:48:51.516 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:48:51.570 INFO:tasks.ceph.osd.7:Stopped 2024-09-10T08:48:51.571 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-10T08:48:51.571 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-10T08:48:51.571 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:48:51.637 INFO:tasks.ceph.mgr.y:Stopped 2024-09-10T08:48:51.637 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-10T08:48:51.637 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:48:51.704 INFO:tasks.ceph.mgr.x:Stopped 2024-09-10T08:48:51.704 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-10T08:48:51.704 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-10T08:48:51.705 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:48:51.726 INFO:tasks.ceph.mon.a:Stopped 2024-09-10T08:48:51.726 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-10T08:48:51.726 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:48:51.744 INFO:tasks.ceph.mon.b:Stopped 2024-09-10T08:48:51.745 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-10T08:48:51.745 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T08:48:51.804 INFO:tasks.ceph.mon.c:Stopped 2024-09-10T08:48:51.805 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-10T08:48:51.805 DEBUG:teuthology.orchestra.run.smithi002:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-10T08:48:51.882 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi002.front.sepia.ceph.com 2024-09-10T08:48:51.883 DEBUG:teuthology.orchestra.run.smithi002:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-10T08:48:52.125 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi002.front.sepia.ceph.com 2024-09-10T08:48:52.126 DEBUG:teuthology.orchestra.run.smithi002:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-10T08:48:52.239 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi002.front.sepia.ceph.com 2024-09-10T08:48:52.240 DEBUG:teuthology.orchestra.run.smithi002:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-10T08:48:52.337 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi002.front.sepia.ceph.com 2024-09-10T08:48:52.338 DEBUG:teuthology.orchestra.run.smithi002:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-10T08:48:52.430 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi155.front.sepia.ceph.com 2024-09-10T08:48:52.431 DEBUG:teuthology.orchestra.run.smithi155:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-10T08:48:52.683 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi155.front.sepia.ceph.com 2024-09-10T08:48:52.683 DEBUG:teuthology.orchestra.run.smithi155:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-10T08:48:52.797 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi155.front.sepia.ceph.com 2024-09-10T08:48:52.797 DEBUG:teuthology.orchestra.run.smithi155:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-10T08:48:52.929 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi155.front.sepia.ceph.com 2024-09-10T08:48:52.930 DEBUG:teuthology.orchestra.run.smithi155:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-10T08:48:53.048 INFO:tasks.ceph:Archiving mon data... 2024-09-10T08:48:53.049 DEBUG:teuthology.misc:Transferring archived files from smithi002:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898932/data/mon.a.tgz 2024-09-10T08:48:53.049 DEBUG:teuthology.orchestra.run.smithi002:> mktemp 2024-09-10T08:48:53.085 INFO:teuthology.orchestra.run.smithi002.stdout:/tmp/tmp.GlTtehtwrZ 2024-09-10T08:48:53.086 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.GlTtehtwrZ 2024-09-10T08:48:53.314 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0666 /tmp/tmp.GlTtehtwrZ 2024-09-10T08:48:53.409 DEBUG:teuthology.orchestra.remote:smithi002:/tmp/tmp.GlTtehtwrZ is 679KB 2024-09-10T08:48:53.506 DEBUG:teuthology.orchestra.run.smithi002:> rm -fr /tmp/tmp.GlTtehtwrZ 2024-09-10T08:48:53.542 DEBUG:teuthology.misc:Transferring archived files from smithi155:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898932/data/mon.b.tgz 2024-09-10T08:48:53.542 DEBUG:teuthology.orchestra.run.smithi155:> mktemp 2024-09-10T08:48:53.578 INFO:teuthology.orchestra.run.smithi155.stdout:/tmp/tmp.rQ4O44QgEU 2024-09-10T08:48:53.578 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.rQ4O44QgEU 2024-09-10T08:48:53.844 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 0666 /tmp/tmp.rQ4O44QgEU 2024-09-10T08:48:53.938 DEBUG:teuthology.orchestra.remote:smithi155:/tmp/tmp.rQ4O44QgEU is 970KB 2024-09-10T08:48:54.036 DEBUG:teuthology.orchestra.run.smithi155:> rm -fr /tmp/tmp.rQ4O44QgEU 2024-09-10T08:48:54.071 DEBUG:teuthology.misc:Transferring archived files from smithi155:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898932/data/mon.c.tgz 2024-09-10T08:48:54.072 DEBUG:teuthology.orchestra.run.smithi155:> mktemp 2024-09-10T08:48:54.147 INFO:teuthology.orchestra.run.smithi155.stdout:/tmp/tmp.S2SjSpAifq 2024-09-10T08:48:54.147 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.S2SjSpAifq 2024-09-10T08:48:54.403 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 0666 /tmp/tmp.S2SjSpAifq 2024-09-10T08:48:54.497 DEBUG:teuthology.orchestra.remote:smithi155:/tmp/tmp.S2SjSpAifq is 970KB 2024-09-10T08:48:54.597 DEBUG:teuthology.orchestra.run.smithi155:> rm -fr /tmp/tmp.S2SjSpAifq 2024-09-10T08:48:54.633 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-10T08:48:54.633 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-10T08:48:54.637 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-10T08:48:54.767 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-10T08:48:54.803 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-10T08:48:54.803 INFO:tasks.ceph:Archiving crash dumps... 2024-09-10T08:48:54.805 DEBUG:teuthology.misc:Transferring archived files from smithi002:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898932/remote/smithi002/crash 2024-09-10T08:48:54.806 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-10T08:48:54.865 DEBUG:teuthology.misc:Transferring archived files from smithi155:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898932/remote/smithi155/crash 2024-09-10T08:48:54.866 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-10T08:48:54.921 INFO:tasks.ceph:Shutting down logrotate 2024-09-10T08:48:54.921 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:48:54.926 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-10T08:48:55.017 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-10T08:48:55.073 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-10T08:48:55.129 INFO:tasks.ceph:Compressing logs... 2024-09-10T08:48:55.129 DEBUG:teuthology.orchestra.run.smithi002:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T08:48:55.133 DEBUG:teuthology.orchestra.run.smithi155:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T08:48:55.184 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-10T08:48:55.184 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48990.log 2024-09-10T08:48:55.185 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47775.log 2024-09-10T08:48:55.186 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41620.log 2024-09-10T08:48:55.186 INFO:teuthology.orchestra.run.smithi002.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48990.log.gz 2024-09-10T08:48:55.187 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40664.log 2024-09-10T08:48:55.187 INFO:teuthology.orchestra.run.smithi002.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47775.log.gz 2024-09-10T08:48:55.188 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36146.log 2024-09-10T08:48:55.188 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-10T08:48:55.189 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36228.log 2024-09-10T08:48:55.189 INFO:teuthology.orchestra.run.smithi002.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41620.log.gz 2024-09-10T08:48:55.189 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.40664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48134.log 2024-09-10T08:48:55.190 INFO:teuthology.orchestra.run.smithi002.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.40664.log.gz 2024-09-10T08:48:55.194 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.36146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.41519.log 2024-09-10T08:48:55.194 INFO:teuthology.orchestra.run.smithi155.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36146.log.gz 2024-09-10T08:48:55.194 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-09-10T08:48:55.195 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.1.41519.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.1.41519.log.gz -5 2024-09-10T08:48:55.195 INFO:teuthology.orchestra.run.smithi155.stderr: --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-10T08:48:55.195 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-10T08:48:55.195 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35935.log 2024-09-10T08:48:55.195 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-10T08:48:55.207 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.35935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36021.log 2024-09-10T08:48:55.207 INFO:teuthology.orchestra.run.smithi155.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35935.log.gz 2024-09-10T08:48:55.207 INFO:teuthology.orchestra.run.smithi155.stderr: 93.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-10T08:48:55.207 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35895.log 2024-09-10T08:48:55.208 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.36021.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36021.log.gz 2024-09-10T08:48:55.208 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35975.log 2024-09-10T08:48:55.208 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.35895.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-10T08:48:55.208 INFO:teuthology.orchestra.run.smithi155.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35895.log.gz 2024-09-10T08:48:55.208 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.35975.log: 89.0%gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-10T08:48:55.208 INFO:teuthology.orchestra.run.smithi155.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35975.log.gz 2024-09-10T08:48:55.208 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-10T08:48:55.208 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36106.log 2024-09-10T08:48:55.208 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-09-10T08:48:55.208 INFO:teuthology.orchestra.run.smithi155.stderr: 91.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-10T08:48:55.209 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.admin.36106.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36106.log.gz 2024-09-10T08:48:55.209 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-10T08:48:55.210 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.36228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45427.log 2024-09-10T08:48:55.211 INFO:teuthology.orchestra.run.smithi002.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.36228.log.gz 2024-09-10T08:48:55.211 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48134.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48134.log.gz 2024-09-10T08:48:55.211 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46622.log 2024-09-10T08:48:55.211 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46117.log 2024-09-10T08:48:55.211 INFO:teuthology.orchestra.run.smithi002.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45427.log.gz 2024-09-10T08:48:55.211 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45724.log 2024-09-10T08:48:55.211 INFO:teuthology.orchestra.run.smithi002.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46622.log.gz 2024-09-10T08:48:55.211 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42093.log 2024-09-10T08:48:55.211 INFO:teuthology.orchestra.run.smithi002.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46117.log.gz 2024-09-10T08:48:55.211 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45724.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45724.log.gz 2024-09-10T08:48:55.211 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44888.log 2024-09-10T08:48:55.212 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42418.log 2024-09-10T08:48:55.212 INFO:teuthology.orchestra.run.smithi002.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42093.log.gz 2024-09-10T08:48:55.212 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48260.log 2024-09-10T08:48:55.212 INFO:teuthology.orchestra.run.smithi002.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44888.log.gz 2024-09-10T08:48:55.212 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45262.log 2024-09-10T08:48:55.212 INFO:teuthology.orchestra.run.smithi002.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42418.log.gz 2024-09-10T08:48:55.212 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48260.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.29825.log 2024-09-10T08:48:55.212 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48260.log.gz 2024-09-10T08:48:55.212 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47147.log 2024-09-10T08:48:55.212 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45262.log.gz 2024-09-10T08:48:55.213 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph.tmp-client.admin.29825.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.29825.log.gz 2024-09-10T08:48:55.213 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48638.log 2024-09-10T08:48:55.213 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47147.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-10T08:48:55.213 INFO:teuthology.orchestra.run.smithi002.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47147.log.gz 2024-09-10T08:48:55.213 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47649.log 2024-09-10T08:48:55.213 INFO:teuthology.orchestra.run.smithi002.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48638.log.gz 2024-09-10T08:48:55.213 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48386.log 2024-09-10T08:48:55.213 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44972.log 2024-09-10T08:48:55.213 INFO:teuthology.orchestra.run.smithi002.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47649.log.gz 2024-09-10T08:48:55.213 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48428.log 2024-09-10T08:48:55.214 INFO:teuthology.orchestra.run.smithi002.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48386.log.gz 2024-09-10T08:48:55.214 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44972.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44972.log.gz 2024-09-10T08:48:55.214 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41536.log 2024-09-10T08:48:55.214 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48218.log 2024-09-10T08:48:55.214 INFO:teuthology.orchestra.run.smithi002.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48428.log.gz 2024-09-10T08:48:55.214 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42838.log 2024-09-10T08:48:55.214 INFO:teuthology.orchestra.run.smithi002.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.41536.log.gz 2024-09-10T08:48:55.214 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42670.log 2024-09-10T08:48:55.214 INFO:teuthology.orchestra.run.smithi002.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48218.log.gz 2024-09-10T08:48:55.214 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42838.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.42838.log.gz 2024-09-10T08:48:55.215 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42083.log 2024-09-10T08:48:55.215 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44640.log 2024-09-10T08:48:55.215 INFO:teuthology.orchestra.run.smithi002.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42670.log.gz 2024-09-10T08:48:55.220 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-mds.d.log: /var/log/ceph/ceph-mgr.x.log: 92.3% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-09-10T08:48:55.221 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.41934.log 2024-09-10T08:48:55.221 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36186.log 2024-09-10T08:48:55.221 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/ceph-client.3.41934.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.41934.log.gz 2024-09-10T08:48:55.221 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-10T08:48:55.221 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.36186.log: /var/log/ceph/ceph-client.admin.36066.log 2024-09-10T08:48:55.221 INFO:teuthology.orchestra.run.smithi155.stderr: 86.9%/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-client.admin.36066.log: -- replaced with /var/log/ceph/ceph-client.admin.36186.log.gz 2024-09-10T08:48:55.221 INFO:teuthology.orchestra.run.smithi155.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36066.log.gz 2024-09-10T08:48:55.224 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42083.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42083.log.gz 2024-09-10T08:48:55.225 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43998.log 2024-09-10T08:48:55.225 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44040.log 2024-09-10T08:48:55.225 INFO:teuthology.orchestra.run.smithi002.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44640.log.gz 2024-09-10T08:48:55.225 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43998.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43998.log.gz 2024-09-10T08:48:55.225 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47028.log 2024-09-10T08:48:55.225 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42094.log 2024-09-10T08:48:55.225 INFO:teuthology.orchestra.run.smithi002.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44040.log.gz 2024-09-10T08:48:55.225 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47028.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47028.log.gz 2024-09-10T08:48:55.225 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45554.log 2024-09-10T08:48:55.226 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40198.log 2024-09-10T08:48:55.226 INFO:teuthology.orchestra.run.smithi002.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42094.log.gz 2024-09-10T08:48:55.226 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45554.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45554.log.gz 2024-09-10T08:48:55.226 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35868.log 2024-09-10T08:48:55.226 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.40198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46868.log 2024-09-10T08:48:55.226 INFO:teuthology.orchestra.run.smithi002.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.40198.log.gz 2024-09-10T08:48:55.226 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.35868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48008.log 2024-09-10T08:48:55.227 INFO:teuthology.orchestra.run.smithi002.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.35868.log.gz 2024-09-10T08:48:55.227 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40370.log 2024-09-10T08:48:55.227 INFO:teuthology.orchestra.run.smithi002.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.46868.log.gz 2024-09-10T08:48:55.227 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48008.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48008.log.gz 2024-09-10T08:48:55.227 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48722.log 2024-09-10T08:48:55.227 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.40370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45949.log 2024-09-10T08:48:55.227 INFO:teuthology.orchestra.run.smithi002.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40370.log.gz 2024-09-10T08:48:55.227 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48722.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48722.log.gzgzip 2024-09-10T08:48:55.228 INFO:teuthology.orchestra.run.smithi002.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.42754.log 2024-09-10T08:48:55.229 INFO:teuthology.orchestra.run.smithi155.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-09-10T08:48:55.233 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44082.log 2024-09-10T08:48:55.233 INFO:teuthology.orchestra.run.smithi002.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45949.log.gz 2024-09-10T08:48:55.233 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42754.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42754.log.gz 2024-09-10T08:48:55.233 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47284.log 2024-09-10T08:48:55.233 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46309.log 2024-09-10T08:48:55.233 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44082.log.gz 2024-09-10T08:48:55.234 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47284.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47284.log.gz 2024-09-10T08:48:55.234 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42091.log 2024-09-10T08:48:55.234 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46309.log: gzip 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46309.log.gz 2024-09-10T08:48:55.234 INFO:teuthology.orchestra.run.smithi002.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.47691.log 2024-09-10T08:48:55.234 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44124.log 2024-09-10T08:48:55.234 INFO:teuthology.orchestra.run.smithi002.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42091.log.gz 2024-09-10T08:48:55.234 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47691.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47691.log.gz 2024-09-10T08:48:55.234 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46075.log 2024-09-10T08:48:55.235 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45014.log 2024-09-10T08:48:55.235 INFO:teuthology.orchestra.run.smithi002.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44124.log.gz 2024-09-10T08:48:55.237 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46075.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46075.log.gz 2024-09-10T08:48:55.237 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44528.log 2024-09-10T08:48:55.238 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45014.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-10T08:48:55.238 INFO:teuthology.orchestra.run.smithi002.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45014.log.gz 2024-09-10T08:48:55.238 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44528.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44528.log.gz 2024-09-10T08:48:55.238 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42427.log 2024-09-10T08:48:55.238 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46952.log 2024-09-10T08:48:55.239 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42427.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42427.log.gz 2024-09-10T08:48:55.239 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 89.1% --verbose -- replaced with /var/log/ceph/ceph.audit.log.gz -- 2024-09-10T08:48:55.239 INFO:teuthology.orchestra.run.smithi002.stderr: /var/log/ceph/ceph-client.admin.44445.log 2024-09-10T08:48:55.239 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46201.log 2024-09-10T08:48:55.239 INFO:teuthology.orchestra.run.smithi002.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46952.log.gz 2024-09-10T08:48:55.240 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48344.log 2024-09-10T08:48:55.240 INFO:teuthology.orchestra.run.smithi002.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44445.log.gz 2024-09-10T08:48:55.241 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46201.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46201.log.gz 2024-09-10T08:48:55.241 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48806.log 2024-09-10T08:48:55.242 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45680.log 2024-09-10T08:48:55.242 INFO:teuthology.orchestra.run.smithi002.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48344.log.gz 2024-09-10T08:48:55.243 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48806.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48806.log.gz 2024-09-10T08:48:55.243 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.43864.log 2024-09-10T08:48:55.244 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41329.log 2024-09-10T08:48:55.244 INFO:teuthology.orchestra.run.smithi002.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45680.log.gz 2024-09-10T08:48:55.245 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.2.43864.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.43864.log.gz 2024-09-10T08:48:55.245 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42421.log 2024-09-10T08:48:55.246 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47336.log 2024-09-10T08:48:55.246 INFO:teuthology.orchestra.run.smithi002.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41329.log.gz 2024-09-10T08:48:55.248 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42421.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42421.log.gz 2024-09-10T08:48:55.248 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48302.log 2024-09-10T08:48:55.249 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40730.log 2024-09-10T08:48:55.249 INFO:teuthology.orchestra.run.smithi002.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47336.log.gz 2024-09-10T08:48:55.249 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48302.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48302.log.gz 2024-09-10T08:48:55.250 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46033.log 2024-09-10T08:48:55.250 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.40730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44292.log 2024-09-10T08:48:55.251 INFO:teuthology.orchestra.run.smithi002.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40730.log.gz 2024-09-10T08:48:55.252 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46033.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46033.log.gz 2024-09-10T08:48:55.252 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45991.log 2024-09-10T08:48:55.259 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41704.log 2024-09-10T08:48:55.259 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44292.log.gz 2024-09-10T08:48:55.259 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45991.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45991.log.gz 2024-09-10T08:48:55.259 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48470.log 2024-09-10T08:48:55.259 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47504.log 2024-09-10T08:48:55.260 INFO:teuthology.orchestra.run.smithi002.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41704.log.gz 2024-09-10T08:48:55.260 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48470.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48470.log.gz 2024-09-10T08:48:55.260 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42095.log 2024-09-10T08:48:55.260 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39892.log 2024-09-10T08:48:55.260 INFO:teuthology.orchestra.run.smithi002.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47504.log.gz 2024-09-10T08:48:55.260 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42095.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.42095.log.gz 2024-09-10T08:48:55.260 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47564.log 2024-09-10T08:48:55.261 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.39892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47378.log 2024-09-10T08:48:55.262 INFO:teuthology.orchestra.run.smithi002.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.39892.log.gz 2024-09-10T08:48:55.263 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47564.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47564.log.gz 2024-09-10T08:48:55.263 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41662.log 2024-09-10T08:48:55.263 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45140.log 2024-09-10T08:48:55.263 INFO:teuthology.orchestra.run.smithi002.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47378.log.gz 2024-09-10T08:48:55.263 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41662.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41662.log.gz 2024-09-10T08:48:55.263 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40154.log 2024-09-10T08:48:55.264 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44762.log 2024-09-10T08:48:55.264 INFO:teuthology.orchestra.run.smithi002.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45140.log.gz 2024-09-10T08:48:55.264 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.40154.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40154.log.gz 2024-09-10T08:48:55.265 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-10T08:48:55.266 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47733.log 2024-09-10T08:48:55.266 INFO:teuthology.orchestra.run.smithi002.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44762.log.gz 2024-09-10T08:48:55.266 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40412.log 2024-09-10T08:48:55.267 INFO:teuthology.orchestra.run.smithi002.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-10T08:48:55.268 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40454.log 2024-09-10T08:48:55.268 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47733.log.gz 2024-09-10T08:48:55.269 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.40412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48512.log 2024-09-10T08:48:55.269 INFO:teuthology.orchestra.run.smithi002.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40412.log.gz 2024-09-10T08:48:55.269 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.40454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46738.log 2024-09-10T08:48:55.271 INFO:teuthology.orchestra.run.smithi002.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40454.log.gz 2024-09-10T08:48:55.271 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48512.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48512.log.gz 2024-09-10T08:48:55.271 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40070.log 2024-09-10T08:48:55.272 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41387.log 2024-09-10T08:48:55.272 INFO:teuthology.orchestra.run.smithi002.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46738.log.gz 2024-09-10T08:48:55.273 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.40070.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40070.log.gz 2024-09-10T08:48:55.274 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45098.log 2024-09-10T08:48:55.275 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42085.log 2024-09-10T08:48:55.275 INFO:teuthology.orchestra.run.smithi002.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41387.log.gz 2024-09-10T08:48:55.275 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45098.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45098.log.gzgzip 2024-09-10T08:48:55.275 INFO:teuthology.orchestra.run.smithi002.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.45768.log 2024-09-10T08:48:55.277 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40580.log 2024-09-10T08:48:55.277 INFO:teuthology.orchestra.run.smithi002.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42085.log.gz 2024-09-10T08:48:55.277 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45768.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45768.log.gz 2024-09-10T08:48:55.278 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48596.log 2024-09-10T08:48:55.278 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.40580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40326.log 2024-09-10T08:48:55.278 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40580.log.gz 2024-09-10T08:48:55.279 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48596.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48596.log.gz 2024-09-10T08:48:55.279 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47817.log 2024-09-10T08:48:55.280 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.40326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45596.log 2024-09-10T08:48:55.281 INFO:teuthology.orchestra.run.smithi002.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40326.log.gz 2024-09-10T08:48:55.281 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40242.log 2024-09-10T08:48:55.282 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47817.log.gz 2024-09-10T08:48:55.282 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44208.log 2024-09-10T08:48:55.283 INFO:teuthology.orchestra.run.smithi002.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45596.log.gz 2024-09-10T08:48:55.283 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.40242.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40242.log.gz 2024-09-10T08:48:55.284 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45861.log 2024-09-10T08:48:55.284 INFO:teuthology.orchestra.run.smithi155.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-10T08:48:55.286 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40538.log 2024-09-10T08:48:55.286 INFO:teuthology.orchestra.run.smithi002.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44208.log.gz 2024-09-10T08:48:55.286 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45861.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45861.log.gz 2024-09-10T08:48:55.286 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44250.log 2024-09-10T08:48:55.287 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.40538.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-10T08:48:55.287 INFO:teuthology.orchestra.run.smithi002.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40538.log.gz 2024-09-10T08:48:55.288 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44250.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44250.log.gz 2024-09-10T08:48:55.288 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45470.log 2024-09-10T08:48:55.290 INFO:teuthology.orchestra.run.smithi155.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-10T08:48:55.292 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42712.log 2024-09-10T08:48:55.292 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45470.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45470.log.gz 2024-09-10T08:48:55.292 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42425.log 2024-09-10T08:48:55.292 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42712.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42712.log.gz 2024-09-10T08:48:55.292 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48908.log 2024-09-10T08:48:55.293 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43407.log 2024-09-10T08:48:55.293 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48908.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42425.log.gz 2024-09-10T08:48:55.294 INFO:teuthology.orchestra.run.smithi002.stderr:gzip 87.3% -5 -- replaced with /var/log/ceph/ceph-client.admin.48908.log.gz --verbose 2024-09-10T08:48:55.294 INFO:teuthology.orchestra.run.smithi002.stderr: -- /var/log/ceph/ceph-client.admin.42431.log 2024-09-10T08:48:55.294 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.0.43407.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.43407.log.gz 2024-09-10T08:48:55.295 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45343.log 2024-09-10T08:48:55.295 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41914.log 2024-09-10T08:48:55.296 INFO:teuthology.orchestra.run.smithi002.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42431.log.gz 2024-09-10T08:48:55.297 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45343.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45343.log.gz 2024-09-10T08:48:55.297 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42796.log 2024-09-10T08:48:55.298 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47462.log 2024-09-10T08:48:55.298 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41914.log.gz 2024-09-10T08:48:55.299 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42796.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-10T08:48:55.299 INFO:teuthology.orchestra.run.smithi002.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42796.log.gz 2024-09-10T08:48:55.300 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48848.log 2024-09-10T08:48:55.301 INFO:teuthology.orchestra.run.smithi002.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47462.log.gz 2024-09-10T08:48:55.302 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39806.log 2024-09-10T08:48:55.303 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42096.log 2024-09-10T08:48:55.303 INFO:teuthology.orchestra.run.smithi002.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48848.log.gz 2024-09-10T08:48:55.304 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.39806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45819.log 2024-09-10T08:48:55.304 INFO:teuthology.orchestra.run.smithi002.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39806.log.gz 2024-09-10T08:48:55.305 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44719.log 2024-09-10T08:48:55.305 INFO:teuthology.orchestra.run.smithi002.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42096.log.gz 2024-09-10T08:48:55.306 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48948.log 2024-09-10T08:48:55.306 INFO:teuthology.orchestra.run.smithi002.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45819.log.gz 2024-09-10T08:48:55.308 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42922.log 2024-09-10T08:48:55.308 INFO:teuthology.orchestra.run.smithi002.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44719.log.gz 2024-09-10T08:48:55.309 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46497.log 2024-09-10T08:48:55.309 INFO:teuthology.orchestra.run.smithi002.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48948.log.gz 2024-09-10T08:48:55.310 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46577.log 2024-09-10T08:48:55.311 INFO:teuthology.orchestra.run.smithi002.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.42922.log.gz 2024-09-10T08:48:55.311 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.0.46497.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.46497.log.gz 2024-09-10T08:48:55.312 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-10T08:48:55.313 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46577.log: gzip -5 --verbose -- 88.4% /var/log/ceph/ceph-client.admin.40496.log -- replaced with /var/log/ceph/ceph-client.admin.46577.log.gz 2024-09-10T08:48:55.313 INFO:teuthology.orchestra.run.smithi002.stderr: 2024-09-10T08:48:55.314 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-10T08:48:55.315 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.40496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41872.log 2024-09-10T08:48:55.315 INFO:teuthology.orchestra.run.smithi002.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40496.log.gz 2024-09-10T08:48:55.317 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45385.log 2024-09-10T08:48:55.317 INFO:teuthology.orchestra.run.smithi002.stderr: 84.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-10T08:48:55.318 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41578.log 2024-09-10T08:48:55.318 INFO:teuthology.orchestra.run.smithi002.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41872.log.gz 2024-09-10T08:48:55.319 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47607.log 2024-09-10T08:48:55.319 INFO:teuthology.orchestra.run.smithi002.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45385.log.gz 2024-09-10T08:48:55.321 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44166.log 2024-09-10T08:48:55.321 INFO:teuthology.orchestra.run.smithi002.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.41578.log.gz 2024-09-10T08:48:55.321 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47607.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47607.log.gz 2024-09-10T08:48:55.322 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40284.log 2024-09-10T08:48:55.323 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45512.log 2024-09-10T08:48:55.324 INFO:teuthology.orchestra.run.smithi002.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44166.log.gz 2024-09-10T08:48:55.324 INFO:teuthology.orchestra.run.smithi002.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-10T08:48:55.325 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.40284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45638.log 2024-09-10T08:48:55.325 INFO:teuthology.orchestra.run.smithi002.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.40284.log.gz 2024-09-10T08:48:55.325 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45903.log 2024-09-10T08:48:55.326 INFO:teuthology.orchestra.run.smithi155.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-10T08:48:55.326 INFO:teuthology.orchestra.run.smithi002.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45512.log.gz 2024-09-10T08:48:55.327 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41156.log 2024-09-10T08:48:55.327 INFO:teuthology.orchestra.run.smithi002.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45638.log.gz 2024-09-10T08:48:55.328 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48680.log 2024-09-10T08:48:55.328 INFO:teuthology.orchestra.run.smithi002.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45903.log.gz 2024-09-10T08:48:55.329 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40112.log 2024-09-10T08:48:55.331 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44846.log 2024-09-10T08:48:55.331 INFO:teuthology.orchestra.run.smithi002.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48680.log.gz 2024-09-10T08:48:55.331 INFO:teuthology.orchestra.run.smithi002.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.41156.log.gz 2024-09-10T08:48:55.332 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.40112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48050.log 2024-09-10T08:48:55.332 INFO:teuthology.orchestra.run.smithi002.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40112.log.gz 2024-09-10T08:48:55.333 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40622.log 2024-09-10T08:48:55.333 INFO:teuthology.orchestra.run.smithi002.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44846.log.gz 2024-09-10T08:48:55.334 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43560.log 2024-09-10T08:48:55.335 INFO:teuthology.orchestra.run.smithi002.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48050.log.gz 2024-09-10T08:48:55.336 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.40622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47241.log 2024-09-10T08:48:55.336 INFO:teuthology.orchestra.run.smithi002.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40622.log.gz 2024-09-10T08:48:55.336 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41788.log 2024-09-10T08:48:55.337 INFO:teuthology.orchestra.run.smithi002.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43560.log.gz 2024-09-10T08:48:55.338 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44804.log 2024-09-10T08:48:55.338 INFO:teuthology.orchestra.run.smithi002.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47241.log.gz 2024-09-10T08:48:55.339 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42628.log 2024-09-10T08:48:55.339 INFO:teuthology.orchestra.run.smithi002.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41788.log.gz 2024-09-10T08:48:55.340 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48092.log 2024-09-10T08:48:55.340 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44804.log.gz 2024-09-10T08:48:55.341 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43087.log 2024-09-10T08:48:55.342 INFO:teuthology.orchestra.run.smithi002.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42628.log.gz 2024-09-10T08:48:55.344 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45182.log 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48092.log.gz 2024-09-10T08:48:55.344 INFO:teuthology.orchestra.run.smithi002.stderr: 2024-09-10T08:48:55.345 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.43087.log: 88.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48764.log 2024-09-10T08:48:55.345 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43087.log.gz 2024-09-10T08:48:55.346 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42430.log 2024-09-10T08:48:55.347 INFO:teuthology.orchestra.run.smithi002.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45182.log.gz 2024-09-10T08:48:55.347 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42428.log 2024-09-10T08:48:55.347 INFO:teuthology.orchestra.run.smithi002.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48764.log.gz 2024-09-10T08:48:55.348 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41830.log 2024-09-10T08:48:55.348 INFO:teuthology.orchestra.run.smithi002.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42430.log.gz 2024-09-10T08:48:55.349 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42432.log 2024-09-10T08:48:55.349 INFO:teuthology.orchestra.run.smithi002.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42428.log.gz 2024-09-10T08:48:55.351 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45056.log 2024-09-10T08:48:55.351 INFO:teuthology.orchestra.run.smithi002.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.41830.log.gz 2024-09-10T08:48:55.352 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42880.log 2024-09-10T08:48:55.352 INFO:teuthology.orchestra.run.smithi002.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42432.log.gz 2024-09-10T08:48:55.353 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41746.log 2024-09-10T08:48:55.353 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45056.log.gz 2024-09-10T08:48:55.354 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46672.log 2024-09-10T08:48:55.355 INFO:teuthology.orchestra.run.smithi002.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42880.log.gz 2024-09-10T08:48:55.355 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44930.log 2024-09-10T08:48:55.356 INFO:teuthology.orchestra.run.smithi002.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.41746.log.gz 2024-09-10T08:48:55.357 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48176.log 2024-09-10T08:48:55.357 INFO:teuthology.orchestra.run.smithi002.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46672.log.gz 2024-09-10T08:48:55.358 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46797.log 2024-09-10T08:48:55.358 INFO:teuthology.orchestra.run.smithi002.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44930.log.gz 2024-09-10T08:48:55.359 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46243.log 2024-09-10T08:48:55.360 INFO:teuthology.orchestra.run.smithi002.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48176.log.gz 2024-09-10T08:48:55.360 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48554.log 2024-09-10T08:48:55.361 INFO:teuthology.orchestra.run.smithi002.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46797.log.gz 2024-09-10T08:48:55.362 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44334.log 2024-09-10T08:48:55.363 INFO:teuthology.orchestra.run.smithi002.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.46243.log.gz 2024-09-10T08:48:55.363 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47420.log 2024-09-10T08:48:55.363 INFO:teuthology.orchestra.run.smithi002.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48554.log.gz 2024-09-10T08:48:55.364 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.44334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41494.log 2024-09-10T08:48:55.364 INFO:teuthology.orchestra.run.smithi002.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44334.log.gz 2024-09-10T08:48:55.365 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39988.log 2024-09-10T08:48:55.366 INFO:teuthology.orchestra.run.smithi002.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47420.log.gz 2024-09-10T08:48:55.367 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.41494.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-10T08:48:55.367 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41494.log.gz 2024-09-10T08:48:55.368 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.39988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36133.log 2024-09-10T08:48:55.368 INFO:teuthology.orchestra.run.smithi002.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.39988.log.gz 2024-09-10T08:48:55.369 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-09-10T08:48:55.371 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.36133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46159.log 2024-09-10T08:48:55.371 INFO:teuthology.orchestra.run.smithi002.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36133.log.gz 2024-09-10T08:48:55.372 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42084.log 2024-09-10T08:48:55.373 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46159.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46159.log.gz 2024-09-10T08:48:55.374 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46910.log 2024-09-10T08:48:55.375 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.42084.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42084.log.gz 2024-09-10T08:48:55.376 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46910.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46910.log.gz 2024-09-10T08:48:55.407 INFO:teuthology.orchestra.run.smithi002.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-09-10T08:48:55.485 INFO:teuthology.orchestra.run.smithi002.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-10T08:48:55.871 INFO:teuthology.orchestra.run.smithi155.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-10T08:48:55.878 INFO:teuthology.orchestra.run.smithi155.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-10T08:48:55.899 INFO:teuthology.orchestra.run.smithi002.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-10T08:48:55.909 INFO:teuthology.orchestra.run.smithi155.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-10T08:48:55.935 INFO:teuthology.orchestra.run.smithi155.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-10T08:48:55.938 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-09-10T08:48:55.938 INFO:teuthology.orchestra.run.smithi155.stderr:real 0m0.772s 2024-09-10T08:48:55.938 INFO:teuthology.orchestra.run.smithi155.stderr:user 0m2.901s 2024-09-10T08:48:55.939 INFO:teuthology.orchestra.run.smithi155.stderr:sys 0m0.321s 2024-09-10T08:48:55.942 INFO:teuthology.orchestra.run.smithi002.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-10T08:48:56.052 INFO:teuthology.orchestra.run.smithi002.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-10T08:48:56.112 INFO:teuthology.orchestra.run.smithi002.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-10T08:48:56.115 INFO:teuthology.orchestra.run.smithi002.stderr: 2024-09-10T08:48:56.115 INFO:teuthology.orchestra.run.smithi002.stderr:real 0m0.953s 2024-09-10T08:48:56.115 INFO:teuthology.orchestra.run.smithi002.stderr:user 0m2.999s 2024-09-10T08:48:56.115 INFO:teuthology.orchestra.run.smithi002.stderr:sys 0m0.699s 2024-09-10T08:48:56.116 INFO:tasks.ceph:Archiving logs... 2024-09-10T08:48:56.116 DEBUG:teuthology.misc:Transferring archived files from smithi002:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898932/remote/smithi002/log 2024-09-10T08:48:56.117 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T08:48:56.702 DEBUG:teuthology.misc:Transferring archived files from smithi155:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898932/remote/smithi155/log 2024-09-10T08:48:56.703 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T08:48:57.177 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-10T08:48:57.186 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-10T08:48:57.187 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T08:48:57.191 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T08:48:57.305 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-10T08:48:57.314 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-10T08:48:57.314 DEBUG:teuthology.orchestra.run.smithi002:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T08:48:57.318 DEBUG:teuthology.orchestra.run.smithi155:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T08:48:57.348 INFO:teuthology.orchestra.run.smithi002.stderr:bash: line 1: ntpq: command not found 2024-09-10T08:48:57.351 INFO:teuthology.orchestra.run.smithi155.stderr:bash: line 1: ntpq: command not found 2024-09-10T08:48:57.355 INFO:teuthology.orchestra.run.smithi002.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T08:48:57.355 INFO:teuthology.orchestra.run.smithi002.stdout:=============================================================================== 2024-09-10T08:48:57.355 INFO:teuthology.orchestra.run.smithi002.stdout:^* hv01.front.sepia.ceph.com 3 6 377 47 +839us[ +840us] +/- 38ms 2024-09-10T08:48:57.355 INFO:teuthology.orchestra.run.smithi002.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 45 +1645us[+1645us] +/- 60ms 2024-09-10T08:48:57.355 INFO:teuthology.orchestra.run.smithi002.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 46 -4338us[-4338us] +/- 86ms 2024-09-10T08:48:57.355 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T08:48:57.358 INFO:teuthology.orchestra.run.smithi155.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-10T08:48:57.358 INFO:teuthology.orchestra.run.smithi155.stdout:=============================================================================== 2024-09-10T08:48:57.358 INFO:teuthology.orchestra.run.smithi155.stdout:^* hv01.front.sepia.ceph.com 3 6 377 46 +872us[ +895us] +/- 38ms 2024-09-10T08:48:57.358 INFO:teuthology.orchestra.run.smithi155.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 46 +1643us[+1643us] +/- 60ms 2024-09-10T08:48:57.358 INFO:teuthology.orchestra.run.smithi155.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 46 -4336us[-4336us] +/- 86ms 2024-09-10T08:48:57.358 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-10T08:48:57.359 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-10T08:48:57.368 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-10T08:48:57.369 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-10T08:48:57.402 DEBUG:teuthology.orchestra.run.smithi002:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T08:48:57.522 DEBUG:teuthology.orchestra.run.smithi155:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-10T08:48:57.634 DEBUG:teuthology.orchestra.run.smithi002:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T08:48:57.695 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T08:48:57.695 DEBUG:teuthology.orchestra.run.smithi155:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-10T08:48:57.755 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T08:48:57.755 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-10T08:48:57.766 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-10T08:48:57.793 INFO:teuthology.task.internal:Duration was 600.601453 seconds 2024-09-10T08:48:57.794 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-10T08:48:57.844 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-10T08:48:57.844 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T08:48:57.848 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T08:48:57.932 INFO:teuthology.orchestra.run.smithi002.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T08:48:57.936 INFO:teuthology.orchestra.run.smithi155.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-10T08:48:58.426 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-10T08:48:58.426 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi002.front.sepia.ceph.com 2024-09-10T08:48:58.426 DEBUG:teuthology.orchestra.run.smithi002:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T08:48:58.479 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi155.front.sepia.ceph.com 2024-09-10T08:48:58.479 DEBUG:teuthology.orchestra.run.smithi155:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T08:48:58.528 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-10T08:48:58.528 DEBUG:teuthology.orchestra.run.smithi002:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T08:48:58.533 DEBUG:teuthology.orchestra.run.smithi155:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T08:48:58.592 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-10T08:48:58.592 DEBUG:teuthology.orchestra.run.smithi002:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T08:48:58.596 DEBUG:teuthology.orchestra.run.smithi155:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T08:48:58.747 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-10T08:48:58.757 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-10T08:48:58.758 DEBUG:teuthology.orchestra.run.smithi002:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T08:48:58.814 DEBUG:teuthology.orchestra.run.smithi155:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T08:48:58.871 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-10T08:48:58.881 DEBUG:teuthology.orchestra.run.smithi002:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T08:48:58.886 DEBUG:teuthology.orchestra.run.smithi155:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T08:48:58.953 INFO:teuthology.orchestra.run.smithi002.stdout:kernel.core_pattern = core 2024-09-10T08:48:58.957 INFO:teuthology.orchestra.run.smithi155.stdout:kernel.core_pattern = core 2024-09-10T08:48:58.987 DEBUG:teuthology.orchestra.run.smithi002:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T08:48:59.020 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T08:48:59.021 DEBUG:teuthology.orchestra.run.smithi155:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T08:48:59.054 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T08:48:59.054 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-10T08:48:59.064 INFO:teuthology.task.internal:Transferring archived files... 2024-09-10T08:48:59.065 DEBUG:teuthology.misc:Transferring archived files from smithi002:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898932/remote/smithi002 2024-09-10T08:48:59.065 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T08:48:59.134 DEBUG:teuthology.misc:Transferring archived files from smithi155:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-10_06:58:10-fs-wip-rishabh-testing-20240909.165402-squid-distro-default-smithi/7898932/remote/smithi155 2024-09-10T08:48:59.134 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T08:48:59.198 INFO:teuthology.task.internal:Removing archive directory... 2024-09-10T08:48:59.198 DEBUG:teuthology.orchestra.run.smithi002:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T08:48:59.202 DEBUG:teuthology.orchestra.run.smithi155:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T08:48:59.237 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-10T08:48:59.249 INFO:teuthology.task.internal:Not uploading archives. 2024-09-10T08:48:59.249 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-10T08:48:59.278 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-10T08:48:59.278 DEBUG:teuthology.orchestra.run.smithi002:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T08:48:59.282 DEBUG:teuthology.orchestra.run.smithi155:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T08:48:59.313 INFO:teuthology.orchestra.run.smithi002.stdout: 393233 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 08:48 /home/ubuntu/cephtest 2024-09-10T08:48:59.318 INFO:teuthology.orchestra.run.smithi155.stdout: 393233 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 08:48 /home/ubuntu/cephtest 2024-09-10T08:48:59.320 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-10T08:48:59.331 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-10T08:48:59.432 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a client.1-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/snap_schedule_snapdir} duration: 600.6014533042908 flavor: default owner: scheduled_rishabh@teuthology success: true 2024-09-10T08:48:59.433 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T08:48:59.520 INFO:teuthology.run:pass